2024-05-15T14:16:29.629 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-15T14:16:29.629 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131 --name cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi --verbose --description rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/others/{0-install supported-distros/{centos_latest} test_others}} --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/orig.config.yaml 2024-05-15T14:16:29.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-15T14:16:29.745 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131 branch: wip-cbodley-testing description: rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/others/{0-install supported-distros/{centos_latest} test_others}} email: null first_in_suite: false job_id: '7707131' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cbodley-testing ceph: conf: client: debug rgw: 20 debug rgw lifecycle: 20 debug rgw notification: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= setgroup: ceph setuser: ceph global: osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: bf560a26040628fcc6ec3e608f9c4451acdef5e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bf560a26040628fcc6ec3e608f9c4451acdef5e2 rgw: frontend: beast realm: MyRealm storage classes: LUKEWARM, FROZEN zone: MyZone zonegroup: MyZoneGroup selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley-testing sha1: bf560a26040628fcc6ec3e608f9c4451acdef5e2 owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 533 sha1: bf560a26040628fcc6ec3e608f9c4451acdef5e2 sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bf560a26040628fcc6ec3e608f9c4451acdef5e2 targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIGOiAIRywfNHhWu0feBiCiJEU5I0oNDSPwZrcxt0GCoF9sa5bTlzG/6k1J/bg/hpQ3oKsM7gIQcq25EBhpzxk= smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOK62w/SYOggCcBf7HbhO/NdjNBJKXIwv9zvxVfBaFvjYxJZ5I6pD8oBMjxGTnJpeZUfg85b/RCzg3ws4lUg4zU= tasks: - install: null - ceph: null - openssl_keys: null - rgw: client.0: null client.1: null - notification-tests: client.0: rgw_server: client.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-15_14:09:14 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-15T14:16:29.745 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa; will attempt to use it 2024-05-15T14:16:29.746 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa/tasks 2024-05-15T14:16:29.746 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-15T14:16:29.747 INFO:teuthology.task.internal:Checking packages... 2024-05-15T14:16:29.772 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bf560a26040628fcc6ec3e608f9c4451acdef5e2' 2024-05-15T14:16:29.772 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-15T14:16:29.772 INFO:teuthology.packaging:ref: None 2024-05-15T14:16:29.772 INFO:teuthology.packaging:tag: None 2024-05-15T14:16:29.772 INFO:teuthology.packaging:branch: wip-cbodley-testing 2024-05-15T14:16:29.772 INFO:teuthology.packaging:sha1: bf560a26040628fcc6ec3e608f9c4451acdef5e2 2024-05-15T14:16:29.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cbodley-testing 2024-05-15T14:16:29.925 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3680.gbf560a26 2024-05-15T14:16:29.926 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-15T14:16:29.932 INFO:teuthology.task.internal:no buildpackages task found 2024-05-15T14:16:29.932 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-15T14:16:29.953 INFO:teuthology.task.internal:Saving configuration 2024-05-15T14:16:29.967 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-15T14:16:29.972 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T14:16:29.998 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 14:11:36.897022', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIGOiAIRywfNHhWu0feBiCiJEU5I0oNDSPwZrcxt0GCoF9sa5bTlzG/6k1J/bg/hpQ3oKsM7gIQcq25EBhpzxk='} 2024-05-15T14:16:30.020 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 14:11:36.898826', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOK62w/SYOggCcBf7HbhO/NdjNBJKXIwv9zvxVfBaFvjYxJZ5I6pD8oBMjxGTnJpeZUfg85b/RCzg3ws4lUg4zU='} 2024-05-15T14:16:30.020 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-15T14:16:30.026 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-05-15T14:16:30.026 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-15T14:16:30.026 INFO:teuthology.run_tasks:Running task console_log... 2024-05-15T14:16:30.098 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f31dc6be0d0>, signals=[15]) 2024-05-15T14:16:30.099 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-15T14:16:30.105 INFO:teuthology.task.internal:Opening connections... 2024-05-15T14:16:30.105 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:16:30.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:16:30.182 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:16:30.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:16:30.254 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-15T14:16:30.262 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-05-15T14:16:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-05-15T14:16:30.280 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-05-15T14:16:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-05-15T14:16:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T14:16:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-05-15T14:16:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T14:16:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T14:16:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T14:16:30.340 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-05-15T14:16:30.363 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-05-15T14:16:30.381 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-05-15T14:16:30.381 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-05-15T14:16:30.438 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T14:16:30.439 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T14:16:30.440 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-05-15T14:16:30.463 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-15T14:16:30.472 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-15T14:16:30.476 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-15T14:16:30.477 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-05-15T14:16:30.479 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-05-15T14:16:30.495 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-15T14:16:30.500 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-15T14:16:30.500 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-05-15T14:16:30.536 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-05-15T14:16:30.632 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-15T14:16:30.687 INFO:teuthology.run_tasks:Running task kernel... 2024-05-15T14:16:30.701 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-15T14:16:30.701 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-15T14:16:30.701 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T14:16:30.702 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T14:16:30.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:16:30.719 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-05-15T14:16:30.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:16:30.720 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-05-15T14:16:30.775 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-437.el9.x86_64 2024-05-15T14:16:30.775 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.14.0-437.el9.x86_64 2024-05-15T14:16:30.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2024-05-15T14:16:30.778 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-437.el9.x86_64 2024-05-15T14:16:30.778 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.14.0-437.el9.x86_64 2024-05-15T14:16:30.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-05-15T14:16:34.623 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.1 MB 00:02 2024-05-15T14:16:35.147 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.1 MB 00:02 2024-05-15T14:16:38.697 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 19 MB 00:02 2024-05-15T14:16:41.698 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 19 MB 00:05 2024-05-15T14:16:44.988 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.2 MB 00:02 2024-05-15T14:16:46.647 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-05-15T14:16:47.815 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-05-15T14:16:48.392 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-15T14:16:49.390 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-05-15T14:16:51.075 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-15T14:16:53.464 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-05-15T14:16:55.462 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-15T14:16:55.462 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-15T14:16:55.554 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-15T14:16:55.566 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:16:55.567 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:16:55.567 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:16:55.567 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-05-15T14:16:55.567 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:16:55.567 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 78 M 2024-05-15T14:16:55.567 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 123 M 2024-05-15T14:16:55.567 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:16:55.766 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 5.1 MB/s | 550 kB 00:00 2024-05-15T14:16:56.374 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 22 MB/s | 15 MB 00:00 2024-05-15T14:16:56.558 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-15T14:16:57.066 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 24 MB/s | 34 MB 00:01 2024-05-15T14:16:57.458 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): kernel-modules-core-5.14.0-446.el9.x86_6 17 MB/s | 28 MB 00:01 2024-05-15T14:16:57.458 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:16:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Total 41 MB/s | 78 MB 00:01 2024-05-15T14:16:58.135 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:16:58.478 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:16:58.479 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:16:58.640 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-15T14:16:58.640 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-15T14:16:58.732 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:16:58.744 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:16:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-05-15T14:16:58.744 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:16:58.744 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:16:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-15T14:16:58.744 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 78 M 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 123 M 2024-05-15T14:16:58.745 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:16:59.076 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 2.9 MB/s | 550 kB 00:00 2024-05-15T14:16:59.396 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:16:59.397 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:16:59.618 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 21 MB/s | 15 MB 00:00 2024-05-15T14:17:00.493 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): kernel-modules-core-5.14.0-446.el9.x86_6 20 MB/s | 28 MB 00:01 2024-05-15T14:17:00.860 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 17 MB/s | 34 MB 00:01 2024-05-15T14:17:00.861 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:17:00.861 INFO:teuthology.orchestra.run.smithi018.stdout:Total 37 MB/s | 78 MB 00:02 2024-05-15T14:17:01.573 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:17:01.763 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:17:02.006 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:17:02.006 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:17:02.497 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-15T14:17:02.591 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T14:17:02.962 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:17:02.962 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:17:05.288 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T14:17:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T14:17:05.514 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:17:06.177 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-15T14:17:06.261 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T14:17:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T14:17:09.223 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T14:17:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T14:17:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:14.295 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T14:17:14.335 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:14.976 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:19.440 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:44.533 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:44.571 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:44.948 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:44.948 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-15T14:17:44.948 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T14:17:44.948 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:17:45.762 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:17:46.117 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T14:17:46.184 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T14:17:46.184 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T14:17:46.184 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-15T14:17:46.184 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-15T14:17:46.184 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-15T14:17:46.185 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-15T14:17:46.185 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-05-15T14:17:46.185 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T14:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T14:17:46.235 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T14:17:46.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -qi grub2-tools 2024-05-15T14:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout:Name : grub2-tools 2024-05-15T14:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout:Epoch : 1 2024-05-15T14:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout:Version : 2.06 2024-05-15T14:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout:Release : 68.el9 2024-05-15T14:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: x86_64 2024-05-15T14:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-15T14:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout:Group : Unspecified 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Size : 8264254 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:License : GPLv3+ 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Packager : builder@centos.org 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Vendor : CentOS 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Summary : Support tools for GRUB. 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:Description : 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-15T14:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-15T14:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-15T14:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout:hardware devices. 2024-05-15T14:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout:This subpackage provides tools for support of all platforms. 2024-05-15T14:17:46.267 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-15T14:17:46.268 INFO:teuthology.task.kernel:Updating grub on smithi070 to boot 5.14.0-446.el9.x86_64 2024-05-15T14:17:46.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-15T14:17:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-05-15T14:17:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-15T14:17:48.217 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-05-15T14:17:48.219 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-05-15T14:17:48.235 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.lP30jIAGVg 2024-05-15T14:17:48.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lP30jIAGVg 2024-05-15T14:17:48.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.lP30jIAGVg 2024-05-15T14:17:48.435 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.lP30jIAGVg is 6KB 2024-05-15T14:17:48.483 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.lP30jIAGVg 2024-05-15T14:17:48.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo /bin/ls /boot/loader/entries || true 2024-05-15T14:17:48.559 INFO:teuthology.orchestra.run.smithi070.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-15T14:17:48.559 INFO:teuthology.orchestra.run.smithi070.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-15T14:17:48.559 INFO:teuthology.orchestra.run.smithi070.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-15T14:17:48.560 INFO:teuthology.orchestra.run.smithi070.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-15T14:17:48.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-15T14:17:48.698 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-05-15T14:17:50.449 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:50.490 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-15T14:17:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T14:17:50.799 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:17:51.612 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:17:51.938 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T14:17:52.035 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T14:17:52.035 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T14:17:52.035 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-15T14:17:52.035 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-15T14:17:52.036 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-15T14:17:52.036 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-15T14:17:52.036 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-05-15T14:17:52.036 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T14:17:52.088 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T14:17:52.088 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T14:17:52.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-05-15T14:17:52.120 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-05-15T14:17:52.120 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-05-15T14:17:52.120 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-05-15T14:17:52.120 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 68.el9 2024-05-15T14:17:52.120 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-05-15T14:17:52.121 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-15T14:17:52.121 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-05-15T14:17:52.121 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8264254 2024-05-15T14:17:52.121 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-05-15T14:17:52.121 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-15T14:17:52.121 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-15T14:17:52.122 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-15T14:17:52.122 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-15T14:17:52.122 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-05-15T14:17:52.122 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-05-15T14:17:52.122 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-15T14:17:52.122 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-05-15T14:17:52.123 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-05-15T14:17:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:17:52.123 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-15T14:17:52.123 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-15T14:17:52.123 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-15T14:17:52.124 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-05-15T14:17:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:17:52.124 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-05-15T14:17:52.125 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-15T14:17:52.126 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 5.14.0-446.el9.x86_64 2024-05-15T14:17:52.126 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-15T14:17:52.737 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-05-15T14:17:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-15T14:17:54.240 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-05-15T14:17:54.242 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-05-15T14:17:54.257 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.Tq7j0r5fbQ 2024-05-15T14:17:54.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Tq7j0r5fbQ 2024-05-15T14:17:54.328 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.Tq7j0r5fbQ 2024-05-15T14:17:54.461 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.Tq7j0r5fbQ is 6KB 2024-05-15T14:17:54.510 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.Tq7j0r5fbQ 2024-05-15T14:17:54.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-05-15T14:17:54.594 INFO:teuthology.orchestra.run.smithi018.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-15T14:17:54.594 INFO:teuthology.orchestra.run.smithi018.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-15T14:17:54.594 INFO:teuthology.orchestra.run.smithi018.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-15T14:17:54.594 INFO:teuthology.orchestra.run.smithi018.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-15T14:17:54.595 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-15T14:17:54.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-05-15T14:18:18.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-15T14:18:18.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-15T14:18:18.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:18:24.754 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-15T14:18:24.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-05-15T14:18:24.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:18:37.218 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-05-15T14:18:43.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-05-15T14:18:46.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-15T14:18:46.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:18:52.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-05-15T14:18:52.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:19:46.259 DEBUG:teuthology.orchestra.remote:timed out 2024-05-15T14:19:52.122 DEBUG:teuthology.orchestra.remote:timed out 2024-05-15T14:19:58.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-15T14:19:58.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:19:58.594 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-05-15T14:19:58.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-15T14:19:58.948 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-446.el9.x86_64"... 2024-05-15T14:19:58.948 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-05-15T14:19:58.964 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-446.el9.x86_64 2024-05-15T14:19:58.964 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-15T14:19:58.964 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-15T14:19:58.964 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-15T14:19:59.965 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-15T14:19:59.966 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-15T14:20:00.061 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-05-15T14:20:00.099 DEBUG:teuthology.parallel:result is None 2024-05-15T14:20:04.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-05-15T14:20:04.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:20:04.431 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-05-15T14:20:04.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-05-15T14:20:04.839 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-446.el9.x86_64"... 2024-05-15T14:20:04.839 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-05-15T14:20:04.855 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-446.el9.x86_64 2024-05-15T14:20:04.855 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-15T14:20:04.855 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-15T14:20:04.856 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-15T14:20:05.857 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-15T14:20:05.857 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-15T14:20:05.925 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2024-05-15T14:20:05.963 DEBUG:teuthology.parallel:result is None 2024-05-15T14:20:05.963 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-15T14:20:05.971 INFO:teuthology.task.internal:Creating test directory... 2024-05-15T14:20:05.971 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T14:20:05.973 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T14:20:05.992 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-15T14:20:05.999 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-15T14:20:06.009 INFO:teuthology.task.internal:Creating archive directory... 2024-05-15T14:20:06.009 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T14:20:06.033 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T14:20:06.065 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-15T14:20:06.072 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-15T14:20:06.072 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T14:20:06.095 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T14:20:06.130 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T14:20:06.135 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T14:20:06.142 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T14:20:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T14:20:06.148 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-15T14:20:06.155 INFO:teuthology.task.internal:Configuring sudo... 2024-05-15T14:20:06.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T14:20:06.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T14:20:06.215 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-15T14:20:06.224 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-15T14:20:06.224 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T14:20:06.257 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T14:20:06.273 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T14:20:06.359 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T14:20:06.410 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T14:20:06.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T14:20:06.536 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:20:06.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T14:20:06.603 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T14:20:06.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T14:20:06.692 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T14:20:06.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T14:20:06.818 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:20:06.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T14:20:06.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-05-15T14:20:06.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-05-15T14:20:06.921 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T14:20:06.973 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T14:20:07.310 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-15T14:20:07.318 INFO:teuthology.task.internal:Starting timer... 2024-05-15T14:20:07.318 INFO:teuthology.run_tasks:Running task pcp... 2024-05-15T14:20:07.327 INFO:teuthology.run_tasks:Running task selinux... 2024-05-15T14:20:07.336 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-15T14:20:07.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-05-15T14:20:07.409 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-05-15T14:20:07.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-05-15T14:20:07.470 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-05-15T14:20:07.472 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-15T14:20:07.472 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-05-15T14:20:07.496 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-05-15T14:20:07.496 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-05-15T14:20:07.536 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-05-15T14:20:07.536 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi070.front.sepia.ceph.com': 'permissive'} 2024-05-15T14:20:07.536 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T14:20:07.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:20:07.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T14:20:07.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:20:07.602 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-15T14:20:07.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-05-15T14:20:07.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-05-15T14:20:07.667 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-15T14:20:07.676 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-15T14:20:07.694 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-15T14:20:07.695 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi070.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-15T14:24:36.787 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com')] 2024-05-15T14:24:36.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-05-15T14:24:36.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:24:36.869 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-05-15T14:24:36.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-05-15T14:24:36.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-15T14:24:36.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T14:24:37.026 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-05-15T14:24:37.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-15T14:24:37.107 INFO:teuthology.run_tasks:Running task clock... 2024-05-15T14:24:37.120 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-15T14:24:37.120 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T14:24:37.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T14:24:37.123 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T14:24:37.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T14:24:37.152 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T14:24:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T14:24:37.178 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T14:24:37.193 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T14:24:37.193 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-05-15T14:24:37.205 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-05-15T14:24:37.216 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-05-15T14:24:37.220 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T14:24:37.227 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-05-15T14:24:37.235 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T14:24:37.241 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T14:24:37.255 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T14:24:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-05-15T14:24:37.295 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T14:24:37.296 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-05-15T14:24:37.296 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:24:37.296 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:24:37.296 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:24:37.296 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:24:37.308 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-05-15T14:24:37.311 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T14:24:37.312 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-05-15T14:24:37.312 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:24:37.312 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:24:37.312 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:24:37.312 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:24:37.312 INFO:teuthology.run_tasks:Running task install... 2024-05-15T14:24:37.321 DEBUG:teuthology.task.install:project ceph 2024-05-15T14:24:37.321 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2'}} 2024-05-15T14:24:37.321 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2'} 2024-05-15T14:24:37.321 INFO:teuthology.task.install:Using flavor: default 2024-05-15T14:24:37.327 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-15T14:24:37.327 INFO:teuthology.task.install:extra packages: [] 2024-05-15T14:24:37.327 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2', 'tag': None, 'wait_for_package': False} 2024-05-15T14:24:37.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf560a26040628fcc6ec3e608f9c4451acdef5e2 2024-05-15T14:24:37.330 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2', 'tag': None, 'wait_for_package': False} 2024-05-15T14:24:37.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf560a26040628fcc6ec3e608f9c4451acdef5e2 2024-05-15T14:24:37.475 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/bf560a26040628fcc6ec3e608f9c4451acdef5e2/centos/9/flavors/default/ 2024-05-15T14:24:37.475 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3680.gbf560a26 2024-05-15T14:24:37.547 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/bf560a26040628fcc6ec3e608f9c4451acdef5e2/centos/9/flavors/default/ 2024-05-15T14:24:37.547 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3680.gbf560a26 2024-05-15T14:24:37.648 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/bf560a26040628fcc6ec3e608f9c4451acdef5e2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/bf560a26040628fcc6ec3e608f9c4451acdef5e2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/bf560a26040628fcc6ec3e608f9c4451acdef5e2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T14:24:37.648 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:24:37.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T14:24:37.673 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-15T14:24:37.673 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bf560a26040628fcc6ec3e608f9c4451acdef5e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T14:24:37.716 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/bf560a26040628fcc6ec3e608f9c4451acdef5e2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/bf560a26040628fcc6ec3e608f9c4451acdef5e2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/bf560a26040628fcc6ec3e608f9c4451acdef5e2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T14:24:37.716 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:24:37.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T14:24:37.739 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T14:24:37.744 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-15T14:24:37.744 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bf560a26040628fcc6ec3e608f9c4451acdef5e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T14:24:37.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T14:24:37.814 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T14:24:37.879 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-05-15T14:24:37.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-05-15T14:24:37.890 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T14:24:37.955 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-05-15T14:24:37.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-05-15T14:24:38.129 INFO:teuthology.orchestra.run.smithi070.stdout:57 files removed 2024-05-15T14:24:38.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw 2024-05-15T14:24:38.196 INFO:teuthology.orchestra.run.smithi018.stdout:57 files removed 2024-05-15T14:24:38.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw 2024-05-15T14:24:38.894 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 180 kB/s | 83 kB 00:00 2024-05-15T14:24:38.990 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 175 kB/s | 83 kB 00:00 2024-05-15T14:24:39.303 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-05-15T14:24:39.348 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 39 kB/s | 12 kB 00:00 2024-05-15T14:24:39.666 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-05-15T14:24:39.687 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-05-15T14:24:40.265 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-15T14:24:40.378 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-15T14:24:42.100 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-15T14:24:42.596 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-05-15T14:24:46.276 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-05-15T14:24:47.321 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.2 MB 00:01 2024-05-15T14:24:47.968 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-05-15T14:24:48.681 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 16 kB 00:00 2024-05-15T14:24:50.365 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-15T14:24:50.803 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 21 MB 00:02 2024-05-15T14:24:55.490 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-05-15T14:24:56.203 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-15T14:24:57.832 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:24:57.841 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 11 M 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 3.4 M 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 3.1 M 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 5.4 M 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 21 M 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 25 k 2024-05-15T14:24:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 747 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 501 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 5.4 M 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 45 k 2024-05-15T14:24:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 135 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 161 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 320 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 300 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 99 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:24:57.844 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:24:57.845 INFO:teuthology.orchestra.run.smithi070.stdout:Install 30 Packages 2024-05-15T14:24:57.845 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 2 Packages 2024-05-15T14:24:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:24:57.845 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 60 M 2024-05-15T14:24:57.845 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:24:58.629 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:24:58.635 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:24:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:24:58.635 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:24:58.635 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:24:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 11 M 2024-05-15T14:24:58.635 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-05-15T14:24:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 3.4 M 2024-05-15T14:24:58.635 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 3.1 M 2024-05-15T14:24:58.636 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:24:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T14:24:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 5.4 M 2024-05-15T14:24:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 21 M 2024-05-15T14:24:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 25 k 2024-05-15T14:24:58.636 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 747 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 501 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 5.4 M 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T14:24:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 45 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 135 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 161 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 320 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 300 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 99 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T14:24:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout:Install 30 Packages 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 2 Packages 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 60 M 2024-05-15T14:24:58.639 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:24:58.841 INFO:teuthology.orchestra.run.smithi070.stdout:(1/32): ceph-base-19.0.0-3680.gbf560a26.el9.x86 9.5 MB/s | 5.4 MB 00:00 2024-05-15T14:24:58.916 INFO:teuthology.orchestra.run.smithi070.stdout:(2/32): ceph-selinux-19.0.0-3680.gbf560a26.el9. 336 kB/s | 25 kB 00:00 2024-05-15T14:24:59.016 INFO:teuthology.orchestra.run.smithi070.stdout:(3/32): libcephfs2-19.0.0-3680.gbf560a26.el9.x8 7.3 MB/s | 747 kB 00:00 2024-05-15T14:24:59.100 INFO:teuthology.orchestra.run.smithi070.stdout:(4/32): libradosstriper1-19.0.0-3680.gbf560a26. 5.9 MB/s | 501 kB 00:00 2024-05-15T14:24:59.608 INFO:teuthology.orchestra.run.smithi070.stdout:(5/32): librgw2-19.0.0-3680.gbf560a26.el9.x86_6 11 MB/s | 5.4 MB 00:00 2024-05-15T14:24:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:(6/32): python3-ceph-argparse-19.0.0-3680.gbf56 678 kB/s | 45 kB 00:00 2024-05-15T14:24:59.801 INFO:teuthology.orchestra.run.smithi070.stdout:(7/32): python3-ceph-common-19.0.0-3680.gbf560a 1.1 MB/s | 135 kB 00:00 2024-05-15T14:24:59.868 INFO:teuthology.orchestra.run.smithi070.stdout:(8/32): python3-cephfs-19.0.0-3680.gbf560a26.el 2.4 MB/s | 161 kB 00:00 2024-05-15T14:24:59.887 INFO:teuthology.orchestra.run.smithi018.stdout:(1/32): ceph-base-19.0.0-3680.gbf560a26.el9.x86 5.1 MB/s | 5.4 MB 00:01 2024-05-15T14:24:59.960 INFO:teuthology.orchestra.run.smithi070.stdout:(9/32): python3-rados-19.0.0-3680.gbf560a26.el9 3.4 MB/s | 320 kB 00:00 2024-05-15T14:24:59.962 INFO:teuthology.orchestra.run.smithi018.stdout:(2/32): ceph-selinux-19.0.0-3680.gbf560a26.el9. 336 kB/s | 25 kB 00:00 2024-05-15T14:25:00.052 INFO:teuthology.orchestra.run.smithi070.stdout:(10/32): python3-rbd-19.0.0-3680.gbf560a26.el9. 3.2 MB/s | 300 kB 00:00 2024-05-15T14:25:00.102 INFO:teuthology.orchestra.run.smithi070.stdout:(11/32): python3-rgw-19.0.0-3680.gbf560a26.el9. 1.9 MB/s | 99 kB 00:00 2024-05-15T14:25:00.121 INFO:teuthology.orchestra.run.smithi018.stdout:(3/32): libcephfs2-19.0.0-3680.gbf560a26.el9.x8 4.6 MB/s | 747 kB 00:00 2024-05-15T14:25:00.222 INFO:teuthology.orchestra.run.smithi018.stdout:(4/32): libradosstriper1-19.0.0-3680.gbf560a26. 4.9 MB/s | 501 kB 00:00 2024-05-15T14:25:00.236 INFO:teuthology.orchestra.run.smithi070.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 800 kB/s | 107 kB 00:00 2024-05-15T14:25:00.303 INFO:teuthology.orchestra.run.smithi070.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-05-15T14:25:00.353 INFO:teuthology.orchestra.run.smithi070.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-05-15T14:25:00.512 INFO:teuthology.orchestra.run.smithi070.stdout:(15/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-05-15T14:25:00.595 INFO:teuthology.orchestra.run.smithi070.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-05-15T14:25:00.671 INFO:teuthology.orchestra.run.smithi070.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 563 kB/s | 42 kB 00:00 2024-05-15T14:25:00.746 INFO:teuthology.orchestra.run.smithi070.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-05-15T14:25:00.821 INFO:teuthology.orchestra.run.smithi070.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 477 kB/s | 36 kB 00:00 2024-05-15T14:25:00.888 INFO:teuthology.orchestra.run.smithi070.stdout:(20/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 712 kB/s | 47 kB 00:00 2024-05-15T14:25:00.897 INFO:teuthology.orchestra.run.smithi018.stdout:(5/32): librgw2-19.0.0-3680.gbf560a26.el9.x86_6 8.0 MB/s | 5.4 MB 00:00 2024-05-15T14:25:00.972 INFO:teuthology.orchestra.run.smithi018.stdout:(6/32): python3-ceph-argparse-19.0.0-3680.gbf56 603 kB/s | 45 kB 00:00 2024-05-15T14:25:01.005 INFO:teuthology.orchestra.run.smithi070.stdout:(21/32): ceph-radosgw-19.0.0-3680.gbf560a26.el9 3.9 MB/s | 11 MB 00:02 2024-05-15T14:25:01.041 INFO:teuthology.orchestra.run.smithi018.stdout:(7/32): python3-ceph-common-19.0.0-3680.gbf560a 2.0 MB/s | 135 kB 00:00 2024-05-15T14:25:01.108 INFO:teuthology.orchestra.run.smithi018.stdout:(8/32): python3-cephfs-19.0.0-3680.gbf560a26.el 2.4 MB/s | 161 kB 00:00 2024-05-15T14:25:01.172 INFO:teuthology.orchestra.run.smithi070.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-05-15T14:25:01.181 INFO:teuthology.orchestra.run.smithi018.stdout:(9/32): python3-rados-19.0.0-3680.gbf560a26.el9 4.2 MB/s | 320 kB 00:00 2024-05-15T14:25:01.214 INFO:teuthology.orchestra.run.smithi070.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-05-15T14:25:01.264 INFO:teuthology.orchestra.run.smithi070.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-05-15T14:25:01.266 INFO:teuthology.orchestra.run.smithi018.stdout:(10/32): python3-rbd-19.0.0-3680.gbf560a26.el9. 3.5 MB/s | 300 kB 00:00 2024-05-15T14:25:01.315 INFO:teuthology.orchestra.run.smithi070.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-15T14:25:01.341 INFO:teuthology.orchestra.run.smithi018.stdout:(11/32): python3-rgw-19.0.0-3680.gbf560a26.el9. 1.3 MB/s | 99 kB 00:00 2024-05-15T14:25:01.448 INFO:teuthology.orchestra.run.smithi070.stdout:(26/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-05-15T14:25:01.483 INFO:teuthology.orchestra.run.smithi018.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 754 kB/s | 107 kB 00:00 2024-05-15T14:25:01.591 INFO:teuthology.orchestra.run.smithi018.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-15T14:25:01.665 INFO:teuthology.orchestra.run.smithi070.stdout:(27/32): ceph-common-19.0.0-3680.gbf560a26.el9. 6.2 MB/s | 21 MB 00:03 2024-05-15T14:25:01.700 INFO:teuthology.orchestra.run.smithi070.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 766 kB/s | 192 kB 00:00 2024-05-15T14:25:01.716 INFO:teuthology.orchestra.run.smithi018.stdout:(14/32): ceph-radosgw-19.0.0-3680.gbf560a26.el9 3.7 MB/s | 11 MB 00:02 2024-05-15T14:25:01.742 INFO:teuthology.orchestra.run.smithi018.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 301 kB/s | 45 kB 00:00 2024-05-15T14:25:01.766 INFO:teuthology.orchestra.run.smithi070.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-05-15T14:25:01.833 INFO:teuthology.orchestra.run.smithi018.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-15T14:25:01.884 INFO:teuthology.orchestra.run.smithi018.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 847 kB/s | 42 kB 00:00 2024-05-15T14:25:01.968 INFO:teuthology.orchestra.run.smithi018.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-05-15T14:25:02.016 INFO:teuthology.orchestra.run.smithi070.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 4.5 MB/s | 1.6 MB 00:00 2024-05-15T14:25:02.017 INFO:teuthology.orchestra.run.smithi018.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 719 kB/s | 36 kB 00:00 2024-05-15T14:25:02.052 INFO:teuthology.orchestra.run.smithi018.stdout:(20/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-05-15T14:25:02.077 INFO:teuthology.orchestra.run.smithi018.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-05-15T14:25:02.091 INFO:teuthology.orchestra.run.smithi070.stdout:(31/32): librados2-19.0.0-3680.gbf560a26.el9.x8 8.7 MB/s | 3.4 MB 00:00 2024-05-15T14:25:02.160 INFO:teuthology.orchestra.run.smithi018.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-05-15T14:25:02.194 INFO:teuthology.orchestra.run.smithi018.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 783 kB/s | 26 kB 00:00 2024-05-15T14:25:02.228 INFO:teuthology.orchestra.run.smithi018.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-05-15T14:25:02.261 INFO:teuthology.orchestra.run.smithi018.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-05-15T14:25:02.328 INFO:teuthology.orchestra.run.smithi018.stdout:(26/32): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-15T14:25:02.370 INFO:teuthology.orchestra.run.smithi018.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-05-15T14:25:02.383 INFO:teuthology.orchestra.run.smithi070.stdout:(32/32): librbd1-19.0.0-3680.gbf560a26.el9.x86_ 5.1 MB/s | 3.1 MB 00:00 2024-05-15T14:25:02.386 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:02.386 INFO:teuthology.orchestra.run.smithi070.stdout:Total 13 MB/s | 60 MB 00:04 2024-05-15T14:25:02.395 INFO:teuthology.orchestra.run.smithi018.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-05-15T14:25:02.446 INFO:teuthology.orchestra.run.smithi018.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-05-15T14:25:02.493 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:25:02.529 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:25:02.529 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:25:02.771 INFO:teuthology.orchestra.run.smithi018.stdout:(30/32): librados2-19.0.0-3680.gbf560a26.el9.x8 9.1 MB/s | 3.4 MB 00:00 2024-05-15T14:25:03.071 INFO:teuthology.orchestra.run.smithi018.stdout:(31/32): librbd1-19.0.0-3680.gbf560a26.el9.x86_ 5.0 MB/s | 3.1 MB 00:00 2024-05-15T14:25:03.155 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:25:03.155 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:25:04.588 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:25:04.682 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-15T14:25:04.719 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-15T14:25:04.755 INFO:teuthology.orchestra.run.smithi018.stdout:(32/32): ceph-common-19.0.0-3680.gbf560a26.el9. 3.6 MB/s | 21 MB 00:05 2024-05-15T14:25:04.758 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:04.758 INFO:teuthology.orchestra.run.smithi018.stdout:Total 9.9 MB/s | 60 MB 00:06 2024-05-15T14:25:04.763 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-15T14:25:04.786 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-15T14:25:04.807 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-15T14:25:04.864 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:25:04.905 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:25:04.906 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:25:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-15T14:25:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-15T14:25:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-15T14:25:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 7/34 2024-05-15T14:25:05.562 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:25:05.562 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:25:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 7/34 2024-05-15T14:25:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.0.0-3680.gbf560a26.el9.x86_64 8/34 2024-05-15T14:25:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 9/34 2024-05-15T14:25:05.771 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 9/34 2024-05-15T14:25:05.816 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-15T14:25:05.866 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.0.0-3680.gbf560a26.el9. 11/34 2024-05-15T14:25:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.0.0-3680.gbf560a26.el9.x86_64 12/34 2024-05-15T14:25:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.0.0-3680.gbf560a26.el9.x86_6 13/34 2024-05-15T14:25:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3680.gbf560a26.el9.x86_6 13/34 2024-05-15T14:25:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-15T14:25:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-15T14:25:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-15T14:25:06.244 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-15T14:25:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-15T14:25:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-15T14:25:06.362 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-15T14:25:06.698 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-15T14:25:06.741 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 22/34 2024-05-15T14:25:06.832 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 22/34 2024-05-15T14:25:06.863 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.0.0-3680.gbf560a26.el9.x86_64 23/34 2024-05-15T14:25:06.908 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-15T14:25:07.167 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:25:07.256 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-15T14:25:07.285 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-15T14:25:07.310 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-15T14:25:07.333 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-15T14:25:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-15T14:25:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-15T14:25:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.0.0-3680.gbf560a26.el9.x86_64 26/34 2024-05-15T14:25:07.493 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.0.0-3680.gbf560a26.el9.x86_64 26/34 2024-05-15T14:25:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-15T14:25:07.570 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.0.0-3680.gbf560a26.el9.x86_64 27/34 2024-05-15T14:25:07.600 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.0.0-3680.gbf560a26.el9.x8 28/34 2024-05-15T14:25:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-15T14:25:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-15T14:25:08.070 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 7/34 2024-05-15T14:25:08.163 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 7/34 2024-05-15T14:25:08.261 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.0.0-3680.gbf560a26.el9.x86_64 8/34 2024-05-15T14:25:08.288 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 9/34 2024-05-15T14:25:08.335 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 9/34 2024-05-15T14:25:08.371 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-15T14:25:08.415 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.0.0-3680.gbf560a26.el9. 11/34 2024-05-15T14:25:08.485 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.0.0-3680.gbf560a26.el9.x86_64 12/34 2024-05-15T14:25:08.499 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.0.0-3680.gbf560a26.el9.x86_6 13/34 2024-05-15T14:25:08.546 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3680.gbf560a26.el9.x86_6 13/34 2024-05-15T14:25:08.572 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-15T14:25:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-15T14:25:08.723 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-15T14:25:08.765 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-15T14:25:08.797 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-15T14:25:08.826 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-15T14:25:08.859 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-15T14:25:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-15T14:25:09.230 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 22/34 2024-05-15T14:25:09.321 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 22/34 2024-05-15T14:25:09.351 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.0.0-3680.gbf560a26.el9.x86_64 23/34 2024-05-15T14:25:09.388 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-15T14:25:09.893 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-15T14:25:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 29/34 2024-05-15T14:25:09.924 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.0.0-3680.gbf560a26.el9.x86_64 26/34 2024-05-15T14:25:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 29/34 2024-05-15T14:25:09.979 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.0.0-3680.gbf560a26.el9.x86_64 26/34 2024-05-15T14:25:10.060 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.0.0-3680.gbf560a26.el9.x86_64 27/34 2024-05-15T14:25:10.093 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.0.0-3680.gbf560a26.el9.x8 28/34 2024-05-15T14:25:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 29/34 2024-05-15T14:25:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 30/34 2024-05-15T14:25:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 30/34 2024-05-15T14:25:10.674 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T14:25:10.675 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T14:25:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:10.702 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.0.0-3680.gbf560a26.el9.x86_64 31/34 2024-05-15T14:25:12.466 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 29/34 2024-05-15T14:25:12.565 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 29/34 2024-05-15T14:25:13.153 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 29/34 2024-05-15T14:25:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 30/34 2024-05-15T14:25:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 30/34 2024-05-15T14:25:13.277 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T14:25:13.277 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T14:25:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:13.303 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.0.0-3680.gbf560a26.el9.x86_64 31/34 2024-05-15T14:25:20.330 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3680.gbf560a26.el9.x86_64 31/34 2024-05-15T14:25:20.330 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-05-15T14:25:20.330 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-05-15T14:25:20.330 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-05-15T14:25:20.331 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-05-15T14:25:20.331 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-05-15T14:25:20.331 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-05-15T14:25:20.331 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-05-15T14:25:20.331 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:21.295 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.0.0-3680.gbf560a26.el9.x86_64 32/34 2024-05-15T14:25:21.320 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3680.gbf560a26.el9.x86_64 32/34 2024-05-15T14:25:21.321 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:21.321 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T14:25:21.321 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T14:25:21.321 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T14:25:21.321 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:21.322 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-15T14:25:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-15T14:25:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T14:25:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T14:25:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 1/34 2024-05-15T14:25:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 2/34 2024-05-15T14:25:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.0.0-3680.gbf560a26.el9.x86_64 3/34 2024-05-15T14:25:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.0.0-3680.gbf560a26.el9.x86_64 4/34 2024-05-15T14:25:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 5/34 2024-05-15T14:25:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.0.0-3680.gbf560a26.el9.x86_6 6/34 2024-05-15T14:25:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.0.0-3680.gbf560a26.el9.x86_64 7/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3680.gbf560a26.el9. 8/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.0.0-3680.gbf560a26.el9.x8 9/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.0.0-3680.gbf560a26.el9.x86_64 10/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.0.0-3680.gbf560a26.el9.x86_64 11/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.0.0-3680.gbf560a26.el9.x86_64 12/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.0.0-3680.gbf560a26.el9.x86_64 13/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-15T14:25:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 31/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-15T14:25:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 33/34 2024-05-15T14:25:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T14:25:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T14:25:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T14:25:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:23.296 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:25:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3680.gbf560a26.el9.x86_64 31/34 2024-05-15T14:25:23.400 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-05-15T14:25:23.400 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-05-15T14:25:23.401 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-05-15T14:25:23.401 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-05-15T14:25:23.401 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-05-15T14:25:23.401 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-05-15T14:25:23.401 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-05-15T14:25:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:23.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-test 2024-05-15T14:25:24.251 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:29 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:25:24.369 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:25:24.370 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:25:24.370 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:24.370 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:25:24.370 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 49 M 2024-05-15T14:25:24.370 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:25:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 163 k 2024-05-15T14:25:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T14:25:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T14:25:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:24.371 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:25:24.371 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:24.371 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-05-15T14:25:24.371 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:24.372 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 50 M 2024-05-15T14:25:24.372 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 211 M 2024-05-15T14:25:24.372 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:25:24.415 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.0.0-3680.gbf560a26.el9.x86_64 32/34 2024-05-15T14:25:24.441 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3680.gbf560a26.el9.x86_64 32/34 2024-05-15T14:25:24.441 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:24.441 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T14:25:24.441 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T14:25:24.442 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T14:25:24.442 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-15T14:25:24.526 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-15T14:25:24.526 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T14:25:24.577 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 2.0 MB/s | 305 kB 00:00 2024-05-15T14:25:24.619 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-05-15T14:25:24.661 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): libcephsqlite-19.0.0-3680.gbf560a26.el9. 705 kB/s | 163 kB 00:00 2024-05-15T14:25:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T14:25:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 1/34 2024-05-15T14:25:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 2/34 2024-05-15T14:25:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.0.0-3680.gbf560a26.el9.x86_64 3/34 2024-05-15T14:25:25.813 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.0.0-3680.gbf560a26.el9.x86_64 4/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 5/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.0.0-3680.gbf560a26.el9.x86_6 6/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.0.0-3680.gbf560a26.el9.x86_64 7/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3680.gbf560a26.el9. 8/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.0.0-3680.gbf560a26.el9.x8 9/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.0.0-3680.gbf560a26.el9.x86_64 10/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.0.0-3680.gbf560a26.el9.x86_64 11/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.0.0-3680.gbf560a26.el9.x86_64 12/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.0.0-3680.gbf560a26.el9.x86_64 13/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-15T14:25:25.814 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-15T14:25:25.815 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-15T14:25:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 31/34 2024-05-15T14:25:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-15T14:25:25.816 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 33/34 2024-05-15T14:25:26.677 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T14:25:26.677 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:26.677 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-05-15T14:25:26.677 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.677 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.678 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:25:26.678 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T14:25:26.678 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.678 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.678 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.678 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.682 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T14:25:26.682 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T14:25:26.682 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T14:25:26.682 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.682 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T14:25:26.682 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.683 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:26.684 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T14:25:26.684 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T14:25:26.684 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T14:25:26.684 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T14:25:26.684 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T14:25:26.684 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:26.684 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:25:27.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-test 2024-05-15T14:25:27.615 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:31 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:25:27.742 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:25:27.742 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:27.742 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:25:27.742 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:27.742 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 49 M 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 163 k 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-05-15T14:25:27.743 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:27.744 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 50 M 2024-05-15T14:25:27.744 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 211 M 2024-05-15T14:25:27.744 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:25:28.131 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): libcephsqlite-19.0.0-3680.gbf560a26.el9. 648 kB/s | 163 kB 00:00 2024-05-15T14:25:28.164 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 305 kB 00:00 2024-05-15T14:25:28.269 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): ceph-test-19.0.0-3680.gbf560a26.el9.x86_ 13 MB/s | 49 MB 00:03 2024-05-15T14:25:28.270 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:28.271 INFO:teuthology.orchestra.run.smithi070.stdout:Total 13 MB/s | 50 MB 00:03 2024-05-15T14:25:28.298 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:25:28.318 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:25:28.318 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:25:28.331 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-05-15T14:25:28.686 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:25:28.687 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:25:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:25:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-15T14:25:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-15T14:25:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.0.0-3680.gbf560a26.el9.x86_64 3/4 2024-05-15T14:25:30.431 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): ceph-test-19.0.0-3680.gbf560a26.el9.x86_ 19 MB/s | 49 MB 00:02 2024-05-15T14:25:30.433 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:30.434 INFO:teuthology.orchestra.run.smithi018.stdout:Total 18 MB/s | 50 MB 00:02 2024-05-15T14:25:30.463 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:25:30.486 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:25:30.486 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:25:30.877 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:25:30.877 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:25:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:25:31.512 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-15T14:25:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-15T14:25:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.0.0-3680.gbf560a26.el9.x86_64 3/4 2024-05-15T14:25:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3680.gbf560a26.el9.x86_64 3/4 2024-05-15T14:25:34.176 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.0.0-3680.gbf560a26.el9.x86_64 4/4 2024-05-15T14:25:36.503 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3680.gbf560a26.el9.x86_64 3/4 2024-05-15T14:25:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.0.0-3680.gbf560a26.el9.x86_64 4/4 2024-05-15T14:25:36.622 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-test-2:19.0.0-3680.gbf560a26.el9.x86_64 4/4 2024-05-15T14:25:36.623 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.0.0-3680.gbf560a26.el9.x86_64 1/4 2024-05-15T14:25:36.623 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.0.0-3680.gbf560a26.el9.x86_64 2/4 2024-05-15T14:25:36.623 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-15T14:25:36.916 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-15T14:25:36.916 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:36.916 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:25:36.916 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:36.917 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:36.917 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T14:25:36.917 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T14:25:36.917 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:36.917 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:25:37.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph 2024-05-15T14:25:37.812 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:42 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:25:37.940 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:25:37.943 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:25:37.943 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:37.943 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:25:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 6.6 k 2024-05-15T14:25:37.943 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:25:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 2.4 M 2024-05-15T14:25:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 1.5 M 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 274 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 4.7 M 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 17 M 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T14:25:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T14:25:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout:Install 36 Packages 2024-05-15T14:25:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:37.947 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 30 M 2024-05-15T14:25:37.947 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 108 M 2024-05-15T14:25:37.947 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:25:38.461 INFO:teuthology.orchestra.run.smithi070.stdout:(1/36): ceph-19.0.0-3680.gbf560a26.el9.x86_64.r 36 kB/s | 6.6 kB 00:00 2024-05-15T14:25:38.686 INFO:teuthology.orchestra.run.smithi070.stdout:(2/36): ceph-mgr-19.0.0-3680.gbf560a26.el9.x86_ 3.7 MB/s | 1.5 MB 00:00 2024-05-15T14:25:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-test-2:19.0.0-3680.gbf560a26.el9.x86_64 4/4 2024-05-15T14:25:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.0.0-3680.gbf560a26.el9.x86_64 1/4 2024-05-15T14:25:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.0.0-3680.gbf560a26.el9.x86_64 2/4 2024-05-15T14:25:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-15T14:25:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-15T14:25:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:39.262 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:25:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T14:25:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T14:25:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:39.263 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:25:39.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph 2024-05-15T14:25:40.113 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:44 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:25:40.245 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:25:40.248 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:25:40.248 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:40.248 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:25:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 6.6 k 2024-05-15T14:25:40.248 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:25:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 2.4 M 2024-05-15T14:25:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 1.5 M 2024-05-15T14:25:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 274 k 2024-05-15T14:25:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 4.7 M 2024-05-15T14:25:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 17 M 2024-05-15T14:25:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T14:25:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T14:25:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T14:25:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T14:25:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T14:25:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T14:25:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:40.252 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:25:40.252 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:40.252 INFO:teuthology.orchestra.run.smithi018.stdout:Install 36 Packages 2024-05-15T14:25:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:40.252 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 30 M 2024-05-15T14:25:40.253 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 108 M 2024-05-15T14:25:40.253 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:25:40.261 INFO:teuthology.orchestra.run.smithi070.stdout:(3/36): ceph-osd-19.0.0-3680.gbf560a26.el9.x86_ 11 MB/s | 17 MB 00:01 2024-05-15T14:25:40.362 INFO:teuthology.orchestra.run.smithi070.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3680.gbf56 2.7 MB/s | 274 kB 00:00 2024-05-15T14:25:40.478 INFO:teuthology.orchestra.run.smithi070.stdout:(5/36): ceph-mds-19.0.0-3680.gbf560a26.el9.x86_ 1.1 MB/s | 2.4 MB 00:02 2024-05-15T14:25:41.029 INFO:teuthology.orchestra.run.smithi070.stdout:(6/36): ceph-mon-19.0.0-3680.gbf560a26.el9.x86_ 1.8 MB/s | 4.7 MB 00:02 2024-05-15T14:25:41.116 INFO:teuthology.orchestra.run.smithi018.stdout:(1/36): ceph-19.0.0-3680.gbf560a26.el9.x86_64.r 25 kB/s | 6.6 kB 00:00 2024-05-15T14:25:41.221 INFO:teuthology.orchestra.run.smithi070.stdout:(7/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 295 kB/s | 253 kB 00:00 2024-05-15T14:25:41.571 INFO:teuthology.orchestra.run.smithi070.stdout:(8/36): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-05-15T14:25:41.834 INFO:teuthology.orchestra.run.smithi018.stdout:(2/36): ceph-mds-19.0.0-3680.gbf560a26.el9.x86_ 2.4 MB/s | 2.4 MB 00:00 2024-05-15T14:25:41.846 INFO:teuthology.orchestra.run.smithi070.stdout:(9/36): python3-ply-3.11-14.el9.noarch.rpm 130 kB/s | 106 kB 00:00 2024-05-15T14:25:41.925 INFO:teuthology.orchestra.run.smithi018.stdout:(3/36): ceph-mgr-19.0.0-3680.gbf560a26.el9.x86_ 1.4 MB/s | 1.5 MB 00:01 2024-05-15T14:25:42.038 INFO:teuthology.orchestra.run.smithi070.stdout:(10/36): python3-pycparser-2.20-6.el9.noarch.rp 165 kB/s | 135 kB 00:00 2024-05-15T14:25:42.084 INFO:teuthology.orchestra.run.smithi018.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3680.gbf56 1.7 MB/s | 274 kB 00:00 2024-05-15T14:25:42.189 INFO:teuthology.orchestra.run.smithi070.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-05-15T14:25:42.226 INFO:teuthology.orchestra.run.smithi018.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-05-15T14:25:42.239 INFO:teuthology.orchestra.run.smithi070.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-15T14:25:42.281 INFO:teuthology.orchestra.run.smithi070.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 836 kB/s | 35 kB 00:00 2024-05-15T14:25:42.314 INFO:teuthology.orchestra.run.smithi070.stdout:(14/36): python3-requests-2.25.1-8.el9.noarch.r 168 kB/s | 125 kB 00:00 2024-05-15T14:25:42.326 INFO:teuthology.orchestra.run.smithi018.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 12 MB/s | 1.2 MB 00:00 2024-05-15T14:25:42.340 INFO:teuthology.orchestra.run.smithi070.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-05-15T14:25:42.368 INFO:teuthology.orchestra.run.smithi018.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-05-15T14:25:42.410 INFO:teuthology.orchestra.run.smithi018.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-05-15T14:25:42.415 INFO:teuthology.orchestra.run.smithi070.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2024-05-15T14:25:42.452 INFO:teuthology.orchestra.run.smithi018.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-05-15T14:25:42.463 INFO:teuthology.orchestra.run.smithi070.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 181 kB/s | 22 kB 00:00 2024-05-15T14:25:42.494 INFO:teuthology.orchestra.run.smithi018.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 5.0 MB/s | 215 kB 00:00 2024-05-15T14:25:42.690 INFO:teuthology.orchestra.run.smithi070.stdout:(18/36): python3-urllib3-1.26.5-5.el9.noarch.rp 254 kB/s | 215 kB 00:00 2024-05-15T14:25:42.711 INFO:teuthology.orchestra.run.smithi018.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 870 kB/s | 188 kB 00:00 2024-05-15T14:25:42.716 INFO:teuthology.orchestra.run.smithi070.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 172 kB/s | 43 kB 00:00 2024-05-15T14:25:42.770 INFO:teuthology.orchestra.run.smithi018.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-15T14:25:42.824 INFO:teuthology.orchestra.run.smithi070.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 369 kB/s | 151 kB 00:00 2024-05-15T14:25:42.845 INFO:teuthology.orchestra.run.smithi018.stdout:(13/36): ceph-mon-19.0.0-3680.gbf560a26.el9.x86 2.7 MB/s | 4.7 MB 00:01 2024-05-15T14:25:42.862 INFO:teuthology.orchestra.run.smithi018.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-05-15T14:25:42.908 INFO:teuthology.orchestra.run.smithi070.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-05-15T14:25:42.929 INFO:teuthology.orchestra.run.smithi018.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-05-15T14:25:42.933 INFO:teuthology.orchestra.run.smithi070.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 709 kB/s | 172 kB 00:00 2024-05-15T14:25:43.000 INFO:teuthology.orchestra.run.smithi070.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 192 kB/s | 18 kB 00:00 2024-05-15T14:25:43.017 INFO:teuthology.orchestra.run.smithi070.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 277 kB/s | 23 kB 00:00 2024-05-15T14:25:43.076 INFO:teuthology.orchestra.run.smithi070.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-05-15T14:25:43.079 INFO:teuthology.orchestra.run.smithi018.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 218 kB/s | 51 kB 00:00 2024-05-15T14:25:43.092 INFO:teuthology.orchestra.run.smithi070.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 262 kB/s | 20 kB 00:00 2024-05-15T14:25:43.134 INFO:teuthology.orchestra.run.smithi070.stdout:(27/36): python3-cherrypy-18.6.1-2.el9.noarch.r 857 kB/s | 358 kB 00:00 2024-05-15T14:25:43.160 INFO:teuthology.orchestra.run.smithi070.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 552 kB/s | 46 kB 00:00 2024-05-15T14:25:43.193 INFO:teuthology.orchestra.run.smithi070.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 784 kB/s | 79 kB 00:00 2024-05-15T14:25:43.229 INFO:teuthology.orchestra.run.smithi018.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-05-15T14:25:43.244 INFO:teuthology.orchestra.run.smithi070.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 197 kB/s | 16 kB 00:00 2024-05-15T14:25:43.269 INFO:teuthology.orchestra.run.smithi070.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-05-15T14:25:43.294 INFO:teuthology.orchestra.run.smithi070.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 894 kB/s | 90 kB 00:00 2024-05-15T14:25:43.336 INFO:teuthology.orchestra.run.smithi070.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 387 kB/s | 36 kB 00:00 2024-05-15T14:25:43.378 INFO:teuthology.orchestra.run.smithi070.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-15T14:25:43.420 INFO:teuthology.orchestra.run.smithi070.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 239 kB/s | 20 kB 00:00 2024-05-15T14:25:43.478 INFO:teuthology.orchestra.run.smithi070.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2024-05-15T14:25:43.480 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:43.480 INFO:teuthology.orchestra.run.smithi070.stdout:Total 5.5 MB/s | 30 MB 00:05 2024-05-15T14:25:43.621 INFO:teuthology.orchestra.run.smithi018.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 279 kB/s | 151 kB 00:00 2024-05-15T14:25:43.622 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:25:43.655 INFO:teuthology.orchestra.run.smithi018.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 102 kB/s | 43 kB 00:00 2024-05-15T14:25:43.662 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:25:43.662 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:25:43.780 INFO:teuthology.orchestra.run.smithi018.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-05-15T14:25:43.872 INFO:teuthology.orchestra.run.smithi018.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 117 kB/s | 11 kB 00:00 2024-05-15T14:25:44.081 INFO:teuthology.orchestra.run.smithi018.stdout:(22/36): ceph-osd-19.0.0-3680.gbf560a26.el9.x86 7.5 MB/s | 17 MB 00:02 2024-05-15T14:25:44.095 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:25:44.095 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:25:44.106 INFO:teuthology.orchestra.run.smithi018.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 76 kB/s | 18 kB 00:00 2024-05-15T14:25:44.131 INFO:teuthology.orchestra.run.smithi018.stdout:(24/36): python3-cherrypy-18.6.1-2.el9.noarch.r 753 kB/s | 358 kB 00:00 2024-05-15T14:25:44.181 INFO:teuthology.orchestra.run.smithi018.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 259 kB/s | 19 kB 00:00 2024-05-15T14:25:44.232 INFO:teuthology.orchestra.run.smithi018.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 275 kB/s | 20 kB 00:00 2024-05-15T14:25:44.257 INFO:teuthology.orchestra.run.smithi018.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-05-15T14:25:44.324 INFO:teuthology.orchestra.run.smithi018.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 857 kB/s | 79 kB 00:00 2024-05-15T14:25:44.349 INFO:teuthology.orchestra.run.smithi018.stdout:(29/36): python3-jaraco-collections-3.0.0-8.el9 86 kB/s | 23 kB 00:00 2024-05-15T14:25:44.375 INFO:teuthology.orchestra.run.smithi018.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-05-15T14:25:44.400 INFO:teuthology.orchestra.run.smithi018.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 218 kB/s | 16 kB 00:00 2024-05-15T14:25:44.459 INFO:teuthology.orchestra.run.smithi018.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 428 kB/s | 36 kB 00:00 2024-05-15T14:25:44.509 INFO:teuthology.orchestra.run.smithi018.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-15T14:25:44.536 INFO:teuthology.orchestra.run.smithi018.stdout:(34/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 482 kB/s | 90 kB 00:00 2024-05-15T14:25:44.586 INFO:teuthology.orchestra.run.smithi018.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-05-15T14:25:44.611 INFO:teuthology.orchestra.run.smithi018.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 195 kB/s | 20 kB 00:00 2024-05-15T14:25:44.617 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:44.617 INFO:teuthology.orchestra.run.smithi018.stdout:Total 6.9 MB/s | 30 MB 00:04 2024-05-15T14:25:44.765 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:25:44.809 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:25:44.809 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:25:45.285 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:25:45.286 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:25:45.345 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:25:45.414 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-15T14:25:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-15T14:25:45.475 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-15T14:25:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-15T14:25:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-15T14:25:45.615 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-15T14:25:45.708 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-15T14:25:45.785 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-15T14:25:45.826 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-15T14:25:45.861 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-15T14:25:45.891 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-15T14:25:45.925 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-15T14:25:45.959 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-15T14:25:45.999 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-15T14:25:46.035 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-15T14:25:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-15T14:25:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-15T14:25:46.180 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-15T14:25:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-15T14:25:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-15T14:25:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-15T14:25:46.523 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-15T14:25:46.567 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:25:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-15T14:25:46.631 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-15T14:25:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-15T14:25:46.664 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-15T14:25:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-15T14:25:46.777 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-15T14:25:46.816 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-15T14:25:46.832 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-15T14:25:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-15T14:25:46.877 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-15T14:25:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-15T14:25:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-15T14:25:47.030 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-15T14:25:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-15T14:25:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-15T14:25:47.085 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-15T14:25:47.120 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-15T14:25:47.149 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-15T14:25:47.184 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-15T14:25:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-15T14:25:47.217 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-15T14:25:47.258 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-15T14:25:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-15T14:25:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-15T14:25:47.383 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-15T14:25:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3680.gbf560a26.el9. 31/36 2024-05-15T14:25:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 32/36 2024-05-15T14:25:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 32/36 2024-05-15T14:25:47.441 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:47.441 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T14:25:47.442 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T14:25:47.442 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T14:25:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:47.459 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-15T14:25:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-15T14:25:47.710 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-15T14:25:47.770 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-15T14:25:47.807 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-15T14:25:47.866 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-15T14:25:47.929 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-15T14:25:48.127 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-15T14:25:48.177 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-15T14:25:48.258 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-15T14:25:48.348 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-15T14:25:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-15T14:25:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-15T14:25:48.705 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3680.gbf560a26.el9. 31/36 2024-05-15T14:25:48.736 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 32/36 2024-05-15T14:25:48.764 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 32/36 2024-05-15T14:25:48.765 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:48.765 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T14:25:48.765 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T14:25:48.765 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T14:25:48.765 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:48.890 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.0.0-3680.gbf560a26.el9.x86_64 33/36 2024-05-15T14:25:48.917 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.0.0-3680.gbf560a26.el9.x86_64 33/36 2024-05-15T14:25:48.917 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:48.917 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T14:25:48.917 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T14:25:48.917 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T14:25:48.917 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:49.357 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.0.0-3680.gbf560a26.el9.x86_64 34/36 2024-05-15T14:25:49.380 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.0.0-3680.gbf560a26.el9.x86_64 34/36 2024-05-15T14:25:49.381 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:49.381 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T14:25:49.381 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T14:25:49.381 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T14:25:49.381 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:49.608 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.0.0-3680.gbf560a26.el9.x86_64 35/36 2024-05-15T14:25:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.0.0-3680.gbf560a26.el9.x86_64 35/36 2024-05-15T14:25:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:49.632 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T14:25:49.632 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T14:25:49.632 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T14:25:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:49.696 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.0.0-3680.gbf560a26.el9.x86_64 36/36 2024-05-15T14:25:50.295 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.0.0-3680.gbf560a26.el9.x86_64 33/36 2024-05-15T14:25:50.324 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.0.0-3680.gbf560a26.el9.x86_64 33/36 2024-05-15T14:25:50.325 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:50.325 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T14:25:50.325 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T14:25:50.325 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T14:25:50.325 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:50.788 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.0.0-3680.gbf560a26.el9.x86_64 34/36 2024-05-15T14:25:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.0.0-3680.gbf560a26.el9.x86_64 34/36 2024-05-15T14:25:50.813 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:50.813 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T14:25:50.813 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T14:25:50.813 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T14:25:50.814 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.0.0-3680.gbf560a26.el9.x86_64 35/36 2024-05-15T14:25:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.0.0-3680.gbf560a26.el9.x86_64 35/36 2024-05-15T14:25:51.072 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:51.073 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T14:25:51.073 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T14:25:51.073 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T14:25:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.0.0-3680.gbf560a26.el9.x86_64 36/36 2024-05-15T14:25:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-2:19.0.0-3680.gbf560a26.el9.x86_64 36/36 2024-05-15T14:25:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.0.0-3680.gbf560a26.el9.x86_64 1/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.0.0-3680.gbf560a26.el9.x86_64 2/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 3/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.0.0-3680.gbf560a26.el9.x86_64 4/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.0.0-3680.gbf560a26.el9.x86_64 5/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3680.gbf560a26.el9. 6/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-15T14:25:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-15T14:25:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-15T14:25:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-15T14:25:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-15T14:25:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:52.450 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:25:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:52.450 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:25:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T14:25:52.451 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T14:25:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T14:25:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T14:25:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T14:25:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T14:25:52.452 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T14:25:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T14:25:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T14:25:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T14:25:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T14:25:52.453 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T14:25:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T14:25:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T14:25:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T14:25:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T14:25:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T14:25:52.454 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T14:25:52.455 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T14:25:52.457 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T14:25:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T14:25:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T14:25:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T14:25:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T14:25:52.458 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T14:25:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T14:25:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T14:25:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T14:25:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T14:25:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T14:25:52.459 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:52.460 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:25:52.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-base 2024-05-15T14:25:52.833 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-2:19.0.0-3680.gbf560a26.el9.x86_64 36/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.0.0-3680.gbf560a26.el9.x86_64 1/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.0.0-3680.gbf560a26.el9.x86_64 2/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 3/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.0.0-3680.gbf560a26.el9.x86_64 4/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.0.0-3680.gbf560a26.el9.x86_64 5/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3680.gbf560a26.el9. 6/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-15T14:25:52.834 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-15T14:25:52.835 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-15T14:25:52.836 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-15T14:25:53.360 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:58 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:25:53.439 INFO:teuthology.orchestra.run.smithi070.stdout:Package ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:25:53.481 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:25:53.482 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:25:53.482 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:25:53.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install cephadm 2024-05-15T14:25:53.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-15T14:25:53.732 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:53.732 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:25:53.732 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:53.732 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:53.732 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:53.732 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:25:53.732 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T14:25:53.733 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T14:25:53.734 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:53.735 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:25:54.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-base 2024-05-15T14:25:54.114 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:59 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:25:54.234 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:25:54.235 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:54.235 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:25:54.235 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:54.235 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 763 k 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 763 k 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 770 k 2024-05-15T14:25:54.236 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:25:54.660 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:58 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:25:54.681 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm-19.0.0-3680.gbf560a26.el9.noarch.rpm 1.7 MB/s | 763 kB 00:00 2024-05-15T14:25:54.681 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:54.682 INFO:teuthology.orchestra.run.smithi070.stdout:Total 1.7 MB/s | 763 kB 00:00 2024-05-15T14:25:54.682 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:25:54.687 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:25:54.687 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:25:54.693 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:25:54.693 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:25:54.745 INFO:teuthology.orchestra.run.smithi018.stdout:Package ceph-base-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:25:54.782 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:25:54.790 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:25:54.791 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:25:54.791 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:25:54.846 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install cephadm 2024-05-15T14:25:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/1 2024-05-15T14:25:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/1 2024-05-15T14:25:55.441 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:59 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:25:55.569 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 763 k 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-05-15T14:25:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:55.571 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 763 k 2024-05-15T14:25:55.571 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 770 k 2024-05-15T14:25:55.571 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:25:55.693 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/1 2024-05-15T14:25:55.828 INFO:teuthology.orchestra.run.smithi018.stdout:cephadm-19.0.0-3680.gbf560a26.el9.noarch.rpm 2.9 MB/s | 763 kB 00:00 2024-05-15T14:25:55.829 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:55.829 INFO:teuthology.orchestra.run.smithi018.stdout:Total 2.9 MB/s | 763 kB 00:00 2024-05-15T14:25:55.829 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:25:55.835 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:25:55.835 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:25:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:25:55.841 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:25:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:25:55.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/1 2024-05-15T14:25:55.955 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:55.955 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:25:55.955 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:25:55.955 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:55.955 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:25:56.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-immutable-object-cache 2024-05-15T14:25:56.348 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/1 2024-05-15T14:25:56.434 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/1 2024-05-15T14:25:56.743 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:01 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:25:56.782 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/1 2024-05-15T14:25:56.865 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:25:56.866 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-05-15T14:25:56.866 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:56.866 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 145 k 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 145 k 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 435 k 2024-05-15T14:25:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:25:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/1 2024-05-15T14:25:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:57.020 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:25:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:25:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:57.020 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:25:57.095 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-immutable-object-cache-19.0.0-3680.gbf560a 636 kB/s | 145 kB 00:00 2024-05-15T14:25:57.095 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:57.096 INFO:teuthology.orchestra.run.smithi070.stdout:Total 632 kB/s | 145 kB 00:00 2024-05-15T14:25:57.096 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:25:57.104 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:25:57.104 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:25:57.159 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:25:57.159 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:25:57.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-immutable-object-cache 2024-05-15T14:25:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:25:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3680.gbf560a26. 1/1 2024-05-15T14:25:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3680.gbf560a26. 1/1 2024-05-15T14:25:57.397 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:57.397 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T14:25:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:57.821 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:01 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:25:57.948 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 145 k 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-05-15T14:25:57.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:57.950 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 145 k 2024-05-15T14:25:57.950 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 435 k 2024-05-15T14:25:57.950 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:25:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3680.gbf560a26. 1/1 2024-05-15T14:25:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:58.279 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:25:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:58.279 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:58.279 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:25:58.292 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-immutable-object-cache-19.0.0-3680.gbf560a 423 kB/s | 145 kB 00:00 2024-05-15T14:25:58.292 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:25:58.293 INFO:teuthology.orchestra.run.smithi018.stdout:Total 421 kB/s | 145 kB 00:00 2024-05-15T14:25:58.293 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:25:58.302 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:25:58.302 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:25:58.362 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:25:58.362 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:25:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:25:58.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr 2024-05-15T14:25:58.568 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3680.gbf560a26. 1/1 2024-05-15T14:25:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3680.gbf560a26. 1/1 2024-05-15T14:25:58.596 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:25:58.596 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T14:25:58.596 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:59.096 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:04 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:25:59.178 INFO:teuthology.orchestra.run.smithi070.stdout:Package ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:25:59.222 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:25:59.223 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:25:59.223 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:25:59.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-dashboard 2024-05-15T14:25:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3680.gbf560a26. 1/1 2024-05-15T14:25:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:59.527 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:25:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:25:59.527 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:25:59.527 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:25:59.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr 2024-05-15T14:25:59.851 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:04 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:25:59.974 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:25:59.975 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:59.975 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:25:59.975 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:59.975 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:25:59.975 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 3.5 M 2024-05-15T14:25:59.975 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 34 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 16 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T14:25:59.976 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:59.977 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:25:59.977 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:25:59.977 INFO:teuthology.orchestra.run.smithi070.stdout:Install 12 Packages 2024-05-15T14:25:59.977 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:25:59.977 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 8.6 M 2024-05-15T14:25:59.977 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 104 M 2024-05-15T14:25:59.978 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:00.360 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:04 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:00.442 INFO:teuthology.orchestra.run.smithi018.stdout:Package ceph-mgr-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:00.487 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:00.488 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:26:00.488 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:00.546 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-dashboard 2024-05-15T14:26:00.664 INFO:teuthology.orchestra.run.smithi070.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3680.gbf 105 kB/s | 34 kB 00:00 2024-05-15T14:26:00.965 INFO:teuthology.orchestra.run.smithi070.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3680.gbf5 26 kB/s | 16 kB 00:00 2024-05-15T14:26:01.138 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:05 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:01.190 INFO:teuthology.orchestra.run.smithi070.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-05-15T14:26:01.270 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:01.271 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:26:01.271 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 3.5 M 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 34 k 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 16 k 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T14:26:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T14:26:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T14:26:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:01.273 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:01.273 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:01.273 INFO:teuthology.orchestra.run.smithi018.stdout:Install 12 Packages 2024-05-15T14:26:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:01.273 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 8.6 M 2024-05-15T14:26:01.274 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 104 M 2024-05-15T14:26:01.274 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:01.274 INFO:teuthology.orchestra.run.smithi070.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 872 kB/s | 269 kB 00:00 2024-05-15T14:26:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.4 MB/s | 863 kB 00:00 2024-05-15T14:26:01.749 INFO:teuthology.orchestra.run.smithi070.stdout:(6/12): ceph-mgr-dashboard-19.0.0-3680.gbf560a2 2.5 MB/s | 3.5 MB 00:01 2024-05-15T14:26:01.774 INFO:teuthology.orchestra.run.smithi070.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 50 kB/s | 19 kB 00:00 2024-05-15T14:26:02.108 INFO:teuthology.orchestra.run.smithi070.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 657 kB/s | 548 kB 00:00 2024-05-15T14:26:02.233 INFO:teuthology.orchestra.run.smithi070.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 246 kB/s | 31 kB 00:00 2024-05-15T14:26:02.304 INFO:teuthology.orchestra.run.smithi018.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3680.gbf 95 kB/s | 34 kB 00:00 2024-05-15T14:26:02.330 INFO:teuthology.orchestra.run.smithi018.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3680.gbf5 43 kB/s | 16 kB 00:00 2024-05-15T14:26:02.342 INFO:teuthology.orchestra.run.smithi070.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 255 kB/s | 144 kB 00:00 2024-05-15T14:26:02.375 INFO:teuthology.orchestra.run.smithi070.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.3 MB/s | 188 kB 00:00 2024-05-15T14:26:02.388 INFO:teuthology.orchestra.run.smithi018.stdout:(3/12): ceph-mgr-dashboard-19.0.0-3680.gbf560a2 8.0 MB/s | 3.5 MB 00:00 2024-05-15T14:26:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.6 MB/s | 2.0 MB 00:00 2024-05-15T14:26:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:02.544 INFO:teuthology.orchestra.run.smithi070.stdout:Total 3.4 MB/s | 8.6 MB 00:02 2024-05-15T14:26:02.588 INFO:teuthology.orchestra.run.smithi018.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.0 MB/s | 269 kB 00:00 2024-05-15T14:26:02.596 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:02.614 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:02.614 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:02.639 INFO:teuthology.orchestra.run.smithi018.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.0 MB/s | 1.0 MB 00:00 2024-05-15T14:26:02.804 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:02.804 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:03.014 INFO:teuthology.orchestra.run.smithi018.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 56 kB/s | 19 kB 00:00 2024-05-15T14:26:03.339 INFO:teuthology.orchestra.run.smithi018.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 730 kB/s | 548 kB 00:00 2024-05-15T14:26:03.396 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:03.398 INFO:teuthology.orchestra.run.smithi018.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 855 kB/s | 863 kB 00:01 2024-05-15T14:26:03.448 INFO:teuthology.orchestra.run.smithi018.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.3 MB/s | 144 kB 00:00 2024-05-15T14:26:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-15T14:26:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-15T14:26:03.550 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-15T14:26:03.565 INFO:teuthology.orchestra.run.smithi018.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.6 MB/s | 188 kB 00:00 2024-05-15T14:26:03.588 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-15T14:26:03.624 INFO:teuthology.orchestra.run.smithi018.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.3 MB/s | 2.0 MB 00:00 2024-05-15T14:26:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-15T14:26:03.774 INFO:teuthology.orchestra.run.smithi018.stdout:(12/12): python3-repoze-lru-0.7-16.el9.noarch.r 82 kB/s | 31 kB 00:00 2024-05-15T14:26:03.779 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:03.779 INFO:teuthology.orchestra.run.smithi018.stdout:Total 3.5 MB/s | 8.6 MB 00:02 2024-05-15T14:26:03.824 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-15T14:26:03.834 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:03.855 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:03.855 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-15T14:26:03.960 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-15T14:26:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-15T14:26:04.037 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3680.gbf560a26.el9 10/12 2024-05-15T14:26:04.055 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:04.055 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:04.720 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-15T14:26:04.836 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-15T14:26:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-15T14:26:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-15T14:26:05.012 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-15T14:26:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3680.gbf560a26.el 11/12 2024-05-15T14:26:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3680.gbf560a26.el9.noa 12/12 2024-05-15T14:26:05.154 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-15T14:26:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-15T14:26:05.302 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-15T14:26:05.328 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-15T14:26:05.361 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3680.gbf560a26.el9 10/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3680.gbf560a26.el9.noa 12/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3680.gbf560a26.el 1/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3680.gbf560a26.el9.noa 2/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3680.gbf560a26.el9 3/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-15T14:26:06.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-15T14:26:06.365 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-15T14:26:06.365 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-15T14:26:06.365 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-15T14:26:06.469 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3680.gbf560a26.el 11/12 2024-05-15T14:26:06.511 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3680.gbf560a26.el9.noa 12/12 2024-05-15T14:26:06.678 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T14:26:06.679 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T14:26:06.680 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T14:26:06.680 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T14:26:06.680 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:06.680 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:06.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-15T14:26:07.469 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:12 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:07.591 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:07.592 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-15T14:26:07.592 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 7.4 M 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T14:26:07.593 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout:Install 12 Packages 2024-05-15T14:26:07.594 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:07.595 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 38 M 2024-05-15T14:26:07.595 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 209 M 2024-05-15T14:26:07.595 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:07.802 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3680.gbf560a26.el9.noa 12/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3680.gbf560a26.el 1/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3680.gbf560a26.el9.noa 2/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3680.gbf560a26.el9 3/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-15T14:26:07.803 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-15T14:26:08.125 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T14:26:08.126 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T14:26:08.127 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T14:26:08.127 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:08.127 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:08.182 INFO:teuthology.orchestra.run.smithi070.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-05-15T14:26:08.299 INFO:teuthology.orchestra.run.smithi070.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-05-15T14:26:08.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-15T14:26:08.567 INFO:teuthology.orchestra.run.smithi070.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 85 kB/s | 33 kB 00:00 2024-05-15T14:26:08.684 INFO:teuthology.orchestra.run.smithi070.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-05-15T14:26:08.801 INFO:teuthology.orchestra.run.smithi070.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 302 kB/s | 35 kB 00:00 2024-05-15T14:26:08.943 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:12 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:09.072 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:09.073 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-05-15T14:26:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:26:09.073 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-05-15T14:26:09.073 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 7.4 M 2024-05-15T14:26:09.073 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:26:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T14:26:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout:Install 12 Packages 2024-05-15T14:26:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:09.075 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 38 M 2024-05-15T14:26:09.075 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 209 M 2024-05-15T14:26:09.075 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:09.548 INFO:teuthology.orchestra.run.smithi018.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-05-15T14:26:09.568 INFO:teuthology.orchestra.run.smithi070.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-05-15T14:26:09.640 INFO:teuthology.orchestra.run.smithi018.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-05-15T14:26:09.676 INFO:teuthology.orchestra.run.smithi070.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-05-15T14:26:10.015 INFO:teuthology.orchestra.run.smithi018.stdout:(3/12): ceph-mgr-diskprediction-local-19.0.0-36 12 MB/s | 7.4 MB 00:00 2024-05-15T14:26:10.210 INFO:teuthology.orchestra.run.smithi070.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-36 3.4 MB/s | 7.4 MB 00:02 2024-05-15T14:26:10.240 INFO:teuthology.orchestra.run.smithi018.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 47 kB/s | 33 kB 00:00 2024-05-15T14:26:10.557 INFO:teuthology.orchestra.run.smithi018.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 34 kB/s | 18 kB 00:00 2024-05-15T14:26:10.726 INFO:teuthology.orchestra.run.smithi070.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 485 kB/s | 250 kB 00:00 2024-05-15T14:26:10.802 INFO:teuthology.orchestra.run.smithi070.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 2.4 MB/s | 4.7 MB 00:02 2024-05-15T14:26:10.849 INFO:teuthology.orchestra.run.smithi018.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 58 kB/s | 35 kB 00:00 2024-05-15T14:26:10.908 INFO:teuthology.orchestra.run.smithi018.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-05-15T14:26:11.674 INFO:teuthology.orchestra.run.smithi018.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 296 kB/s | 244 kB 00:00 2024-05-15T14:26:11.783 INFO:teuthology.orchestra.run.smithi018.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 3.9 MB/s | 4.7 MB 00:01 2024-05-15T14:26:12.183 INFO:teuthology.orchestra.run.smithi018.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-05-15T14:26:12.452 INFO:teuthology.orchestra.run.smithi070.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.8 MB/s | 5.1 MB 00:02 2024-05-15T14:26:12.742 INFO:teuthology.orchestra.run.smithi018.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 235 kB/s | 250 kB 00:01 2024-05-15T14:26:13.667 INFO:teuthology.orchestra.run.smithi018.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.6 MB/s | 16 MB 00:01 2024-05-15T14:26:13.668 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:13.669 INFO:teuthology.orchestra.run.smithi018.stdout:Total 8.3 MB/s | 38 MB 00:04 2024-05-15T14:26:14.041 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:14.069 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:14.070 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:14.518 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:14.518 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:15.300 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:15.380 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-15T14:26:15.424 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-15T14:26:15.528 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-15T14:26:15.567 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-15T14:26:15.752 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-15T14:26:15.782 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-15T14:26:15.862 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-15T14:26:16.550 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-15T14:26:16.668 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-15T14:26:16.943 INFO:teuthology.orchestra.run.smithi070.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.6 MB/s | 16 MB 00:06 2024-05-15T14:26:16.944 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:16.944 INFO:teuthology.orchestra.run.smithi070.stdout:Total 4.1 MB/s | 38 MB 00:09 2024-05-15T14:26:17.303 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:17.330 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:17.330 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:17.764 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:17.764 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:18.015 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-15T14:26:18.544 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:18.617 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-15T14:26:18.657 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-15T14:26:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-15T14:26:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-15T14:26:18.983 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-15T14:26:19.008 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-15T14:26:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-15T14:26:19.094 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-15T14:26:19.122 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3680.gbf560 12/12 2024-05-15T14:26:19.724 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-15T14:26:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-15T14:26:21.065 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-15T14:26:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3680.gbf560 12/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3680.gbf560 1/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-15T14:26:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-15T14:26:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-15T14:26:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T14:26:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T14:26:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T14:26:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T14:26:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T14:26:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T14:26:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T14:26:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T14:26:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:22.095 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-15T14:26:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3680.gbf560 12/12 2024-05-15T14:26:22.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-rook 2024-05-15T14:26:23.078 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:27 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:23.207 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:23.208 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:26:23.208 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 49 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T14:26:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T14:26:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T14:26:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T14:26:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:23.210 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:23.210 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:23.210 INFO:teuthology.orchestra.run.smithi018.stdout:Install 13 Packages 2024-05-15T14:26:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:23.211 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 2.2 M 2024-05-15T14:26:23.211 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 26 M 2024-05-15T14:26:23.211 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:24.171 INFO:teuthology.orchestra.run.smithi018.stdout:(1/13): ceph-mgr-rook-19.0.0-3680.gbf560a26.el9 150 kB/s | 49 kB 00:00 2024-05-15T14:26:24.196 INFO:teuthology.orchestra.run.smithi018.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 72 kB/s | 26 kB 00:00 2024-05-15T14:26:24.221 INFO:teuthology.orchestra.run.smithi018.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 50 kB/s | 19 kB 00:00 2024-05-15T14:26:24.355 INFO:teuthology.orchestra.run.smithi018.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-05-15T14:26:24.405 INFO:teuthology.orchestra.run.smithi018.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 865 kB/s | 159 kB 00:00 2024-05-15T14:26:24.439 INFO:teuthology.orchestra.run.smithi018.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 642 kB/s | 54 kB 00:00 2024-05-15T14:26:24.539 INFO:teuthology.orchestra.run.smithi018.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 241 kB/s | 32 kB 00:00 2024-05-15T14:26:24.564 INFO:teuthology.orchestra.run.smithi018.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 120 kB/s | 15 kB 00:00 2024-05-15T14:26:24.598 INFO:teuthology.orchestra.run.smithi018.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 741 kB/s | 279 kB 00:00 2024-05-15T14:26:24.665 INFO:teuthology.orchestra.run.smithi018.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.6 MB/s | 206 kB 00:00 2024-05-15T14:26:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3680.gbf560 12/12 2024-05-15T14:26:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3680.gbf560 1/12 2024-05-15T14:26:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-15T14:26:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-15T14:26:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-15T14:26:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-15T14:26:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-15T14:26:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-15T14:26:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-15T14:26:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-15T14:26:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-15T14:26:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-15T14:26:24.723 INFO:teuthology.orchestra.run.smithi018.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-05-15T14:26:24.873 INFO:teuthology.orchestra.run.smithi018.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 215 kB/s | 59 kB 00:00 2024-05-15T14:26:24.924 INFO:teuthology.orchestra.run.smithi018.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.8 MB/s | 1.0 MB 00:00 2024-05-15T14:26:24.924 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:24.925 INFO:teuthology.orchestra.run.smithi018.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-05-15T14:26:24.999 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:25.015 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:25.015 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-15T14:26:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:25.067 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:25.068 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:25.113 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:25.114 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:25.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-rook 2024-05-15T14:26:25.663 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:25.873 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-15T14:26:25.927 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-15T14:26:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-15T14:26:25.995 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:30 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:26.027 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-15T14:26:26.069 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-15T14:26:26.117 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 49 k 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T14:26:26.119 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout:Install 13 Packages 2024-05-15T14:26:26.120 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:26.121 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 2.2 M 2024-05-15T14:26:26.121 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 26 M 2024-05-15T14:26:26.121 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:26.166 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-15T14:26:26.277 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-15T14:26:26.329 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-15T14:26:26.335 INFO:teuthology.orchestra.run.smithi070.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 180 kB/s | 19 kB 00:00 2024-05-15T14:26:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 195 kB/s | 26 kB 00:00 2024-05-15T14:26:26.485 INFO:teuthology.orchestra.run.smithi070.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-05-15T14:26:26.510 INFO:teuthology.orchestra.run.smithi070.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-05-15T14:26:26.544 INFO:teuthology.orchestra.run.smithi070.stdout:(5/13): ceph-mgr-rook-19.0.0-3680.gbf560a26.el9 156 kB/s | 49 kB 00:00 2024-05-15T14:26:26.570 INFO:teuthology.orchestra.run.smithi070.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 911 kB/s | 54 kB 00:00 2024-05-15T14:26:26.594 INFO:teuthology.orchestra.run.smithi070.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-05-15T14:26:26.645 INFO:teuthology.orchestra.run.smithi070.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 199 kB/s | 15 kB 00:00 2024-05-15T14:26:26.662 INFO:teuthology.orchestra.run.smithi070.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 274 kB/s | 32 kB 00:00 2024-05-15T14:26:26.720 INFO:teuthology.orchestra.run.smithi070.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-15T14:26:26.746 INFO:teuthology.orchestra.run.smithi070.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 1.3 MB/s | 206 kB 00:00 2024-05-15T14:26:26.771 INFO:teuthology.orchestra.run.smithi070.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-05-15T14:26:26.838 INFO:teuthology.orchestra.run.smithi070.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.3 MB/s | 1.0 MB 00:00 2024-05-15T14:26:26.838 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:26.838 INFO:teuthology.orchestra.run.smithi070.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-05-15T14:26:26.902 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:26.917 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:26.917 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:27.001 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:27.002 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-15T14:26:27.151 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-15T14:26:27.184 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-15T14:26:27.233 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-15T14:26:27.262 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.0.0-3680.gbf560a26.el9.noarch 13/13 2024-05-15T14:26:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-15T14:26:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-15T14:26:27.777 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-15T14:26:27.815 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-15T14:26:27.856 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-15T14:26:27.950 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-15T14:26:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3680.gbf560a26.el9.noarch 13/13 2024-05-15T14:26:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3680.gbf560a26.el9.noarch 1/13 2024-05-15T14:26:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-15T14:26:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-15T14:26:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-15T14:26:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-15T14:26:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-15T14:26:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-15T14:26:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-15T14:26:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-15T14:26:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-15T14:26:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-15T14:26:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-15T14:26:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-15T14:26:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-15T14:26:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-15T14:26:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:28.358 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:28.358 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:28.359 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:28.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-cephadm 2024-05-15T14:26:28.813 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-15T14:26:28.864 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-15T14:26:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-15T14:26:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-15T14:26:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.0.0-3680.gbf560a26.el9.noarch 13/13 2024-05-15T14:26:29.225 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:33 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:29.353 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:29.354 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:26:29.354 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:29.354 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:29.354 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 143 k 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout:Install 6 Packages 2024-05-15T14:26:29.355 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:29.356 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 7.0 M 2024-05-15T14:26:29.356 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 33 M 2024-05-15T14:26:29.356 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:29.728 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3680.gbf560a26.el9.noarch 13/13 2024-05-15T14:26:29.728 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3680.gbf560a26.el9.noarch 1/13 2024-05-15T14:26:29.728 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-15T14:26:29.728 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-15T14:26:29.728 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-15T14:26:29.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-15T14:26:29.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-15T14:26:29.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-15T14:26:29.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-15T14:26:29.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-15T14:26:29.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-15T14:26:29.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-15T14:26:29.729 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-15T14:26:29.976 INFO:teuthology.orchestra.run.smithi018.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-05-15T14:26:30.055 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T14:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T14:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T14:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:30.059 INFO:teuthology.orchestra.run.smithi018.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3680.gbf560a26.e 633 kB/s | 143 kB 00:00 2024-05-15T14:26:30.143 INFO:teuthology.orchestra.run.smithi018.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-05-15T14:26:30.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-cephadm 2024-05-15T14:26:30.485 INFO:teuthology.orchestra.run.smithi018.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 136 kB/s | 58 kB 00:00 2024-05-15T14:26:30.569 INFO:teuthology.orchestra.run.smithi018.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 120 kB/s | 51 kB 00:00 2024-05-15T14:26:30.802 INFO:teuthology.orchestra.run.smithi018.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 664 kB/s | 548 kB 00:00 2024-05-15T14:26:30.803 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:30.804 INFO:teuthology.orchestra.run.smithi018.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-05-15T14:26:30.878 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:30.889 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:30.889 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:30.906 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:35 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:30.993 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:30.993 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:31.028 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 143 k 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T14:26:31.029 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:31.030 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:31.030 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:31.030 INFO:teuthology.orchestra.run.smithi070.stdout:Install 6 Packages 2024-05-15T14:26:31.030 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:31.030 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 7.0 M 2024-05-15T14:26:31.030 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 33 M 2024-05-15T14:26:31.031 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:31.315 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:31.494 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-15T14:26:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-15T14:26:31.690 INFO:teuthology.orchestra.run.smithi070.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-05-15T14:26:31.857 INFO:teuthology.orchestra.run.smithi070.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-05-15T14:26:32.091 INFO:teuthology.orchestra.run.smithi070.stdout:(3/6): ceph-mgr-cephadm-19.0.0-3680.gbf560a26.e 248 kB/s | 143 kB 00:00 2024-05-15T14:26:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-15T14:26:32.191 INFO:teuthology.orchestra.run.smithi070.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-05-15T14:26:32.202 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-15T14:26:32.208 INFO:teuthology.orchestra.run.smithi070.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 165 kB/s | 58 kB 00:00 2024-05-15T14:26:32.233 INFO:teuthology.orchestra.run.smithi070.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 358 kB/s | 51 kB 00:00 2024-05-15T14:26:32.235 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:32.235 INFO:teuthology.orchestra.run.smithi070.stdout:Total 5.8 MB/s | 7.0 MB 00:01 2024-05-15T14:26:32.272 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-15T14:26:32.300 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 6/6 2024-05-15T14:26:32.305 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:32.316 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:32.316 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:32.412 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:32.413 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-15T14:26:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-15T14:26:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 6/6 2024-05-15T14:26:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/6 2024-05-15T14:26:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-15T14:26:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-15T14:26:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-15T14:26:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-15T14:26:33.305 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-15T14:26:33.305 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:33.305 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:33.305 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:33.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T14:26:33.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T14:26:33.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T14:26:33.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T14:26:33.306 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T14:26:33.306 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:33.306 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-15T14:26:33.555 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-15T14:26:33.570 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-fuse 2024-05-15T14:26:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-15T14:26:33.647 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 6/6 2024-05-15T14:26:34.174 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:38 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:34.303 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:34.303 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:26:34.303 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:34.303 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 890 k 2024-05-15T14:26:34.303 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:26:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T14:26:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:34.304 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:34.304 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:34.304 INFO:teuthology.orchestra.run.smithi018.stdout:Install 2 Packages 2024-05-15T14:26:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:34.304 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 970 k 2024-05-15T14:26:34.305 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 2.8 M 2024-05-15T14:26:34.305 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 6/6 2024-05-15T14:26:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 1/6 2024-05-15T14:26:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-15T14:26:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-15T14:26:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-15T14:26:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-15T14:26:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-15T14:26:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:34.654 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:34.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-fuse 2024-05-15T14:26:35.062 INFO:teuthology.orchestra.run.smithi018.stdout:(1/2): ceph-fuse-19.0.0-3680.gbf560a26.el9.x86_ 1.8 MB/s | 890 kB 00:00 2024-05-15T14:26:35.288 INFO:teuthology.orchestra.run.smithi018.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 114 kB/s | 80 kB 00:00 2024-05-15T14:26:35.289 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:35.289 INFO:teuthology.orchestra.run.smithi018.stdout:Total 985 kB/s | 970 kB 00:00 2024-05-15T14:26:35.302 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:35.326 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:35.326 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:35.410 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:35.411 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:35.486 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:40 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:35.608 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:35.608 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:35.608 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:26:35.608 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:35.608 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 890 k 2024-05-15T14:26:35.609 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:26:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T14:26:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:35.609 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:35.609 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:35.609 INFO:teuthology.orchestra.run.smithi070.stdout:Install 2 Packages 2024-05-15T14:26:35.609 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:35.610 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 970 k 2024-05-15T14:26:35.610 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 2.8 M 2024-05-15T14:26:35.610 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:35.726 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:35.878 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-15T14:26:35.948 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 2/2 2024-05-15T14:26:36.061 INFO:teuthology.orchestra.run.smithi070.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 476 kB/s | 80 kB 00:00 2024-05-15T14:26:36.369 INFO:teuthology.orchestra.run.smithi070.stdout:(2/2): ceph-fuse-19.0.0-3680.gbf560a26.el9.x86_ 1.8 MB/s | 890 kB 00:00 2024-05-15T14:26:36.370 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:36.370 INFO:teuthology.orchestra.run.smithi070.stdout:Total 1.2 MB/s | 970 kB 00:00 2024-05-15T14:26:36.381 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:36.403 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:36.403 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:36.481 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:36.481 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 2/2 2024-05-15T14:26:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 1/2 2024-05-15T14:26:36.676 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:36.803 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-15T14:26:36.867 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 2/2 2024-05-15T14:26:36.888 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-15T14:26:36.888 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:36.888 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:36.888 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-15T14:26:36.889 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:36.889 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:37.143 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-volume 2024-05-15T14:26:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 2/2 2024-05-15T14:26:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 1/2 2024-05-15T14:26:37.751 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:41 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-15T14:26:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:37.797 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-15T14:26:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:37.797 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:37.881 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 273 k 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:37.882 INFO:teuthology.orchestra.run.smithi018.stdout:Install 2 Packages 2024-05-15T14:26:37.883 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:37.883 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 350 k 2024-05-15T14:26:37.883 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 1.5 M 2024-05-15T14:26:37.883 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:38.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-volume 2024-05-15T14:26:38.267 INFO:teuthology.orchestra.run.smithi018.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 388 kB/s | 77 kB 00:00 2024-05-15T14:26:38.543 INFO:teuthology.orchestra.run.smithi018.stdout:(2/2): ceph-volume-19.0.0-3680.gbf560a26.el9.no 576 kB/s | 273 kB 00:00 2024-05-15T14:26:38.543 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:38.543 INFO:teuthology.orchestra.run.smithi018.stdout:Total 529 kB/s | 350 kB 00:00 2024-05-15T14:26:38.556 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:38.567 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:38.567 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:38.604 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:38.605 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:38.620 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:43 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:38.744 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.0.0-3680.gbf560a26.el9 ceph-noarch 273 k 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:38.745 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:38.746 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:38.746 INFO:teuthology.orchestra.run.smithi070.stdout:Install 2 Packages 2024-05-15T14:26:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:38.746 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 350 k 2024-05-15T14:26:38.747 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 1.5 M 2024-05-15T14:26:38.747 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:38.760 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:38.948 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-15T14:26:38.987 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.0.0-3680.gbf560a26.el9.noarch 2/2 2024-05-15T14:26:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.0.0-3680.gbf560a26.el9.noarch 2/2 2024-05-15T14:26:39.004 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:26:39.004 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T14:26:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:39.192 INFO:teuthology.orchestra.run.smithi070.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 755 kB/s | 77 kB 00:00 2024-05-15T14:26:39.342 INFO:teuthology.orchestra.run.smithi070.stdout:(2/2): ceph-volume-19.0.0-3680.gbf560a26.el9.no 1.1 MB/s | 273 kB 00:00 2024-05-15T14:26:39.343 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:39.343 INFO:teuthology.orchestra.run.smithi070.stdout:Total 586 kB/s | 350 kB 00:00 2024-05-15T14:26:39.355 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:39.364 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:39.364 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:39.397 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:39.397 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:39.538 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:39.721 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.0.0-3680.gbf560a26.el9.noarch 1/2 2024-05-15T14:26:39.722 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-15T14:26:39.753 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.0.0-3680.gbf560a26.el9.noarch 2/2 2024-05-15T14:26:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.0.0-3680.gbf560a26.el9.noarch 2/2 2024-05-15T14:26:39.770 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:26:39.770 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T14:26:39.770 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:40.013 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-15T14:26:40.013 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:40.013 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:40.013 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:40.013 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T14:26:40.013 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:40.014 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:40.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librados-devel 2024-05-15T14:26:40.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.0.0-3680.gbf560a26.el9.noarch 1/2 2024-05-15T14:26:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-15T14:26:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:40.736 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.0.0-3680.gbf560a26.el9.noarch 2024-05-15T14:26:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T14:26:40.736 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:40.737 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:40.975 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:44 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:41.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librados-devel 2024-05-15T14:26:41.103 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:41.104 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:41.104 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-05-15T14:26:41.104 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:41.104 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:41.104 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 127 k 2024-05-15T14:26:41.105 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:41.105 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:41.105 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:41.105 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-05-15T14:26:41.105 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:41.105 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 127 k 2024-05-15T14:26:41.105 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 456 k 2024-05-15T14:26:41.105 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:41.490 INFO:teuthology.orchestra.run.smithi018.stdout:librados-devel-19.0.0-3680.gbf560a26.el9.x86_64 329 kB/s | 127 kB 00:00 2024-05-15T14:26:41.491 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:41.491 INFO:teuthology.orchestra.run.smithi018.stdout:Total 328 kB/s | 127 kB 00:00 2024-05-15T14:26:41.491 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:41.497 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:41.497 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:41.565 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:41.565 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:41.613 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:46 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:41.722 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:41.740 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 127 k 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-05-15T14:26:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 127 k 2024-05-15T14:26:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 456 k 2024-05-15T14:26:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:41.816 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:42.132 INFO:teuthology.orchestra.run.smithi070.stdout:librados-devel-19.0.0-3680.gbf560a26.el9.x86_64 325 kB/s | 127 kB 00:00 2024-05-15T14:26:42.132 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:42.133 INFO:teuthology.orchestra.run.smithi070.stdout:Total 324 kB/s | 127 kB 00:00 2024-05-15T14:26:42.133 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:42.138 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:42.138 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:42.202 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:42.203 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:42.463 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:42.487 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:42.487 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:42.487 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:42.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install libcephfs2 2024-05-15T14:26:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:43.100 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:43.101 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:43.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install libcephfs2 2024-05-15T14:26:43.328 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:47 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:43.415 INFO:teuthology.orchestra.run.smithi018.stdout:Package libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:26:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:43.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install libcephfs-devel 2024-05-15T14:26:43.905 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:48 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:43.987 INFO:teuthology.orchestra.run.smithi070.stdout:Package libcephfs2-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:44.030 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:44.031 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:26:44.031 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:44.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install libcephfs-devel 2024-05-15T14:26:44.140 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:48 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:44.267 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:44.268 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-05-15T14:26:44.268 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:44.268 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 32 k 2024-05-15T14:26:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:44.269 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:44.269 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:44.269 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-05-15T14:26:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:44.269 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 32 k 2024-05-15T14:26:44.269 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 142 k 2024-05-15T14:26:44.269 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:44.444 INFO:teuthology.orchestra.run.smithi018.stdout:libcephfs-devel-19.0.0-3680.gbf560a26.el9.x86_6 181 kB/s | 32 kB 00:00 2024-05-15T14:26:44.445 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:44.445 INFO:teuthology.orchestra.run.smithi018.stdout:Total 180 kB/s | 32 kB 00:00 2024-05-15T14:26:44.445 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:44.449 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:44.449 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:44.467 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:44.467 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:44.674 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:49 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:44.678 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:44.796 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:44.796 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 32 k 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 32 k 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 142 k 2024-05-15T14:26:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:45.044 INFO:teuthology.orchestra.run.smithi070.stdout:libcephfs-devel-19.0.0-3680.gbf560a26.el9.x86_6 129 kB/s | 32 kB 00:00 2024-05-15T14:26:45.044 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:45.045 INFO:teuthology.orchestra.run.smithi070.stdout:Total 128 kB/s | 32 kB 00:00 2024-05-15T14:26:45.045 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:45.050 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:45.050 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:45.072 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:45.072 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:45.150 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:45.277 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:45.277 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:45.277 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:45.278 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:45.278 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:45.278 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:45.282 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:45.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librados2 2024-05-15T14:26:45.644 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:45.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:45.868 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:45.868 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:45.868 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:45.869 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:45.869 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:46.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librados2 2024-05-15T14:26:46.043 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:50 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:46.126 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:46.170 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:46.172 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:26:46.172 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:46.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librbd1 2024-05-15T14:26:46.595 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:51 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:46.674 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:46.717 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:46.718 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:26:46.718 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:46.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librbd1 2024-05-15T14:26:46.844 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:50 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:46.974 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:46.975 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:26:46.975 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:47.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rados 2024-05-15T14:26:47.353 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:52 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:47.433 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:47.475 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:47.476 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:26:47.476 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:47.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rados 2024-05-15T14:26:47.640 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:51 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:47.724 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rados-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:47.767 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:47.769 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:26:47.769 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:47.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rgw 2024-05-15T14:26:48.117 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:53 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:48.199 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rados-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:48.240 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:48.241 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:26:48.241 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:48.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rgw 2024-05-15T14:26:48.432 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:52 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:48.518 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rgw-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:48.562 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:48.563 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:26:48.563 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:48.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-cephfs 2024-05-15T14:26:48.886 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:53 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:48.967 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rgw-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:49.009 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:49.010 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:26:49.010 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:49.073 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-cephfs 2024-05-15T14:26:49.220 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:53 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:49.304 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-cephfs-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:49.349 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:49.350 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:26:49.350 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:49.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rbd 2024-05-15T14:26:49.652 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:54 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:49.733 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-cephfs-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:49.775 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:49.776 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:26:49.776 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:49.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rbd 2024-05-15T14:26:50.026 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:54 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:50.114 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rbd-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:50.159 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:50.160 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-05-15T14:26:50.161 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:50.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-fuse 2024-05-15T14:26:50.415 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:55 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:50.495 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rbd-2:19.0.0-3680.gbf560a26.el9.x86_64 is already installed. 2024-05-15T14:26:50.537 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:50.538 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-15T14:26:50.538 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:50.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-fuse 2024-05-15T14:26:50.873 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:54 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:51.002 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:51.003 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-05-15T14:26:51.003 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:51.003 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 86 k 2024-05-15T14:26:51.003 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:51.003 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:51.003 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:51.004 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-05-15T14:26:51.004 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:51.004 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 86 k 2024-05-15T14:26:51.004 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 231 k 2024-05-15T14:26:51.004 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:51.165 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:56 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:51.298 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:51.299 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:51.299 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-05-15T14:26:51.299 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:51.299 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:51.299 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 86 k 2024-05-15T14:26:51.300 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-05-15T14:26:51.300 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 86 k 2024-05-15T14:26:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 231 k 2024-05-15T14:26:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:51.597 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-fuse-19.0.0-3680.gbf560a26.el9.x86_64.rpm 144 kB/s | 86 kB 00:00 2024-05-15T14:26:51.598 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:51.598 INFO:teuthology.orchestra.run.smithi018.stdout:Total 144 kB/s | 86 kB 00:00 2024-05-15T14:26:51.598 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:51.609 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:51.610 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:51.675 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:51.675 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:51.824 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:51.931 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:52.272 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:52.288 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-fuse-19.0.0-3680.gbf560a26.el9.x86_64.rpm 87 kB/s | 86 kB 00:00 2024-05-15T14:26:52.288 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:52.289 INFO:teuthology.orchestra.run.smithi070.stdout:Total 86 kB/s | 86 kB 00:00 2024-05-15T14:26:52.289 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:52.297 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:52.297 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:52.362 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:52.363 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:52.626 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:52.660 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:52.660 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:52.887 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-mirror 2024-05-15T14:26:52.976 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:53.242 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:53.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:53.242 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:53.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-mirror 2024-05-15T14:26:53.493 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:57 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:53.623 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:53.623 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-05-15T14:26:53.623 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:53.624 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 3.1 M 2024-05-15T14:26:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:53.624 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:53.624 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:53.624 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-05-15T14:26:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:53.624 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 3.1 M 2024-05-15T14:26:53.625 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 13 M 2024-05-15T14:26:53.625 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:54.070 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:59 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:54.195 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:54.196 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:54.196 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 3.1 M 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 3.1 M 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 13 M 2024-05-15T14:26:54.197 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:54.739 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-mirror-19.0.0-3680.gbf560a26.el9.x86_64.rpm 5.7 MB/s | 3.1 MB 00:00 2024-05-15T14:26:54.739 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:54.740 INFO:teuthology.orchestra.run.smithi070.stdout:Total 5.7 MB/s | 3.1 MB 00:00 2024-05-15T14:26:54.740 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:54.749 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:54.749 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:54.830 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:54.830 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:55.033 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-mirror-19.0.0-3680.gbf560a26.el9.x86_64.rpm 2.2 MB/s | 3.1 MB 00:01 2024-05-15T14:26:55.033 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:55.033 INFO:teuthology.orchestra.run.smithi018.stdout:Total 2.2 MB/s | 3.1 MB 00:01 2024-05-15T14:26:55.034 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:55.045 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:55.046 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:55.135 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:55.135 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:55.357 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:26:55.357 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T14:26:55.357 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T14:26:55.357 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T14:26:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:55.666 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:55.694 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:55.694 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T14:26:55.694 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T14:26:55.694 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T14:26:55.694 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T14:26:55.694 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:56.483 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:56.483 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:56.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-nbd 2024-05-15T14:26:56.868 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:56.868 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:56.868 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:56.868 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:56.868 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:56.868 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:57.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-nbd 2024-05-15T14:26:57.300 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:02:02 ago on Wed 15 May 2024 02:24:55 PM UTC. 2024-05-15T14:26:57.423 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-15T14:26:57.423 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 171 k 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 171 k 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 494 k 2024-05-15T14:26:57.424 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-15T14:26:57.653 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-nbd-19.0.0-3680.gbf560a26.el9.x86_64.rpm 750 kB/s | 171 kB 00:00 2024-05-15T14:26:57.653 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:57.653 INFO:teuthology.orchestra.run.smithi070.stdout:Total 746 kB/s | 171 kB 00:00 2024-05-15T14:26:57.653 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-15T14:26:57.661 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-15T14:26:57.661 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-15T14:26:57.700 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:02:01 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:26:57.724 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-15T14:26:57.724 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-15T14:26:57.828 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.0.0-3680.gbf560a26.el9 ceph 171 k 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 171 k 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 494 k 2024-05-15T14:26:57.829 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:26:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-15T14:26:57.984 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:58.306 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-nbd-19.0.0-3680.gbf560a26.el9.x86_64.rpm 359 kB/s | 171 kB 00:00 2024-05-15T14:26:58.307 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:26:58.307 INFO:teuthology.orchestra.run.smithi018.stdout:Total 358 kB/s | 171 kB 00:00 2024-05-15T14:26:58.307 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:26:58.316 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:26:58.316 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:26:58.363 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:58.385 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:26:58.385 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:26:58.541 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:26:58.632 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:58.640 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:58.640 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:58.640 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-15T14:26:58.640 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:58.640 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:26:58.640 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-15T14:26:58.862 DEBUG:teuthology.parallel:result is None 2024-05-15T14:26:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.0.0-3680.gbf560a26.el9.x86_64 1/1 2024-05-15T14:26:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:59.435 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:26:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.0.0-3680.gbf560a26.el9.x86_64 2024-05-15T14:26:59.435 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:26:59.435 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:26:59.652 DEBUG:teuthology.parallel:result is None 2024-05-15T14:26:59.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf560a26040628fcc6ec3e608f9c4451acdef5e2 2024-05-15T14:26:59.872 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T14:26:59.893 INFO:teuthology.orchestra.run.smithi018.stdout:19.0.0-3680.gbf560a26.el9 2024-05-15T14:26:59.894 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3680.gbf560a26.el9 2024-05-15T14:26:59.894 INFO:teuthology.task.install:The correct ceph version 19.0.0-3680.gbf560a26 is installed. 2024-05-15T14:26:59.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf560a26040628fcc6ec3e608f9c4451acdef5e2 2024-05-15T14:27:00.037 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T14:27:00.060 INFO:teuthology.orchestra.run.smithi070.stdout:19.0.0-3680.gbf560a26.el9 2024-05-15T14:27:00.060 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3680.gbf560a26.el9 2024-05-15T14:27:00.060 INFO:teuthology.task.install:The correct ceph version 19.0.0-3680.gbf560a26 is installed. 2024-05-15T14:27:00.062 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-15T14:27:00.062 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:00.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T14:27:00.089 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:00.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T14:27:00.128 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-15T14:27:00.128 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:00.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T14:27:00.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T14:27:00.220 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:00.220 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T14:27:00.246 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T14:27:00.311 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-15T14:27:00.312 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:00.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T14:27:00.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T14:27:00.412 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:00.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T14:27:00.437 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T14:27:00.503 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-15T14:27:00.503 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:00.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T14:27:00.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T14:27:00.595 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:00.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T14:27:00.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T14:27:00.686 INFO:teuthology.run_tasks:Running task ceph... 2024-05-15T14:27:00.774 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-15T14:27:00.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-05-15T14:27:00.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-05-15T14:27:00.801 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-15T14:27:00.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T14:27:00.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T14:27:00.867 INFO:tasks.ceph:Creating extra log directories... 2024-05-15T14:27:00.868 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T14:27:00.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T14:27:00.944 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-15T14:27:00.944 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-15T14:27:00.944 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131', 'branch': 'wip-cbodley-testing', 'description': 'rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/others/{0-install supported-distros/{centos_latest} test_others}}', 'email': None, 'first_in_suite': False, 'job_id': '7707131', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cbodley-testing'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2'}}, 'rgw': {'frontend': 'beast', 'realm': 'MyRealm', 'storage classes': 'LUKEWARM, FROZEN', 'zone': 'MyZone', 'zonegroup': 'MyZoneGroup'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley-testing', 'sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 533, 'sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bf560a26040628fcc6ec3e608f9c4451acdef5e2', 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIGOiAIRywfNHhWu0feBiCiJEU5I0oNDSPwZrcxt0GCoF9sa5bTlzG/6k1J/bg/hpQ3oKsM7gIQcq25EBhpzxk=', 'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOK62w/SYOggCcBf7HbhO/NdjNBJKXIwv9zvxVfBaFvjYxJZ5I6pD8oBMjxGTnJpeZUfg85b/RCzg3ws4lUg4zU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None, 'client.1': None}}, {'notification-tests': {'client.0': {'rgw_server': 'client.0'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-15_14:09:14', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-15T14:27:00.944 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T14:27:00.976 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T14:27:00.991 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T14:27:01.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T14:27:01.057 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:01.058 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-05-15T14:27:01.114 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-15T14:27:01.114 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-05-15T14:27:01.170 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-15T14:27:01.170 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T14:27:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-15T14:27:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T14:27:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T14:27:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-05-15 14:26:55.945603331 +0000 2024-05-15T14:27:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-05-15 14:23:52.850517236 +0000 2024-05-15T14:27:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-05-15 14:23:52.850517236 +0000 2024-05-15T14:27:01.171 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-05-15 14:23:52.850517236 +0000 2024-05-15T14:27:01.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-15T14:27:01.234 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-05-15T14:27:01.235 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-05-15T14:27:01.235 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 8.5414e-05 s, 6.0 MB/s 2024-05-15T14:27:01.236 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-15T14:27:01.292 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-05-15T14:27:01.348 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-15T14:27:01.348 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T14:27:01.348 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-15T14:27:01.348 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T14:27:01.349 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T14:27:01.349 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-05-15 14:26:55.946603319 +0000 2024-05-15T14:27:01.349 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-05-15 14:23:53.194513222 +0000 2024-05-15T14:27:01.349 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-05-15 14:23:53.194513222 +0000 2024-05-15T14:27:01.349 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-05-15 14:23:53.194513222 +0000 2024-05-15T14:27:01.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-15T14:27:01.413 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-05-15T14:27:01.413 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-05-15T14:27:01.413 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000103105 s, 5.0 MB/s 2024-05-15T14:27:01.414 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-15T14:27:01.471 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-05-15T14:27:01.527 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-15T14:27:01.528 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T14:27:01.528 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-15T14:27:01.528 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T14:27:01.528 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T14:27:01.528 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-05-15 14:26:55.946603319 +0000 2024-05-15T14:27:01.528 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-05-15 14:23:53.526509348 +0000 2024-05-15T14:27:01.528 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-05-15 14:23:53.526509348 +0000 2024-05-15T14:27:01.528 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-05-15 14:23:53.526509348 +0000 2024-05-15T14:27:01.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-15T14:27:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-05-15T14:27:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-05-15T14:27:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 9.4583e-05 s, 5.4 MB/s 2024-05-15T14:27:01.593 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-15T14:27:01.650 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-05-15T14:27:01.706 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-15T14:27:01.706 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T14:27:01.706 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-15T14:27:01.706 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T14:27:01.707 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T14:27:01.707 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-05-15 14:26:55.947603308 +0000 2024-05-15T14:27:01.707 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-05-15 14:23:53.867505369 +0000 2024-05-15T14:27:01.707 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-05-15 14:23:53.867505369 +0000 2024-05-15T14:27:01.707 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-05-15 14:23:53.867505369 +0000 2024-05-15T14:27:01.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-15T14:27:01.770 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-05-15T14:27:01.770 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-05-15T14:27:01.770 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 9.8813e-05 s, 5.2 MB/s 2024-05-15T14:27:01.771 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-15T14:27:01.828 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:01.828 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:01.828 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-05-15T14:27:01.845 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-15T14:27:01.846 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-05-15T14:27:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-15T14:27:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T14:27:01.903 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-15T14:27:01.903 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T14:27:01.903 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T14:27:01.903 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-15 14:26:55.616372607 +0000 2024-05-15T14:27:01.903 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-15 14:23:45.654377455 +0000 2024-05-15T14:27:01.903 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-15 14:23:45.654377455 +0000 2024-05-15T14:27:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-15 14:23:45.654377455 +0000 2024-05-15T14:27:01.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-15T14:27:01.967 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-15T14:27:01.967 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-15T14:27:01.967 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000108529 s, 4.7 MB/s 2024-05-15T14:27:01.968 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-15T14:27:02.026 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-05-15T14:27:02.083 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-15T14:27:02.084 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T14:27:02.084 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-15T14:27:02.084 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T14:27:02.084 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T14:27:02.084 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-15 14:26:55.616372607 +0000 2024-05-15T14:27:02.084 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-15 14:23:45.975367788 +0000 2024-05-15T14:27:02.084 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-15 14:23:45.975367788 +0000 2024-05-15T14:27:02.084 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-15 14:23:45.975367788 +0000 2024-05-15T14:27:02.084 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-15T14:27:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-15T14:27:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-15T14:27:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000103222 s, 5.0 MB/s 2024-05-15T14:27:02.149 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-15T14:27:02.206 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-15 14:26:55.617372577 +0000 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-15 14:23:46.324357278 +0000 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-15 14:23:46.324357278 +0000 2024-05-15T14:27:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-15 14:23:46.324357278 +0000 2024-05-15T14:27:02.263 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-15T14:27:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-15T14:27:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-15T14:27:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000108874 s, 4.7 MB/s 2024-05-15T14:27:02.328 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-15T14:27:02.384 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-05-15T14:27:02.439 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-15T14:27:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T14:27:02.440 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-15T14:27:02.440 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T14:27:02.440 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T14:27:02.440 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-15 14:26:55.617372577 +0000 2024-05-15T14:27:02.440 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-15 14:23:46.651347431 +0000 2024-05-15T14:27:02.440 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-15 14:23:46.651347431 +0000 2024-05-15T14:27:02.440 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-15 14:23:46.651347431 +0000 2024-05-15T14:27:02.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-15T14:27:02.502 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-15T14:27:02.502 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-15T14:27:02.502 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.0986e-05 s, 6.3 MB/s 2024-05-15T14:27:02.503 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-15T14:27:02.560 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:02.560 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-15T14:27:02.560 INFO:tasks.ceph:Generating config... 2024-05-15T14:27:02.561 INFO:tasks.ceph:[client] debug rgw = 20 2024-05-15T14:27:02.561 INFO:tasks.ceph:[client] debug rgw lifecycle = 20 2024-05-15T14:27:02.561 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-05-15T14:27:02.561 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-05-15T14:27:02.561 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-05-15T14:27:02.561 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-05-15T14:27:02.562 INFO:tasks.ceph:[client] setgroup = ceph 2024-05-15T14:27:02.562 INFO:tasks.ceph:[client] setuser = ceph 2024-05-15T14:27:02.562 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-05-15T14:27:02.562 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-05-15T14:27:02.562 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-15T14:27:02.562 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-15T14:27:02.562 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-15T14:27:02.562 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-15T14:27:02.562 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-15T14:27:02.562 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-15T14:27:02.562 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-15T14:27:02.562 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-15T14:27:02.562 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-15T14:27:02.562 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-15T14:27:02.563 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-15T14:27:02.563 INFO:tasks.ceph:Setting up mon.a... 2024-05-15T14:27:02.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-15T14:27:02.625 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-05-15T14:27:02.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-15T14:27:02.676 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T14:27:02.701 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.c', '[v2:172.21.15.18:3301,v1:172.21.15.18:6790]'), ('mon.b', '172.21.15.70')] 2024-05-15T14:27:02.702 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.70', 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-05-15T14:27:02.703 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:02.703 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-15T14:27:02.758 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --addv c '[v2:172.21.15.18:3301,v1:172.21.15.18:6790]' --add b 172.21.15.70 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:02.846 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:27:02.846 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:27:02.846 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:02.846 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid 7b76a29b-9591-4fa3-8f6d-706a5bf01a89 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:fsid 7b76a29b-9591-4fa3-8f6d-706a5bf01a89 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-05-15T14:27:02.846527+0000 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-05-15T14:27:02.846527+0000 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.b 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0] mon.c 2024-05-15T14:27:02.847 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-15T14:27:02.848 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-15T14:27:02.864 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7b76a29b-9591-4fa3-8f6d-706a5bf01a89... 2024-05-15T14:27:02.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T14:27:02.906 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T14:27:02.948 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-05-15T14:27:02.948 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-05-15T14:27:02.948 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T14:27:02.948 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.949 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T14:27:02.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.70" 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: osd_max_pg_log_entries = 10 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: osd_min_pg_log_entries = 10 2024-05-15T14:27:02.951 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = 7b76a29b-9591-4fa3-8f6d-706a5bf01a89 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-05-15T14:27:02.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-05-15T14:27:02.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: bdev async discard = True 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: bdev enable discard = True 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore allocator = bitmap 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 1/20 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 1/20 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 4/10 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T14:27:02.954 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: osd shutdown pgref assert = True 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-05-15T14:27:02.955 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.956 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T14:27:02.957 INFO:teuthology.orchestra.run.smithi018.stdout: debug rgw = 20 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout: debug rgw lifecycle = 20 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout: debug rgw notification = 20 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt require ssl = False 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt s3 kms backend = testing 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout: setgroup = ceph 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout: setuser = ceph 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-05-15T14:27:02.958 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-05-15T14:27:02.959 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-05-15T14:27:02.960 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-05-15T14:27:02.961 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.70" 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: osd_max_pg_log_entries = 10 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: osd_min_pg_log_entries = 10 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 7b76a29b-9591-4fa3-8f6d-706a5bf01a89 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.962 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.963 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-05-15T14:27:02.964 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: osd shutdown pgref assert = True 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-05-15T14:27:02.965 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-05-15T14:27:02.966 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-05-15T14:27:02.966 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-05-15T14:27:02.966 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-05-15T14:27:02.966 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.966 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-05-15T14:27:02.966 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-15T14:27:02.966 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T14:27:02.967 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw = 20 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw lifecycle = 20 2024-05-15T14:27:02.968 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw notification = 20 2024-05-15T14:27:02.969 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt require ssl = False 2024-05-15T14:27:02.969 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt s3 kms backend = testing 2024-05-15T14:27:02.969 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-05-15T14:27:02.969 INFO:teuthology.orchestra.run.smithi070.stdout: setgroup = ceph 2024-05-15T14:27:02.969 INFO:teuthology.orchestra.run.smithi070.stdout: setuser = ceph 2024-05-15T14:27:02.969 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-05-15T14:27:02.969 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-05-15T14:27:02.969 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-05-15T14:27:02.970 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-15T14:27:02.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-15T14:27:03.067 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-15T14:27:03.067 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:03.067 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-15T14:27:03.082 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:03.082 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-15T14:27:03.138 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:27:03.138 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:03.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T14:27:03.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T14:27:03.213 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:03.213 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:03.270 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:27:03.270 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:03.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T14:27:03.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T14:27:03.305 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:03.305 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:03.360 INFO:tasks.ceph:Setting up mon nodes... 2024-05-15T14:27:03.361 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-15T14:27:03.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-15T14:27:03.413 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-15T14:27:03.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-15T14:27:03.488 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-15T14:27:03.490 INFO:tasks.ceph:Setting up mds nodes... 2024-05-15T14:27:03.490 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-15T14:27:03.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-15T14:27:03.533 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-15T14:27:03.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-15T14:27:03.587 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-15T14:27:03.599 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-15T14:27:03.599 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-15T14:27:03.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-15T14:27:03.625 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:03.625 INFO:tasks.ceph:role: osd.0 2024-05-15T14:27:03.626 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:27:03.626 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-15T14:27:03.691 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T14:27:03.692 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T14:27:03.724 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-05-15T14:27:03.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-05-15T14:27:03.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-15T14:27:03.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-15T14:27:03.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-15T14:27:03.928 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:03.928 INFO:tasks.ceph:role: osd.1 2024-05-15T14:27:03.928 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:27:03.928 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-15T14:27:03.994 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T14:27:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T14:27:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T14:27:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T14:27:03.994 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T14:27:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-05-15T14:27:03.994 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T14:27:03.995 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T14:27:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T14:27:03.995 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T14:27:04.027 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-05-15T14:27:04.028 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-05-15T14:27:04.029 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-15T14:27:04.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-15T14:27:04.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-15T14:27:04.233 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:04.233 INFO:tasks.ceph:role: osd.2 2024-05-15T14:27:04.233 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:27:04.233 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T14:27:04.299 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T14:27:04.332 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-05-15T14:27:04.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-05-15T14:27:04.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-15T14:27:04.404 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-15T14:27:04.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-15T14:27:04.542 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:04.542 INFO:tasks.ceph:role: osd.3 2024-05-15T14:27:04.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:27:04.542 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-15T14:27:04.607 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T14:27:04.607 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T14:27:04.607 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T14:27:04.607 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T14:27:04.607 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T14:27:04.608 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-05-15T14:27:04.608 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T14:27:04.608 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T14:27:04.608 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T14:27:04.608 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T14:27:04.639 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-05-15T14:27:04.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-05-15T14:27:04.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-15T14:27:04.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-15T14:27:04.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:04.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:04.879+0000 7fdd18f8e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-15T14:27:04.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:04.879+0000 7fdd18f8e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-15T14:27:04.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:04.879+0000 7fdd18f8e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T14:27:04.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:04.879+0000 7fdd18f8e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T14:27:04.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:04.879+0000 7fdd18f8e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T14:27:04.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:04.880+0000 7fdd18f8e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-15T14:27:07.731 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-15T14:27:07.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:07.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:07.854+0000 7f4677013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-15T14:27:07.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:07.854+0000 7f4677013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-15T14:27:07.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:07.854+0000 7f4677013640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T14:27:07.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:07.854+0000 7f4677013640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T14:27:07.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:07.854+0000 7f4677013640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T14:27:07.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:07.855+0000 7f4677013640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-15T14:27:10.705 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-15T14:27:10.735 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:10.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:10.827+0000 7fde2ad31640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-15T14:27:10.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:10.827+0000 7fde2ad31640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-15T14:27:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:10.827+0000 7fde2ad31640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T14:27:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:10.827+0000 7fde2ad31640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T14:27:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:10.827+0000 7fde2ad31640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T14:27:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:10.827+0000 7fde2ad31640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-15T14:27:13.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-15T14:27:13.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:13.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:13.799+0000 7f6607063640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-15T14:27:13.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:13.800+0000 7f6607063640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-15T14:27:13.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:13.800+0000 7f6607063640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T14:27:13.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:13.800+0000 7f6607063640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T14:27:13.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:13.800+0000 7f6607063640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T14:27:13.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:13.800+0000 7f6607063640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-15T14:27:16.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-15T14:27:16.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-15T14:27:16.706 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:16.706 INFO:tasks.ceph:role: osd.4 2024-05-15T14:27:16.706 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:27:16.706 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-15T14:27:16.774 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T14:27:16.774 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T14:27:16.775 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T14:27:16.775 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T14:27:16.775 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T14:27:16.775 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-15T14:27:16.775 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T14:27:16.775 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T14:27:16.775 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T14:27:16.775 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T14:27:16.807 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-15T14:27:16.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-15T14:27:16.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-15T14:27:16.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-15T14:27:16.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-15T14:27:17.015 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:17.015 INFO:tasks.ceph:role: osd.5 2024-05-15T14:27:17.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:27:17.016 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-15T14:27:17.080 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T14:27:17.080 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T14:27:17.080 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T14:27:17.080 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T14:27:17.081 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T14:27:17.081 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-15T14:27:17.081 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T14:27:17.081 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T14:27:17.081 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T14:27:17.081 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T14:27:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-15T14:27:17.115 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-15T14:27:17.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-15T14:27:17.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-15T14:27:17.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-15T14:27:17.318 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:17.318 INFO:tasks.ceph:role: osd.6 2024-05-15T14:27:17.318 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:27:17.318 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-15T14:27:17.383 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T14:27:17.383 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T14:27:17.383 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T14:27:17.383 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T14:27:17.383 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T14:27:17.384 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-15T14:27:17.384 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T14:27:17.384 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T14:27:17.384 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T14:27:17.384 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T14:27:17.415 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-15T14:27:17.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-15T14:27:17.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-15T14:27:17.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-15T14:27:17.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-15T14:27:17.628 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T14:27:17.629 INFO:tasks.ceph:role: osd.7 2024-05-15T14:27:17.629 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:27:17.629 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-15T14:27:17.692 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T14:27:17.693 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T14:27:17.724 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-15T14:27:17.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-15T14:27:17.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-15T14:27:17.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-15T14:27:17.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:17.981+0000 7f2485980640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-15T14:27:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:17.981+0000 7f2485980640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-15T14:27:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:17.981+0000 7f2485980640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T14:27:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:17.981+0000 7f2485980640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T14:27:17.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:17.981+0000 7f2485980640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T14:27:17.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:17.982+0000 7f2485980640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-15T14:27:20.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-15T14:27:20.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:20.947+0000 7f9c21b13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-15T14:27:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:20.947+0000 7f9c21b13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-15T14:27:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:20.947+0000 7f9c21b13640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T14:27:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:20.947+0000 7f9c21b13640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T14:27:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:20.947+0000 7f9c21b13640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T14:27:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:20.948+0000 7f9c21b13640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-15T14:27:23.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-15T14:27:23.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:23.911+0000 7f13d5033640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-15T14:27:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:23.911+0000 7f13d5033640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-15T14:27:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:23.911+0000 7f13d5033640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T14:27:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:23.911+0000 7f13d5033640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T14:27:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:23.911+0000 7f13d5033640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T14:27:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:23.911+0000 7f13d5033640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-15T14:27:26.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-15T14:27:26.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:26.875+0000 7f9d5b043640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-15T14:27:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:26.875+0000 7f9d5b043640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-15T14:27:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:26.875+0000 7f9d5b043640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T14:27:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:26.875+0000 7f9d5b043640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T14:27:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:26.875+0000 7f9d5b043640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T14:27:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:27:26.875+0000 7f9d5b043640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-15T14:27:29.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-15T14:27:29.749 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-15T14:27:29.750 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:29.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-15T14:27:29.782 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:29.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-15T14:27:29.852 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:29.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-15T14:27:29.922 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:29.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-15T14:27:29.990 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:29.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-15T14:27:30.059 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:30.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-15T14:27:30.091 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:30.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-15T14:27:30.159 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:30.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-15T14:27:30.227 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:30.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-15T14:27:30.294 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:30.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-15T14:27:30.361 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:30.361 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-15T14:27:30.381 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:30.381 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-15T14:27:30.418 INFO:tasks.ceph:Adding keys to all mons... 2024-05-15T14:27:30.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-15T14:27:30.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.y] 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA3xkRmL3CsGBAAh64pshjVJo9I5zp6lUhHMg== 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA4xkRmu6h7NBAAhSoDOs/RsabgE02wkawy+g== 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA7xkRmATP8MhAAW8ptMx0YfIaFNqpR/+v+GA== 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA+xkRmKzNdMRAAjBxZqPxbue0SC9++VgKzzw== 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-05-15T14:27:30.462 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBBxkRm+Vu7LxAA/yvGlxcbjAk1ZEWmS81Q0g== 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA3xkRm8McYHRAAdFE/b7nwfb3jnZBf8qo1KQ== 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBFxkRmc7WdOhAAd5q8QvtvucEbLHSgK2o52Q== 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBIxkRmjZiFOBAASdMeVc0H9Mh5kfQzfJmLlQ== 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.6] 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBLxkRmGTtZNhAACjs5YvxF8s9SYH+LkvkBxQ== 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.7] 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBOxkRmp/83NBAAO9MF1PnBLhAFOaA3gOQB3Q== 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA3xkRm8KPLHxAAsGNz93Xra/jsjKALpBl/1w== 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2024-05-15T14:27:30.463 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA3xkRmenICIxAAL3U9v5LwXH1/T+5eamWW9A== 2024-05-15T14:27:30.482 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA3xkRmL3CsGBAAh64pshjVJo9I5zp6lUhHMg== 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA4xkRmu6h7NBAAhSoDOs/RsabgE02wkawy+g== 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA7xkRmATP8MhAAW8ptMx0YfIaFNqpR/+v+GA== 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA+xkRmKzNdMRAAjBxZqPxbue0SC9++VgKzzw== 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBBxkRm+Vu7LxAA/yvGlxcbjAk1ZEWmS81Q0g== 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA3xkRm8McYHRAAdFE/b7nwfb3jnZBf8qo1KQ== 2024-05-15T14:27:30.483 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBFxkRmc7WdOhAAd5q8QvtvucEbLHSgK2o52Q== 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBIxkRmjZiFOBAASdMeVc0H9Mh5kfQzfJmLlQ== 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBLxkRmGTtZNhAACjs5YvxF8s9SYH+LkvkBxQ== 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBOxkRmp/83NBAAO9MF1PnBLhAFOaA3gOQB3Q== 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA3xkRm8KPLHxAAsGNz93Xra/jsjKALpBl/1w== 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout:[client.1] 2024-05-15T14:27:30.484 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA3xkRmenICIxAAL3U9v5LwXH1/T+5eamWW9A== 2024-05-15T14:27:30.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T14:27:30.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T14:27:30.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.580 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.632 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.792 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T14:27:30.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T14:27:30.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:30.953 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:31.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:31.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T14:27:31.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T14:27:31.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T14:27:31.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T14:27:31.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T14:27:31.168 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-15T14:27:31.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-15T14:27:31.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T14:27:31.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-15T14:27:31.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-15T14:27:31.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T14:27:31.479 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-15T14:27:31.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-15T14:27:31.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T14:27:31.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-15T14:27:31.651 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:31.653 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-15T14:27:31.707 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-15T14:27:31.707 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-15T14:27:31.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-15T14:27:31.709 INFO:tasks.ceph.mon.a:Started 2024-05-15T14:27:31.709 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-15T14:27:31.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-15T14:27:31.711 INFO:tasks.ceph.mon.c:Started 2024-05-15T14:27:31.712 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-15T14:27:31.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-15T14:27:31.748 INFO:tasks.ceph.mon.b:Started 2024-05-15T14:27:31.749 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-15T14:27:31.749 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-15T14:27:31.749 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-15T14:27:31.751 INFO:tasks.ceph.mgr.y:Started 2024-05-15T14:27:31.751 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-15T14:27:31.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-15T14:27:31.753 INFO:tasks.ceph.mgr.x:Started 2024-05-15T14:27:31.753 INFO:tasks.ceph:Setting crush tunables to default 2024-05-15T14:27:31.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-05-15T14:27:32.095 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-05-15T14:27:32.106 INFO:tasks.ceph:check_enable_crimson: False 2024-05-15T14:27:32.107 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-15T14:27:32.107 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:32.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-15T14:27:32.123 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:32.123+0000 7fd5ec20d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-15T14:27:32.130 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:32.130+0000 7fa491cf8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-15T14:27:32.132 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:32.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-15T14:27:32.198 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:32.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-15T14:27:32.264 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:27:32.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-15T14:27:32.290 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:32.289+0000 7fd5ec20d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-15T14:27:32.300 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:32.299+0000 7fa491cf8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-15T14:27:32.325 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:32.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-15T14:27:32.343 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:32.343+0000 7fd5ec20d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-15T14:27:32.350 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:32.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-15T14:27:32.358 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:32.357+0000 7fa491cf8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-15T14:27:32.415 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:32.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-15T14:27:32.479 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-15T14:27:32.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-15T14:27:32.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 82e38010-356d-4bc4-871a-0f2e1432fb95 0 2024-05-15T14:27:32.603 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:32.602+0000 7fd5ec20d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-15T14:27:32.630 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:32.630+0000 7fa491cf8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-15T14:27:32.651 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:32.650+0000 7fd5ec20d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-15T14:27:32.678 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:32.678+0000 7fa491cf8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-15T14:27:32.766 INFO:teuthology.orchestra.run.smithi070.stdout:0 2024-05-15T14:27:32.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new be1a5e4f-4dfe-4cea-81ec-524c172fffcf 1 2024-05-15T14:27:32.998 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-05-15T14:27:33.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new ebd5f9e3-29f1-40f3-9f58-1479a1b8ed3a 2 2024-05-15T14:27:33.192 INFO:teuthology.orchestra.run.smithi070.stdout:2 2024-05-15T14:27:33.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 84736067-d077-46fe-9fac-c403119aa108 3 2024-05-15T14:27:33.387 INFO:teuthology.orchestra.run.smithi070.stdout:3 2024-05-15T14:27:33.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 650f8100-a2ce-4713-af49-30d0ecc6a42b 4 2024-05-15T14:27:33.450 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:33.450+0000 7fa491cf8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-15T14:27:33.452 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:33.452+0000 7fd5ec20d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-15T14:27:33.544 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:33.543+0000 7fd5ec20d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-15T14:27:33.544 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:33.543+0000 7fa491cf8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-15T14:27:33.580 INFO:teuthology.orchestra.run.smithi070.stdout:4 2024-05-15T14:27:33.587 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:33.586+0000 7fd5ec20d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-15T14:27:33.590 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:33.589+0000 7fa491cf8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-15T14:27:33.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new b2868c5e-de69-43ce-a5f9-e72d9dcb1bd6 5 2024-05-15T14:27:33.764 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:33.764+0000 7fa491cf8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-15T14:27:33.778 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:33.777+0000 7fd5ec20d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-15T14:27:33.792 INFO:teuthology.orchestra.run.smithi070.stdout:5 2024-05-15T14:27:33.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new e813ec9c-769d-47bc-8dc9-12742bcb42df 6 2024-05-15T14:27:33.815 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:33.814+0000 7fa491cf8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-15T14:27:33.839 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:33.838+0000 7fd5ec20d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-15T14:27:33.872 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:33.870+0000 7fa491cf8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-15T14:27:33.894 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:33.894+0000 7fd5ec20d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-15T14:27:33.991 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:33.989+0000 7fa491cf8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-15T14:27:33.991 INFO:teuthology.orchestra.run.smithi070.stdout:6 2024-05-15T14:27:33.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new caefff72-54ba-4680-be60-861b292fab19 7 2024-05-15T14:27:34.014 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:34.013+0000 7fd5ec20d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-15T14:27:34.198 INFO:teuthology.orchestra.run.smithi070.stdout:7 2024-05-15T14:27:34.210 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-15T14:27:34.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-15T14:27:34.212 INFO:tasks.ceph.osd.0:Started 2024-05-15T14:27:34.212 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-15T14:27:34.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-15T14:27:34.214 INFO:tasks.ceph.osd.1:Started 2024-05-15T14:27:34.215 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-15T14:27:34.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-15T14:27:34.217 INFO:tasks.ceph.osd.2:Started 2024-05-15T14:27:34.217 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-15T14:27:34.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-15T14:27:34.219 INFO:tasks.ceph.osd.3:Started 2024-05-15T14:27:34.219 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-15T14:27:34.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-15T14:27:34.221 INFO:tasks.ceph.osd.4:Started 2024-05-15T14:27:34.222 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-15T14:27:34.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-15T14:27:34.224 INFO:tasks.ceph.osd.5:Started 2024-05-15T14:27:34.224 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-15T14:27:34.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-15T14:27:34.226 INFO:tasks.ceph.osd.6:Started 2024-05-15T14:27:34.226 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-15T14:27:34.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-15T14:27:34.228 INFO:tasks.ceph.osd.7:Started 2024-05-15T14:27:34.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T14:27:34.426 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:34.425+0000 7fd5ec20d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-15T14:27:34.431 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:34.431 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"fsid":"7b76a29b-9591-4fa3-8f6d-706a5bf01a89","created":"2024-05-15T14:27:32.006075+0000","modified":"2024-05-15T14:27:34.196289+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T14:27:34.196289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"82e38010-356d-4bc4-871a-0f2e1432fb95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be1a5e4f-4dfe-4cea-81ec-524c172fffcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ebd5f9e3-29f1-40f3-9f58-1479a1b8ed3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"84736067-d077-46fe-9fac-c403119aa108","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"650f8100-a2ce-4713-af49-30d0ecc6a42b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b2868c5e-de69-43ce-a5f9-e72d9dcb1bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e813ec9c-769d-47bc-8dc9-12742bcb42df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"caefff72-54ba-4680-be60-861b292fab19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T14:27:34.432 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:34.432+0000 7fa491cf8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-15T14:27:34.443 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-15T14:27:34.443 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-15T14:27:34.565 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:34.564+0000 7fd5ec20d040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-15T14:27:34.579 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:34.579+0000 7fa491cf8040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-15T14:27:34.818 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-05-15T14:27:34.818+0000 7f124a411640 -1 Falling back to public interface 2024-05-15T14:27:34.821 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:34.820+0000 7fd5ec20d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-15T14:27:34.832 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-15T14:27:34.831+0000 7f859080f640 -1 Falling back to public interface 2024-05-15T14:27:34.832 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-15T14:27:34.831+0000 7f315fa1d640 -1 Falling back to public interface 2024-05-15T14:27:34.832 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-15T14:27:34.831+0000 7f315e420640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-05-15T14:27:34.833 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-15T14:27:34.831+0000 7f858f191640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2024-05-15T14:27:34.842 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-05-15T14:27:34.841+0000 7f10378d9640 -1 Falling back to public interface 2024-05-15T14:27:34.842 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-05-15T14:27:34.841+0000 7f782ce0e640 -1 Falling back to public interface 2024-05-15T14:27:34.843 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-05-15T14:27:34.842+0000 7f4434015640 -1 Falling back to public interface 2024-05-15T14:27:34.843 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-05-15T14:27:34.842+0000 7f3d2c718640 -1 Falling back to public interface 2024-05-15T14:27:34.846 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-05-15T14:27:34.845+0000 7fed9c3dc640 -1 Falling back to public interface 2024-05-15T14:27:34.856 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:34.856+0000 7fa491cf8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-15T14:27:34.877 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:34.876+0000 7fd5ec20d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-15T14:27:34.912 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:34.911+0000 7fa491cf8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-15T14:27:34.992 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:34.991+0000 7fd5ec20d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-15T14:27:35.035 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:35.034+0000 7fa491cf8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-15T14:27:35.249 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T14:27:35.284 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:35.284+0000 7fd5ec20d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-15T14:27:35.331 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:35.330+0000 7fd5ec20d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-15T14:27:35.341 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:35.341+0000 7fa491cf8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-15T14:27:35.395 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:35.394+0000 7fa491cf8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-15T14:27:35.418 INFO:teuthology.misc.health.smithi018.stdout: 2024-05-15T14:27:35.419 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":10,"fsid":"7b76a29b-9591-4fa3-8f6d-706a5bf01a89","created":"2024-05-15T14:27:32.006075+0000","modified":"2024-05-15T14:27:34.196289+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T14:27:34.196289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"82e38010-356d-4bc4-871a-0f2e1432fb95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be1a5e4f-4dfe-4cea-81ec-524c172fffcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ebd5f9e3-29f1-40f3-9f58-1479a1b8ed3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"84736067-d077-46fe-9fac-c403119aa108","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"650f8100-a2ce-4713-af49-30d0ecc6a42b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b2868c5e-de69-43ce-a5f9-e72d9dcb1bd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e813ec9c-769d-47bc-8dc9-12742bcb42df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"caefff72-54ba-4680-be60-861b292fab19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T14:27:35.428 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-15T14:27:35.488 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:35.487+0000 7fd5ec20d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-15T14:27:35.561 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:35.560+0000 7fa491cf8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-15T14:27:35.621 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:35.621+0000 7fd5ec20d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-15T14:27:35.672 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:35.672+0000 7fd5ec20d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-15T14:27:35.706 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:35.705+0000 7fa491cf8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-15T14:27:35.741 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:35.740+0000 7fd5ec20d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-15T14:27:35.758 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:35.757+0000 7fa491cf8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-15T14:27:35.786 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:35.785+0000 7fd5ec20d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-15T14:27:35.833 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:35.831+0000 7fa491cf8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-15T14:27:35.879 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:35.879+0000 7fa491cf8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-15T14:27:36.258 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:36.257+0000 7fd5ec20d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-15T14:27:36.371 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:36.371+0000 7fd5ec20d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-15T14:27:36.382 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:36.381+0000 7fa491cf8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-15T14:27:36.508 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-05-15T14:27:36.507+0000 7fa491cf8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-15T14:27:37.387 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:37.386+0000 7fd58ba8e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-15T14:27:37.387 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-15T14:27:37.387+0000 7fd58ba8e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-15T14:27:38.300 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-05-15T14:27:38.299+0000 7f124a411640 -1 osd.1 0 log_to_monitors true 2024-05-15T14:27:38.320 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-15T14:27:38.319+0000 7f315fa1d640 -1 osd.7 0 log_to_monitors true 2024-05-15T14:27:38.336 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-15T14:27:38.336+0000 7f859080f640 -1 osd.5 0 log_to_monitors true 2024-05-15T14:27:38.338 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-05-15T14:27:38.337+0000 7f10378d9640 -1 osd.6 0 log_to_monitors true 2024-05-15T14:27:38.340 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-05-15T14:27:38.339+0000 7f4434015640 -1 osd.4 0 log_to_monitors true 2024-05-15T14:27:38.357 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-05-15T14:27:38.356+0000 7f3d2c718640 -1 osd.2 0 log_to_monitors true 2024-05-15T14:27:38.361 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-05-15T14:27:38.361+0000 7fed9c3dc640 -1 osd.0 0 log_to_monitors true 2024-05-15T14:27:38.367 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-05-15T14:27:38.366+0000 7f782ce0e640 -1 osd.3 0 log_to_monitors true 2024-05-15T14:27:40.778 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-05-15T14:27:40.777+0000 7f103386f640 -1 osd.6 0 waiting for initial osdmap 2024-05-15T14:27:40.791 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-05-15T14:27:40.791+0000 7f102b68f640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T14:27:40.799 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-15T14:27:40.799+0000 7f858c178640 -1 osd.5 0 waiting for initial osdmap 2024-05-15T14:27:40.813 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-15T14:27:40.813+0000 7f315bc1b640 -1 osd.7 0 waiting for initial osdmap 2024-05-15T14:27:40.815 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-15T14:27:40.815+0000 7f8583f98640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T14:27:40.824 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-15T14:27:40.824+0000 7f3153238640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T14:27:40.828 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-05-15T14:27:40.828+0000 7f442f9c3640 -1 osd.4 0 waiting for initial osdmap 2024-05-15T14:27:40.840 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-05-15T14:27:40.840+0000 7f44277e3640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T14:27:40.874 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-05-15T14:27:40.874+0000 7f7828da4640 -1 osd.3 0 waiting for initial osdmap 2024-05-15T14:27:40.882 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-05-15T14:27:40.881+0000 7f3d286ae640 -1 osd.2 0 waiting for initial osdmap 2024-05-15T14:27:40.890 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-05-15T14:27:40.890+0000 7f7820bc4640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T14:27:40.893 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-05-15T14:27:40.892+0000 7fed98372640 -1 osd.0 0 waiting for initial osdmap 2024-05-15T14:27:40.894 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-05-15T14:27:40.894+0000 7f3d204ce640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T14:27:40.906 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-05-15T14:27:40.906+0000 7fed90192640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T14:27:40.912 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-05-15T14:27:40.912+0000 7f1246557640 -1 osd.1 0 waiting for initial osdmap 2024-05-15T14:27:40.925 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-05-15T14:27:40.925+0000 7f123db63640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T14:27:42.236 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T14:27:42.551 INFO:teuthology.misc.health.smithi018.stdout: 2024-05-15T14:27:42.551 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":13,"fsid":"7b76a29b-9591-4fa3-8f6d-706a5bf01a89","created":"2024-05-15T14:27:32.006075+0000","modified":"2024-05-15T14:27:41.780704+0000","last_up_change":"2024-05-15T14:27:41.780704+0000","last_in_change":"2024-05-15T14:27:34.196289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"82e38010-356d-4bc4-871a-0f2e1432fb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6825","nonce":3725803698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6827","nonce":3725803698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6831","nonce":3725803698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6829","nonce":3725803698}]},"public_addr":"172.21.15.18:6825/3725803698","cluster_addr":"172.21.15.18:6827/3725803698","heartbeat_back_addr":"172.21.15.18:6831/3725803698","heartbeat_front_addr":"172.21.15.18:6829/3725803698","state":["exists","up"]},{"osd":1,"uuid":"be1a5e4f-4dfe-4cea-81ec-524c172fffcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6801","nonce":3228695091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6803","nonce":3228695091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6807","nonce":3228695091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6805","nonce":3228695091}]},"public_addr":"172.21.15.18:6801/3228695091","cluster_addr":"172.21.15.18:6803/3228695091","heartbeat_back_addr":"172.21.15.18:6807/3228695091","heartbeat_front_addr":"172.21.15.18:6805/3228695091","state":["exists","up"]},{"osd":2,"uuid":"ebd5f9e3-29f1-40f3-9f58-1479a1b8ed3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6814","nonce":2500301093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6818","nonce":2500301093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6823","nonce":2500301093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6821","nonce":2500301093}]},"public_addr":"172.21.15.18:6814/2500301093","cluster_addr":"172.21.15.18:6818/2500301093","heartbeat_back_addr":"172.21.15.18:6823/2500301093","heartbeat_front_addr":"172.21.15.18:6821/2500301093","state":["exists","up"]},{"osd":3,"uuid":"84736067-d077-46fe-9fac-c403119aa108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6809","nonce":2567457164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6811","nonce":2567457164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6820","nonce":2567457164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6815","nonce":2567457164}]},"public_addr":"172.21.15.18:6809/2567457164","cluster_addr":"172.21.15.18:6811/2567457164","heartbeat_back_addr":"172.21.15.18:6820/2567457164","heartbeat_front_addr":"172.21.15.18:6815/2567457164","state":["exists","up"]},{"osd":4,"uuid":"650f8100-a2ce-4713-af49-30d0ecc6a42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6822","nonce":4115055233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6826","nonce":4115055233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6831","nonce":4115055233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6829","nonce":4115055233}]},"public_addr":"172.21.15.70:6822/4115055233","cluster_addr":"172.21.15.70:6826/4115055233","heartbeat_back_addr":"172.21.15.70:6831/4115055233","heartbeat_front_addr":"172.21.15.70:6829/4115055233","state":["exists","up"]},{"osd":5,"uuid":"b2868c5e-de69-43ce-a5f9-e72d9dcb1bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6803","nonce":2586885345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6808","nonce":2586885345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6815","nonce":2586885345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6813","nonce":2586885345}]},"public_addr":"172.21.15.70:6803/2586885345","cluster_addr":"172.21.15.70:6808/2586885345","heartbeat_back_addr":"172.21.15.70:6815/2586885345","heartbeat_front_addr":"172.21.15.70:6813/2586885345","state":["exists","up"]},{"osd":6,"uuid":"e813ec9c-769d-47bc-8dc9-12742bcb42df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6817","nonce":1716851624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6819","nonce":1716851624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6827","nonce":1716851624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6823","nonce":1716851624}]},"public_addr":"172.21.15.70:6817/1716851624","cluster_addr":"172.21.15.70:6819/1716851624","heartbeat_back_addr":"172.21.15.70:6827/1716851624","heartbeat_front_addr":"172.21.15.70:6823/1716851624","state":["exists","up"]},{"osd":7,"uuid":"caefff72-54ba-4680-be60-861b292fab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6801","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6802","nonce":2407810716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6805","nonce":2407810716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6812","nonce":2407810716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6809","nonce":2407810716}]},"public_addr":"172.21.15.70:6802/2407810716","cluster_addr":"172.21.15.70:6805/2407810716","heartbeat_back_addr":"172.21.15.70:6812/2407810716","heartbeat_front_addr":"172.21.15.70:6809/2407810716","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T14:27:42.563 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-15T14:27:42.563 INFO:tasks.ceph:Creating RBD pool 2024-05-15T14:27:42.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-15T14:27:43.795 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'rbd' created 2024-05-15T14:27:43.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-15T14:27:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-15T14:27:44.822 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-15T14:27:44.822 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-15T14:27:44.822 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-15T14:27:44.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-15T14:27:44.823 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-15T14:27:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:45.197 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":453764289},{"type":"v1","addr":"172.21.15.70:6833","nonce":453764289}]},"active_addr":"172.21.15.70:6833/453764289","active_change":"2024-05-15T14:27:36.374136+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3945388357}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2511037604}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2351491242}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1549544320}]}]} 2024-05-15T14:27:45.204 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-15T14:27:45.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-15T14:27:45.204 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T14:27:45.517 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:45.517 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":16,"fsid":"7b76a29b-9591-4fa3-8f6d-706a5bf01a89","created":"2024-05-15T14:27:32.006075+0000","modified":"2024-05-15T14:27:44.800473+0000","last_up_change":"2024-05-15T14:27:41.780704+0000","last_in_change":"2024-05-15T14:27:34.196289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T14:27:42.397255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-15T14:27:42.873261+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"82e38010-356d-4bc4-871a-0f2e1432fb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6825","nonce":3725803698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6827","nonce":3725803698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6831","nonce":3725803698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6829","nonce":3725803698}]},"public_addr":"172.21.15.18:6825/3725803698","cluster_addr":"172.21.15.18:6827/3725803698","heartbeat_back_addr":"172.21.15.18:6831/3725803698","heartbeat_front_addr":"172.21.15.18:6829/3725803698","state":["exists","up"]},{"osd":1,"uuid":"be1a5e4f-4dfe-4cea-81ec-524c172fffcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6801","nonce":3228695091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6803","nonce":3228695091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6807","nonce":3228695091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6805","nonce":3228695091}]},"public_addr":"172.21.15.18:6801/3228695091","cluster_addr":"172.21.15.18:6803/3228695091","heartbeat_back_addr":"172.21.15.18:6807/3228695091","heartbeat_front_addr":"172.21.15.18:6805/3228695091","state":["exists","up"]},{"osd":2,"uuid":"ebd5f9e3-29f1-40f3-9f58-1479a1b8ed3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6814","nonce":2500301093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6818","nonce":2500301093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6823","nonce":2500301093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6821","nonce":2500301093}]},"public_addr":"172.21.15.18:6814/2500301093","cluster_addr":"172.21.15.18:6818/2500301093","heartbeat_back_addr":"172.21.15.18:6823/2500301093","heartbeat_front_addr":"172.21.15.18:6821/2500301093","state":["exists","up"]},{"osd":3,"uuid":"84736067-d077-46fe-9fac-c403119aa108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6809","nonce":2567457164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6811","nonce":2567457164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6820","nonce":2567457164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6815","nonce":2567457164}]},"public_addr":"172.21.15.18:6809/2567457164","cluster_addr":"172.21.15.18:6811/2567457164","heartbeat_back_addr":"172.21.15.18:6820/2567457164","heartbeat_front_addr":"172.21.15.18:6815/2567457164","state":["exists","up"]},{"osd":4,"uuid":"650f8100-a2ce-4713-af49-30d0ecc6a42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6822","nonce":4115055233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6826","nonce":4115055233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6831","nonce":4115055233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6829","nonce":4115055233}]},"public_addr":"172.21.15.70:6822/4115055233","cluster_addr":"172.21.15.70:6826/4115055233","heartbeat_back_addr":"172.21.15.70:6831/4115055233","heartbeat_front_addr":"172.21.15.70:6829/4115055233","state":["exists","up"]},{"osd":5,"uuid":"b2868c5e-de69-43ce-a5f9-e72d9dcb1bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6803","nonce":2586885345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6808","nonce":2586885345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6815","nonce":2586885345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6813","nonce":2586885345}]},"public_addr":"172.21.15.70:6803/2586885345","cluster_addr":"172.21.15.70:6808/2586885345","heartbeat_back_addr":"172.21.15.70:6815/2586885345","heartbeat_front_addr":"172.21.15.70:6813/2586885345","state":["exists","up"]},{"osd":6,"uuid":"e813ec9c-769d-47bc-8dc9-12742bcb42df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6817","nonce":1716851624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6819","nonce":1716851624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6827","nonce":1716851624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6823","nonce":1716851624}]},"public_addr":"172.21.15.70:6817/1716851624","cluster_addr":"172.21.15.70:6819/1716851624","heartbeat_back_addr":"172.21.15.70:6827/1716851624","heartbeat_front_addr":"172.21.15.70:6823/1716851624","state":["exists","up"]},{"osd":7,"uuid":"caefff72-54ba-4680-be60-861b292fab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6801","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6802","nonce":2407810716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6805","nonce":2407810716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6812","nonce":2407810716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6809","nonce":2407810716}]},"public_addr":"172.21.15.70:6802/2407810716","cluster_addr":"172.21.15.70:6805/2407810716","heartbeat_back_addr":"172.21.15.70:6812/2407810716","heartbeat_front_addr":"172.21.15.70:6809/2407810716","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.333113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.345670+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.340644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.327808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.304551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.342242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.332781+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.307236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T14:27:45.530 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-15T14:27:45.531 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T14:27:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:45.842 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"fsid":"7b76a29b-9591-4fa3-8f6d-706a5bf01a89","created":"2024-05-15T14:27:32.006075+0000","modified":"2024-05-15T14:27:45.806090+0000","last_up_change":"2024-05-15T14:27:41.780704+0000","last_in_change":"2024-05-15T14:27:34.196289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T14:27:42.397255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-15T14:27:42.873261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"82e38010-356d-4bc4-871a-0f2e1432fb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6825","nonce":3725803698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6827","nonce":3725803698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6831","nonce":3725803698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6829","nonce":3725803698}]},"public_addr":"172.21.15.18:6825/3725803698","cluster_addr":"172.21.15.18:6827/3725803698","heartbeat_back_addr":"172.21.15.18:6831/3725803698","heartbeat_front_addr":"172.21.15.18:6829/3725803698","state":["exists","up"]},{"osd":1,"uuid":"be1a5e4f-4dfe-4cea-81ec-524c172fffcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6801","nonce":3228695091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6803","nonce":3228695091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6807","nonce":3228695091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6805","nonce":3228695091}]},"public_addr":"172.21.15.18:6801/3228695091","cluster_addr":"172.21.15.18:6803/3228695091","heartbeat_back_addr":"172.21.15.18:6807/3228695091","heartbeat_front_addr":"172.21.15.18:6805/3228695091","state":["exists","up"]},{"osd":2,"uuid":"ebd5f9e3-29f1-40f3-9f58-1479a1b8ed3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6814","nonce":2500301093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6818","nonce":2500301093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6823","nonce":2500301093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6821","nonce":2500301093}]},"public_addr":"172.21.15.18:6814/2500301093","cluster_addr":"172.21.15.18:6818/2500301093","heartbeat_back_addr":"172.21.15.18:6823/2500301093","heartbeat_front_addr":"172.21.15.18:6821/2500301093","state":["exists","up"]},{"osd":3,"uuid":"84736067-d077-46fe-9fac-c403119aa108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6809","nonce":2567457164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6811","nonce":2567457164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6820","nonce":2567457164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6815","nonce":2567457164}]},"public_addr":"172.21.15.18:6809/2567457164","cluster_addr":"172.21.15.18:6811/2567457164","heartbeat_back_addr":"172.21.15.18:6820/2567457164","heartbeat_front_addr":"172.21.15.18:6815/2567457164","state":["exists","up"]},{"osd":4,"uuid":"650f8100-a2ce-4713-af49-30d0ecc6a42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6822","nonce":4115055233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6826","nonce":4115055233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6831","nonce":4115055233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6829","nonce":4115055233}]},"public_addr":"172.21.15.70:6822/4115055233","cluster_addr":"172.21.15.70:6826/4115055233","heartbeat_back_addr":"172.21.15.70:6831/4115055233","heartbeat_front_addr":"172.21.15.70:6829/4115055233","state":["exists","up"]},{"osd":5,"uuid":"b2868c5e-de69-43ce-a5f9-e72d9dcb1bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6803","nonce":2586885345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6808","nonce":2586885345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6815","nonce":2586885345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6813","nonce":2586885345}]},"public_addr":"172.21.15.70:6803/2586885345","cluster_addr":"172.21.15.70:6808/2586885345","heartbeat_back_addr":"172.21.15.70:6815/2586885345","heartbeat_front_addr":"172.21.15.70:6813/2586885345","state":["exists","up"]},{"osd":6,"uuid":"e813ec9c-769d-47bc-8dc9-12742bcb42df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6817","nonce":1716851624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6819","nonce":1716851624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6827","nonce":1716851624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6823","nonce":1716851624}]},"public_addr":"172.21.15.70:6817/1716851624","cluster_addr":"172.21.15.70:6819/1716851624","heartbeat_back_addr":"172.21.15.70:6827/1716851624","heartbeat_front_addr":"172.21.15.70:6823/1716851624","state":["exists","up"]},{"osd":7,"uuid":"caefff72-54ba-4680-be60-861b292fab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6801","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6802","nonce":2407810716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6805","nonce":2407810716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6812","nonce":2407810716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6809","nonce":2407810716}]},"public_addr":"172.21.15.70:6802/2407810716","cluster_addr":"172.21.15.70:6805/2407810716","heartbeat_back_addr":"172.21.15.70:6812/2407810716","heartbeat_front_addr":"172.21.15.70:6809/2407810716","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.333113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.345670+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.340644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.327808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.304551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.342242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.332781+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.307236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T14:27:45.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-15T14:27:45.856 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-15T14:27:45.856 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-15T14:27:45.856 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-15T14:27:45.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-15T14:27:45.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-15T14:27:45.858 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-15T14:27:45.858 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-15T14:27:46.114 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:46.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T14:27:46.120 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:46.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T14:27:46.122 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:46.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-15T14:27:46.123 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-05-15T14:27:46.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-15T14:27:46.124 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-05-15T14:27:46.124 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:46.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-15T14:27:46.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-15T14:27:46.126 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:46.127 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T14:27:46.128 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-05-15T14:27:46.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-15T14:27:46.721 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-05-15T14:27:46.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2024-05-15T14:27:46.752 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-05-15T14:27:46.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2024-05-15T14:27:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-05-15T14:27:46.785 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-05-15T14:27:46.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2024-05-15T14:27:46.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2024-05-15T14:27:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-05-15T14:27:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-05-15T14:27:46.836 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-05-15T14:27:46.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.7 2024-05-15T14:27:46.845 DEBUG:teuthology.parallel:result is None 2024-05-15T14:27:46.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.6 2024-05-15T14:27:46.845 DEBUG:teuthology.parallel:result is None 2024-05-15T14:27:46.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.5 2024-05-15T14:27:46.847 DEBUG:teuthology.parallel:result is None 2024-05-15T14:27:46.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-05-15T14:27:46.851 DEBUG:teuthology.parallel:result is None 2024-05-15T14:27:47.743 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T14:27:47.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T14:27:47.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T14:27:47.802 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-15T14:27:48.084 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:48.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.3 2024-05-15T14:27:48.098 DEBUG:teuthology.parallel:result is None 2024-05-15T14:27:48.158 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:48.167 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:48.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2024-05-15T14:27:48.172 DEBUG:teuthology.parallel:result is None 2024-05-15T14:27:48.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2024-05-15T14:27:48.180 DEBUG:teuthology.parallel:result is None 2024-05-15T14:27:48.202 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-05-15T14:27:48.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.4 2024-05-15T14:27:48.215 DEBUG:teuthology.parallel:result is None 2024-05-15T14:27:48.215 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T14:27:48.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:27:48.561 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:27:48.573 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-05-15T14:27:48.381679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252392,"kb_used_data":2424,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722328,"statfs":{"total":773094113280,"available":772835663872,"internally_reserved":0,"allocated":2482176,"data_stored":1581344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000578"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T14:27:44.809183+0000","last_change":"2024-05-15T14:27:44.808595+0000","last_active":"2024-05-15T14:27:44.809183+0000","last_peered":"2024-05-15T14:27:44.809183+0000","last_clean":"2024-05-15T14:27:44.809183+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:27:44.809183+0000","last_undegraded":"2024-05-15T14:27:44.809183+0000","last_fullsized":"2024-05-15T14:27:44.809183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:20.733183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T14:27:44.809416+0000","last_change":"2024-05-15T14:27:44.808690+0000","last_active":"2024-05-15T14:27:44.809416+0000","last_peered":"2024-05-15T14:27:44.809416+0000","last_clean":"2024-05-15T14:27:44.809416+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:27:44.809416+0000","last_undegraded":"2024-05-15T14:27:44.809416+0000","last_fullsized":"2024-05-15T14:27:44.809416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:20.733183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.809740+0000","last_change":"2024-05-15T14:27:45.305329+0000","last_active":"2024-05-15T14:27:45.809740+0000","last_peered":"2024-05-15T14:27:45.809740+0000","last_clean":"2024-05-15T14:27:45.809740+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:27:45.809740+0000","last_undegraded":"2024-05-15T14:27:45.809740+0000","last_fullsized":"2024-05-15T14:27:45.809740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:38:59.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.306299+0000","last_change":"2024-05-15T14:27:45.305199+0000","last_active":"2024-05-15T14:27:45.306299+0000","last_peered":"2024-05-15T14:27:45.306299+0000","last_clean":"2024-05-15T14:27:45.306299+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:27:45.306299+0000","last_undegraded":"2024-05-15T14:27:45.306299+0000","last_fullsized":"2024-05-15T14:27:45.306299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:47.141057+0000","last_change":"2024-05-15T14:27:44.810023+0000","last_active":"2024-05-15T14:27:47.141057+0000","last_peered":"2024-05-15T14:27:47.141057+0000","last_clean":"2024-05-15T14:27:47.141057+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:27:47.141057+0000","last_undegraded":"2024-05-15T14:27:47.141057+0000","last_fullsized":"2024-05-15T14:27:47.141057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.808720+0000","last_change":"2024-05-15T14:27:45.305663+0000","last_active":"2024-05-15T14:27:45.808720+0000","last_peered":"2024-05-15T14:27:45.808720+0000","last_clean":"2024-05-15T14:27:45.808720+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:27:45.808720+0000","last_undegraded":"2024-05-15T14:27:45.808720+0000","last_fullsized":"2024-05-15T14:27:45.808720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.809747+0000","last_change":"2024-05-15T14:27:44.810189+0000","last_active":"2024-05-15T14:27:45.809747+0000","last_peered":"2024-05-15T14:27:45.809747+0000","last_clean":"2024-05-15T14:27:45.809747+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:27:45.809747+0000","last_undegraded":"2024-05-15T14:27:45.809747+0000","last_fullsized":"2024-05-15T14:27:45.809747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:29.474022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:47.141036+0000","last_change":"2024-05-15T14:27:44.808919+0000","last_active":"2024-05-15T14:27:47.141036+0000","last_peered":"2024-05-15T14:27:47.141036+0000","last_clean":"2024-05-15T14:27:47.141036+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:27:47.141036+0000","last_undegraded":"2024-05-15T14:27:47.141036+0000","last_fullsized":"2024-05-15T14:27:47.141036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":104,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.809676+0000","last_change":"2024-05-15T14:27:43.806336+0000","last_active":"2024-05-15T14:27:45.809676+0000","last_peered":"2024-05-15T14:27:45.809676+0000","last_clean":"2024-05-15T14:27:45.809676+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:27:45.809676+0000","last_undegraded":"2024-05-15T14:27:45.809676+0000","last_fullsized":"2024-05-15T14:27:45.809676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_clean_scrub_stamp":"2024-05-15T14:27:42.789461+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:25.195322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":761856,"data_stored":643318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":52950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":52950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":52950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":749568,"data_stored":637570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:27:48.574 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:27:48.877 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:48.878 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:27:48.890 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-05-15T14:27:48.381679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252392,"kb_used_data":2424,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722328,"statfs":{"total":773094113280,"available":772835663872,"internally_reserved":0,"allocated":2482176,"data_stored":1581344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000578"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T14:27:44.809183+0000","last_change":"2024-05-15T14:27:44.808595+0000","last_active":"2024-05-15T14:27:44.809183+0000","last_peered":"2024-05-15T14:27:44.809183+0000","last_clean":"2024-05-15T14:27:44.809183+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:27:44.809183+0000","last_undegraded":"2024-05-15T14:27:44.809183+0000","last_fullsized":"2024-05-15T14:27:44.809183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:20.733183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T14:27:44.809416+0000","last_change":"2024-05-15T14:27:44.808690+0000","last_active":"2024-05-15T14:27:44.809416+0000","last_peered":"2024-05-15T14:27:44.809416+0000","last_clean":"2024-05-15T14:27:44.809416+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:27:44.809416+0000","last_undegraded":"2024-05-15T14:27:44.809416+0000","last_fullsized":"2024-05-15T14:27:44.809416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:20.733183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.809740+0000","last_change":"2024-05-15T14:27:45.305329+0000","last_active":"2024-05-15T14:27:45.809740+0000","last_peered":"2024-05-15T14:27:45.809740+0000","last_clean":"2024-05-15T14:27:45.809740+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:27:45.809740+0000","last_undegraded":"2024-05-15T14:27:45.809740+0000","last_fullsized":"2024-05-15T14:27:45.809740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:38:59.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.306299+0000","last_change":"2024-05-15T14:27:45.305199+0000","last_active":"2024-05-15T14:27:45.306299+0000","last_peered":"2024-05-15T14:27:45.306299+0000","last_clean":"2024-05-15T14:27:45.306299+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:27:45.306299+0000","last_undegraded":"2024-05-15T14:27:45.306299+0000","last_fullsized":"2024-05-15T14:27:45.306299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:47.141057+0000","last_change":"2024-05-15T14:27:44.810023+0000","last_active":"2024-05-15T14:27:47.141057+0000","last_peered":"2024-05-15T14:27:47.141057+0000","last_clean":"2024-05-15T14:27:47.141057+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:27:47.141057+0000","last_undegraded":"2024-05-15T14:27:47.141057+0000","last_fullsized":"2024-05-15T14:27:47.141057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.808720+0000","last_change":"2024-05-15T14:27:45.305663+0000","last_active":"2024-05-15T14:27:45.808720+0000","last_peered":"2024-05-15T14:27:45.808720+0000","last_clean":"2024-05-15T14:27:45.808720+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:27:45.808720+0000","last_undegraded":"2024-05-15T14:27:45.808720+0000","last_fullsized":"2024-05-15T14:27:45.808720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.809747+0000","last_change":"2024-05-15T14:27:44.810189+0000","last_active":"2024-05-15T14:27:45.809747+0000","last_peered":"2024-05-15T14:27:45.809747+0000","last_clean":"2024-05-15T14:27:45.809747+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:27:45.809747+0000","last_undegraded":"2024-05-15T14:27:45.809747+0000","last_fullsized":"2024-05-15T14:27:45.809747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:29.474022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:47.141036+0000","last_change":"2024-05-15T14:27:44.808919+0000","last_active":"2024-05-15T14:27:47.141036+0000","last_peered":"2024-05-15T14:27:47.141036+0000","last_clean":"2024-05-15T14:27:47.141036+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:27:47.141036+0000","last_undegraded":"2024-05-15T14:27:47.141036+0000","last_fullsized":"2024-05-15T14:27:47.141036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":104,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-15T14:27:45.809676+0000","last_change":"2024-05-15T14:27:43.806336+0000","last_active":"2024-05-15T14:27:45.809676+0000","last_peered":"2024-05-15T14:27:45.809676+0000","last_clean":"2024-05-15T14:27:45.809676+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:27:45.809676+0000","last_undegraded":"2024-05-15T14:27:45.809676+0000","last_fullsized":"2024-05-15T14:27:45.809676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_clean_scrub_stamp":"2024-05-15T14:27:42.789461+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:25.195322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":761856,"data_stored":643318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":52950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":52950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":52950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":749568,"data_stored":637570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:27:48.891 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T14:27:48.891 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-15T14:27:48.891 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-15T14:27:48.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-15T14:27:49.240 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:27:49.240 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-15T14:27:49.253 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-15T14:27:49.253 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-05-15T14:27:49.265 INFO:teuthology.run_tasks:Running task rgw... 2024-05-15T14:27:49.281 DEBUG:tasks.rgw:config is {'client.0': None, 'client.1': None} 2024-05-15T14:27:49.281 DEBUG:tasks.rgw:client list is dict_keys(['client.0', 'client.1']) 2024-05-15T14:27:49.281 INFO:tasks.rgw:Creating data pools 2024-05-15T14:27:49.281 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-15T14:27:49.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool create MyZone.rgw.buckets.data 64 64 --cluster ceph 2024-05-15T14:27:49.822 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'MyZone.rgw.buckets.data' created 2024-05-15T14:27:49.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool application enable MyZone.rgw.buckets.data rgw --cluster ceph 2024-05-15T14:27:50.826 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rgw' on pool 'MyZone.rgw.buckets.data' 2024-05-15T14:27:50.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool create MyZone.rgw.buckets.index 64 64 --cluster ceph 2024-05-15T14:27:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'MyZone.rgw.buckets.index' created 2024-05-15T14:27:51.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph osd pool application enable MyZone.rgw.buckets.index rgw --cluster ceph 2024-05-15T14:27:52.830 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rgw' on pool 'MyZone.rgw.buckets.index' 2024-05-15T14:27:52.861 DEBUG:tasks.rgw:Obtaining remote for client client.1 2024-05-15T14:27:52.862 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool create MyZone.rgw.buckets.data 64 64 --cluster ceph 2024-05-15T14:27:53.162 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'MyZone.rgw.buckets.data' already exists 2024-05-15T14:27:53.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool application enable MyZone.rgw.buckets.data rgw --cluster ceph 2024-05-15T14:27:53.834 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rgw' on pool 'MyZone.rgw.buckets.data' 2024-05-15T14:27:53.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool create MyZone.rgw.buckets.index 64 64 --cluster ceph 2024-05-15T14:27:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'MyZone.rgw.buckets.index' already exists 2024-05-15T14:27:54.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool application enable MyZone.rgw.buckets.index rgw --cluster ceph 2024-05-15T14:27:54.865 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rgw' on pool 'MyZone.rgw.buckets.index' 2024-05-15T14:27:54.878 DEBUG:tasks.rgw:Pools created 2024-05-15T14:27:54.878 INFO:tasks.rgw:Creating realm MyRealm 2024-05-15T14:27:54.879 INFO:tasks.util.rgw:rgwadmin: client.0 : ['realm', 'create', '--rgw-realm', 'MyRealm', '--default'] 2024-05-15T14:27:54.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'realm', 'create', '--rgw-realm', 'MyRealm', '--default'] 2024-05-15T14:27:54.879 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph realm create --rgw-realm MyRealm --default 2024-05-15T14:27:54.987 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:27:54.988 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:27:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:55.017+0000 7f6dbb333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:27:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:55.017+0000 7f6dbb333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:27:55.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:55.021+0000 7f6c797e2640 20 reqs_thread_entry: start 2024-05-15T14:27:56.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:56.889+0000 7f6dbb333800 20 creating initial latest_epoch=1 for period=7cfaded8-8cca-41de-86c1-7920f35dfb0e 2024-05-15T14:27:56.913 INFO:teuthology.orchestra.run.smithi018.stdout:{"id":"c960760b-b2d7-439f-9323-6ff955b035b5","name":"MyRealm","current_period":"7cfaded8-8cca-41de-86c1-7920f35dfb0e","epoch":1} 2024-05-15T14:27:56.913 DEBUG:tasks.util.rgw: json result: {'id': 'c960760b-b2d7-439f-9323-6ff955b035b5', 'name': 'MyRealm', 'current_period': '7cfaded8-8cca-41de-86c1-7920f35dfb0e', 'epoch': 1} 2024-05-15T14:27:56.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'create', '--rgw-realm', 'MyRealm', '--rgw-zonegroup', 'MyZoneGroup', '--master', '--default'] 2024-05-15T14:27:56.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'create', '--rgw-realm', 'MyRealm', '--rgw-zonegroup', 'MyZoneGroup', '--master', '--default'] 2024-05-15T14:27:56.914 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup create --rgw-realm MyRealm --rgw-zonegroup MyZoneGroup --master --default 2024-05-15T14:27:56.964 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:27:56.964 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:27:56.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:56.990+0000 7f661d12b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:27:56.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:56.991+0000 7f661d12b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:27:56.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:56.994+0000 7f645effd640 20 reqs_thread_entry: start 2024-05-15T14:27:57.015 INFO:teuthology.orchestra.run.smithi018.stdout:{"id":"88d155fc-d3b1-427c-898a-ccb610f9ade3","name":"MyZoneGroup","api_name":"MyZoneGroup","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":[]}],"default_placement":"default-placement","realm_id":"c960760b-b2d7-439f-9323-6ff955b035b5","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-05-15T14:27:57.015 DEBUG:tasks.util.rgw: json result: {'id': '88d155fc-d3b1-427c-898a-ccb610f9ade3', 'name': 'MyZoneGroup', 'api_name': 'MyZoneGroup', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '', 'zones': [], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': []}], 'default_placement': 'default-placement', 'realm_id': 'c960760b-b2d7-439f-9323-6ff955b035b5', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-05-15T14:27:57.016 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'create', '--rgw-realm', 'MyRealm', '--rgw-zonegroup', 'MyZoneGroup', '--rgw-zone', 'MyZone', '--master', '--default'] 2024-05-15T14:27:57.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'create', '--rgw-realm', 'MyRealm', '--rgw-zonegroup', 'MyZoneGroup', '--rgw-zone', 'MyZone', '--master', '--default'] 2024-05-15T14:27:57.016 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone create --rgw-realm MyRealm --rgw-zonegroup MyZoneGroup --rgw-zone MyZone --master --default 2024-05-15T14:27:57.064 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:27:57.064 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:27:57.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.089+0000 7f157d931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:27:57.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.089+0000 7f157d931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:27:57.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.093+0000 7f14377fe640 20 reqs_thread_entry: start 2024-05-15T14:27:57.098 INFO:teuthology.orchestra.run.smithi018.stderr:NOTICE: set zone's realm_id=c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:27:57.127 INFO:teuthology.orchestra.run.smithi018.stdout:{"id":"d844ce7e-fd85-4b58-a5b6-40865194449a","name":"MyZone","domain_root":"MyZone.rgw.meta:root","control_pool":"MyZone.rgw.control","gc_pool":"MyZone.rgw.log:gc","lc_pool":"MyZone.rgw.log:lc","log_pool":"MyZone.rgw.log","intent_log_pool":"MyZone.rgw.log:intent","usage_log_pool":"MyZone.rgw.log:usage","roles_pool":"MyZone.rgw.meta:roles","reshard_pool":"MyZone.rgw.log:reshard","user_keys_pool":"MyZone.rgw.meta:users.keys","user_email_pool":"MyZone.rgw.meta:users.email","user_swift_pool":"MyZone.rgw.meta:users.swift","user_uid_pool":"MyZone.rgw.meta:users.uid","otp_pool":"MyZone.rgw.otp","notif_pool":"MyZone.rgw.log:notif","topics_pool":"MyZone.rgw.meta:topics","account_pool":"MyZone.rgw.meta:accounts","group_pool":"MyZone.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"MyZone.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"MyZone.rgw.buckets.data"}},"data_extra_pool":"MyZone.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c960760b-b2d7-439f-9323-6ff955b035b5"} 2024-05-15T14:27:57.127 DEBUG:tasks.util.rgw: json result: {'id': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'name': 'MyZone', 'domain_root': 'MyZone.rgw.meta:root', 'control_pool': 'MyZone.rgw.control', 'gc_pool': 'MyZone.rgw.log:gc', 'lc_pool': 'MyZone.rgw.log:lc', 'log_pool': 'MyZone.rgw.log', 'intent_log_pool': 'MyZone.rgw.log:intent', 'usage_log_pool': 'MyZone.rgw.log:usage', 'roles_pool': 'MyZone.rgw.meta:roles', 'reshard_pool': 'MyZone.rgw.log:reshard', 'user_keys_pool': 'MyZone.rgw.meta:users.keys', 'user_email_pool': 'MyZone.rgw.meta:users.email', 'user_swift_pool': 'MyZone.rgw.meta:users.swift', 'user_uid_pool': 'MyZone.rgw.meta:users.uid', 'otp_pool': 'MyZone.rgw.otp', 'notif_pool': 'MyZone.rgw.log:notif', 'topics_pool': 'MyZone.rgw.meta:topics', 'account_pool': 'MyZone.rgw.meta:accounts', 'group_pool': 'MyZone.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'MyZone.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'MyZone.rgw.buckets.data'}}, 'data_extra_pool': 'MyZone.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': 'c960760b-b2d7-439f-9323-6ff955b035b5'} 2024-05-15T14:27:57.128 INFO:tasks.util.rgw:rgwadmin: client.0 : ['period', 'update', '--commit', '--rgw-realm', 'MyRealm', '--rgw-zonegroup', 'MyZoneGroup', '--rgw-zone', 'MyZone'] 2024-05-15T14:27:57.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'period', 'update', '--commit', '--rgw-realm', 'MyRealm', '--rgw-zonegroup', 'MyZoneGroup', '--rgw-zone', 'MyZone'] 2024-05-15T14:27:57.128 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph period update --commit --rgw-realm MyRealm --rgw-zonegroup MyZoneGroup --rgw-zone MyZone 2024-05-15T14:27:57.175 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:27:57.175 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:27:57.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.211+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.212+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:27:57.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.212+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.213+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:27:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.213+0000 7fc963405800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:27:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.213+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.214+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:27:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.214+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.214+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:27:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.214+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.215+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=359 2024-05-15T14:27:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.215+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.215+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:27:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.215+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.216+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=1005 2024-05-15T14:27:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.216+0000 7fc963405800 0 period (7cfaded8-8cca-41de-86c1-7920f35dfb0e does not have zone d844ce7e-fd85-4b58-a5b6-40865194449a configured 2024-05-15T14:27:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.216+0000 7fc963405800 20 searching for the correct realm 2024-05-15T14:27:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got default.zonegroup.c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:27:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got period_config.c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:27:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got realms.c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:27:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got default.realm 2024-05-15T14:27:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got realms.c960760b-b2d7-439f-9323-6ff955b035b5.control 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got zonegroup_info.88d155fc-d3b1-427c-898a-ccb610f9ade3 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got zone_names.MyZone 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got periods.7cfaded8-8cca-41de-86c1-7920f35dfb0e.latest_epoch 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got periods.7cfaded8-8cca-41de-86c1-7920f35dfb0e.1 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got realms_names.MyRealm 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got zonegroups_names.MyZoneGroup 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got default.zone.c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 RGWRados::pool_iterate: got zone_info.d844ce7e-fd85-4b58-a5b6-40865194449a 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:27:57.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.226+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.227+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.227+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.227+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.227+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.228+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.228+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.228+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=359 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.228+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.228+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:27:57.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.228+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=517 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 20 zone MyZone found 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 20 zonegroup MyZoneGroup 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 20 rados_obj.operate() r=0 bl.length=187 2024-05-15T14:27:57.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:57.229+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:58.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:58.885+0000 7fc963405800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:27:58.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:58.885+0000 7fc963405800 20 rados->read ofs=0 len=0 2024-05-15T14:27:58.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:58.886+0000 7fc963405800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:27:58.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:58.886+0000 7fc963405800 20 started sync module instance, tier type = 2024-05-15T14:27:58.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:27:58.886+0000 7fc963405800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:28:00.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.901+0000 7fc963405800 20 add_watcher() i=0 2024-05-15T14:28:00.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.901+0000 7fc963405800 20 add_watcher() i=1 2024-05-15T14:28:00.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.901+0000 7fc963405800 20 add_watcher() i=2 2024-05-15T14:28:00.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.901+0000 7fc963405800 20 add_watcher() i=3 2024-05-15T14:28:00.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.901+0000 7fc963405800 20 add_watcher() i=4 2024-05-15T14:28:00.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.901+0000 7fc963405800 20 add_watcher() i=5 2024-05-15T14:28:00.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.901+0000 7fc963405800 20 add_watcher() i=6 2024-05-15T14:28:00.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.902+0000 7fc963405800 20 add_watcher() i=7 2024-05-15T14:28:00.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.902+0000 7fc963405800 2 all 8 watchers are set, enabling cache 2024-05-15T14:28:00.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.902+0000 7fc963405800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-05-15T14:28:00.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.902+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-05-15T14:28:00.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.902+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.903+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-05-15T14:28:00.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.903+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-05-15T14:28:00.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.903+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.903+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-05-15T14:28:00.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.903+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-05-15T14:28:00.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.903+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-05-15T14:28:00.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-05-15T14:28:00.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-05-15T14:28:00.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-05-15T14:28:00.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-05-15T14:28:00.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-05-15T14:28:00.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.904+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-05-15T14:28:00.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-05-15T14:28:00.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-05-15T14:28:00.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-05-15T14:28:00.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-05-15T14:28:00.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.905+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-05-15T14:28:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-05-15T14:28:00.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-05-15T14:28:00.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-05-15T14:28:00.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.906+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-05-15T14:28:00.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.907+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-05-15T14:28:00.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.908+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-05-15T14:28:00.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.909+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-05-15T14:28:00.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.910+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-05-15T14:28:00.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.911+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-05-15T14:28:00.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.912+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.913+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.913+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.913+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.913+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.913+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.913+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.914+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-05-15T14:28:00.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-05-15T14:28:00.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-05-15T14:28:00.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-05-15T14:28:00.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-05-15T14:28:00.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.915+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-05-15T14:28:00.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.916+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.917+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.918+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.919+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-05-15T14:28:00.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.920+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.921+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-05-15T14:28:00.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-05-15T14:28:00.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-05-15T14:28:00.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-05-15T14:28:00.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.922+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-05-15T14:28:00.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-05-15T14:28:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.923+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.924+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-05-15T14:28:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.925+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-05-15T14:28:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.926+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-05-15T14:28:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.927+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.928+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-05-15T14:28:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.929+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-05-15T14:28:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.930+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-05-15T14:28:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.931+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-05-15T14:28:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.932+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-05-15T14:28:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.933+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.934+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-05-15T14:28:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.935+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.936+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.936+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.936+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.936+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.936+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-05-15T14:28:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.936+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.936+0000 7fc963405800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-05-15T14:28:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.936+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-05-15T14:28:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.937+0000 7fc963405800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-05-15T14:28:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.940+0000 7fc816fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:28:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.940+0000 7fc963405800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:00.940+0000 7fc963405800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:03.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.882+0000 7fc963405800 10 rgw_init_ioctx warning: failed to set recovery_priority on MyZone.rgw.meta 2024-05-15T14:28:03.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.882+0000 7fc963405800 5 note: GC not initialized 2024-05-15T14:28:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.882+0000 7fc963405800 20 init_complete bucket index max shards: 11 2024-05-15T14:28:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.882+0000 7fc815fe3640 20 reqs_thread_entry: start 2024-05-15T14:28:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.882+0000 7fc963405800 20 Filter name: none 2024-05-15T14:28:03.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.883+0000 7fc7777fe640 20 reqs_thread_entry: start 2024-05-15T14:28:03.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.885+0000 7fc963405800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=7cfaded8-8cca-41de-86c1-7920f35dfb0e 2024-05-15T14:28:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.918+0000 7fc963405800 20 creating initial latest_epoch=1 for period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:28:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.920+0000 7fc963405800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 7cfaded8-8cca-41de-86c1-7920f35dfb0e 2024-05-15T14:28:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.922+0000 7fc963405800 20 creating initial latest_epoch=1 for period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:28:03.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.931+0000 7fc963405800 4 Promoted to master zone and committed new period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:28:03.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.932+0000 7fc816fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:28:03.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.935+0000 7fc963405800 20 remove_watcher() i=0 2024-05-15T14:28:03.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.935+0000 7fc963405800 2 removed watcher, disabling cache 2024-05-15T14:28:03.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.936+0000 7fc963405800 20 remove_watcher() i=1 2024-05-15T14:28:03.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.937+0000 7fc963405800 20 remove_watcher() i=2 2024-05-15T14:28:03.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.939+0000 7fc963405800 20 remove_watcher() i=3 2024-05-15T14:28:03.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.940+0000 7fc963405800 20 remove_watcher() i=4 2024-05-15T14:28:03.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.941+0000 7fc963405800 20 remove_watcher() i=5 2024-05-15T14:28:03.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.942+0000 7fc963405800 20 remove_watcher() i=6 2024-05-15T14:28:03.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:03.944+0000 7fc963405800 20 remove_watcher() i=7 2024-05-15T14:28:03.957 INFO:teuthology.orchestra.run.smithi018.stdout:{"id":"450b0ad8-e873-4e0c-9309-d9dacbb20322","epoch":1,"predecessor_uuid":"7cfaded8-8cca-41de-86c1-7920f35dfb0e","sync_status":[],"period_map":{"id":"450b0ad8-e873-4e0c-9309-d9dacbb20322","zonegroups":[{"id":"88d155fc-d3b1-427c-898a-ccb610f9ade3","name":"MyZoneGroup","api_name":"MyZoneGroup","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"d844ce7e-fd85-4b58-a5b6-40865194449a","zones":[{"id":"d844ce7e-fd85-4b58-a5b6-40865194449a","name":"MyZone","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c960760b-b2d7-439f-9323-6ff955b035b5","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"d844ce7e-fd85-4b58-a5b6-40865194449a","val":1760083948}]},"master_zonegroup":"88d155fc-d3b1-427c-898a-ccb610f9ade3","master_zone":"d844ce7e-fd85-4b58-a5b6-40865194449a","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c960760b-b2d7-439f-9323-6ff955b035b5","realm_epoch":2} 2024-05-15T14:28:03.958 DEBUG:tasks.util.rgw: json result: {'id': '450b0ad8-e873-4e0c-9309-d9dacbb20322', 'epoch': 1, 'predecessor_uuid': '7cfaded8-8cca-41de-86c1-7920f35dfb0e', 'sync_status': [], 'period_map': {'id': '450b0ad8-e873-4e0c-9309-d9dacbb20322', 'zonegroups': [{'id': '88d155fc-d3b1-427c-898a-ccb610f9ade3', 'name': 'MyZoneGroup', 'api_name': 'MyZoneGroup', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'zones': [{'id': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'name': 'MyZone', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['compress-encrypted', 'notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': 'c960760b-b2d7-439f-9323-6ff955b035b5', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']}], 'short_zone_ids': [{'key': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'val': 1760083948}]}, 'master_zonegroup': '88d155fc-d3b1-427c-898a-ccb610f9ade3', 'master_zone': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'period_config': {'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}}, 'realm_id': 'c960760b-b2d7-439f-9323-6ff955b035b5', 'realm_epoch': 2} 2024-05-15T14:28:03.958 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-05-15T14:28:03.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-05-15T14:28:03.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-05-15T14:28:03.959 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone MyZone --placement-id default-placement --storage-class LUKEWARM 2024-05-15T14:28:04.021 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:28:04.021 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:28:04.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.049+0000 7f40b2811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:04.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.049+0000 7f40b2811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.053+0000 7f3f70fe1640 20 reqs_thread_entry: start 2024-05-15T14:28:04.070 INFO:teuthology.orchestra.run.smithi018.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-05-15T14:28:04.071 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-05-15T14:28:04.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-05-15T14:28:04.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-05-15T14:28:04.071 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone MyZone --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-05-15T14:28:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:28:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:28:04.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.149+0000 7f47e792b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:04.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.149+0000 7f47e792b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:04.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.153+0000 7f46a27fc640 20 reqs_thread_entry: start 2024-05-15T14:28:04.171 INFO:teuthology.orchestra.run.smithi018.stdout:{"id":"d844ce7e-fd85-4b58-a5b6-40865194449a","name":"MyZone","domain_root":"MyZone.rgw.meta:root","control_pool":"MyZone.rgw.control","gc_pool":"MyZone.rgw.log:gc","lc_pool":"MyZone.rgw.log:lc","log_pool":"MyZone.rgw.log","intent_log_pool":"MyZone.rgw.log:intent","usage_log_pool":"MyZone.rgw.log:usage","roles_pool":"MyZone.rgw.meta:roles","reshard_pool":"MyZone.rgw.log:reshard","user_keys_pool":"MyZone.rgw.meta:users.keys","user_email_pool":"MyZone.rgw.meta:users.email","user_swift_pool":"MyZone.rgw.meta:users.swift","user_uid_pool":"MyZone.rgw.meta:users.uid","otp_pool":"MyZone.rgw.otp","notif_pool":"MyZone.rgw.log:notif","topics_pool":"MyZone.rgw.meta:topics","account_pool":"MyZone.rgw.meta:accounts","group_pool":"MyZone.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"MyZone.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"MyZone.rgw.buckets.data"}},"data_extra_pool":"MyZone.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c960760b-b2d7-439f-9323-6ff955b035b5"} 2024-05-15T14:28:04.172 DEBUG:tasks.util.rgw: json result: {'id': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'name': 'MyZone', 'domain_root': 'MyZone.rgw.meta:root', 'control_pool': 'MyZone.rgw.control', 'gc_pool': 'MyZone.rgw.log:gc', 'lc_pool': 'MyZone.rgw.log:lc', 'log_pool': 'MyZone.rgw.log', 'intent_log_pool': 'MyZone.rgw.log:intent', 'usage_log_pool': 'MyZone.rgw.log:usage', 'roles_pool': 'MyZone.rgw.meta:roles', 'reshard_pool': 'MyZone.rgw.log:reshard', 'user_keys_pool': 'MyZone.rgw.meta:users.keys', 'user_email_pool': 'MyZone.rgw.meta:users.email', 'user_swift_pool': 'MyZone.rgw.meta:users.swift', 'user_uid_pool': 'MyZone.rgw.meta:users.uid', 'otp_pool': 'MyZone.rgw.otp', 'notif_pool': 'MyZone.rgw.log:notif', 'topics_pool': 'MyZone.rgw.meta:topics', 'account_pool': 'MyZone.rgw.meta:accounts', 'group_pool': 'MyZone.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'MyZone.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'MyZone.rgw.buckets.data'}}, 'data_extra_pool': 'MyZone.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': 'c960760b-b2d7-439f-9323-6ff955b035b5'} 2024-05-15T14:28:04.172 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-05-15T14:28:04.172 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-05-15T14:28:04.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-05-15T14:28:04.172 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone MyZone --placement-id default-placement --storage-class FROZEN 2024-05-15T14:28:04.223 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:28:04.223 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:28:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.249+0000 7fd030613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.249+0000 7fd030613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:04.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.253+0000 7fceb1ffb640 20 reqs_thread_entry: start 2024-05-15T14:28:04.269 INFO:teuthology.orchestra.run.smithi018.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-05-15T14:28:04.270 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-05-15T14:28:04.270 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-05-15T14:28:04.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-05-15T14:28:04.270 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone MyZone --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-05-15T14:28:04.322 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:28:04.323 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:28:04.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.348+0000 7efdd472e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:04.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.348+0000 7efdd472e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:04.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:28:04.352+0000 7efc8effd640 20 reqs_thread_entry: start 2024-05-15T14:28:04.371 INFO:teuthology.orchestra.run.smithi018.stdout:{"id":"d844ce7e-fd85-4b58-a5b6-40865194449a","name":"MyZone","domain_root":"MyZone.rgw.meta:root","control_pool":"MyZone.rgw.control","gc_pool":"MyZone.rgw.log:gc","lc_pool":"MyZone.rgw.log:lc","log_pool":"MyZone.rgw.log","intent_log_pool":"MyZone.rgw.log:intent","usage_log_pool":"MyZone.rgw.log:usage","roles_pool":"MyZone.rgw.meta:roles","reshard_pool":"MyZone.rgw.log:reshard","user_keys_pool":"MyZone.rgw.meta:users.keys","user_email_pool":"MyZone.rgw.meta:users.email","user_swift_pool":"MyZone.rgw.meta:users.swift","user_uid_pool":"MyZone.rgw.meta:users.uid","otp_pool":"MyZone.rgw.otp","notif_pool":"MyZone.rgw.log:notif","topics_pool":"MyZone.rgw.meta:topics","account_pool":"MyZone.rgw.meta:accounts","group_pool":"MyZone.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"MyZone.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"MyZone.rgw.buckets.data"}},"data_extra_pool":"MyZone.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c960760b-b2d7-439f-9323-6ff955b035b5"} 2024-05-15T14:28:04.372 DEBUG:tasks.util.rgw: json result: {'id': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'name': 'MyZone', 'domain_root': 'MyZone.rgw.meta:root', 'control_pool': 'MyZone.rgw.control', 'gc_pool': 'MyZone.rgw.log:gc', 'lc_pool': 'MyZone.rgw.log:lc', 'log_pool': 'MyZone.rgw.log', 'intent_log_pool': 'MyZone.rgw.log:intent', 'usage_log_pool': 'MyZone.rgw.log:usage', 'roles_pool': 'MyZone.rgw.meta:roles', 'reshard_pool': 'MyZone.rgw.log:reshard', 'user_keys_pool': 'MyZone.rgw.meta:users.keys', 'user_email_pool': 'MyZone.rgw.meta:users.email', 'user_swift_pool': 'MyZone.rgw.meta:users.swift', 'user_uid_pool': 'MyZone.rgw.meta:users.uid', 'otp_pool': 'MyZone.rgw.otp', 'notif_pool': 'MyZone.rgw.log:notif', 'topics_pool': 'MyZone.rgw.meta:topics', 'account_pool': 'MyZone.rgw.meta:accounts', 'group_pool': 'MyZone.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'MyZone.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'MyZone.rgw.buckets.data'}}, 'data_extra_pool': 'MyZone.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': 'c960760b-b2d7-439f-9323-6ff955b035b5'} 2024-05-15T14:28:04.372 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-05-15T14:28:04.372 INFO:tasks.util.rgw:rgwadmin: client.1 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-05-15T14:28:04.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-05-15T14:28:04.372 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster ceph zonegroup placement add --rgw-zone MyZone --placement-id default-placement --storage-class LUKEWARM 2024-05-15T14:28:04.486 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:28:04.486 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:28:04.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.513+0000 7ff76ff1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:04.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.513+0000 7ff76ff1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:04.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.517+0000 7ff5d9ffb640 20 reqs_thread_entry: start 2024-05-15T14:28:04.547 INFO:teuthology.orchestra.run.smithi070.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-05-15T14:28:04.547 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-05-15T14:28:04.547 INFO:tasks.util.rgw:rgwadmin: client.1 : ['zone', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-05-15T14:28:04.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-05-15T14:28:04.547 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster ceph zone placement add --rgw-zone MyZone --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-05-15T14:28:04.599 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:28:04.599 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:28:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.623+0000 7f4b7f133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.623+0000 7f4b7f133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:04.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.627+0000 7f4a397fa640 20 reqs_thread_entry: start 2024-05-15T14:28:04.644 INFO:teuthology.orchestra.run.smithi070.stdout:{"id":"d844ce7e-fd85-4b58-a5b6-40865194449a","name":"MyZone","domain_root":"MyZone.rgw.meta:root","control_pool":"MyZone.rgw.control","gc_pool":"MyZone.rgw.log:gc","lc_pool":"MyZone.rgw.log:lc","log_pool":"MyZone.rgw.log","intent_log_pool":"MyZone.rgw.log:intent","usage_log_pool":"MyZone.rgw.log:usage","roles_pool":"MyZone.rgw.meta:roles","reshard_pool":"MyZone.rgw.log:reshard","user_keys_pool":"MyZone.rgw.meta:users.keys","user_email_pool":"MyZone.rgw.meta:users.email","user_swift_pool":"MyZone.rgw.meta:users.swift","user_uid_pool":"MyZone.rgw.meta:users.uid","otp_pool":"MyZone.rgw.otp","notif_pool":"MyZone.rgw.log:notif","topics_pool":"MyZone.rgw.meta:topics","account_pool":"MyZone.rgw.meta:accounts","group_pool":"MyZone.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"MyZone.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"MyZone.rgw.buckets.data"}},"data_extra_pool":"MyZone.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c960760b-b2d7-439f-9323-6ff955b035b5"} 2024-05-15T14:28:04.644 DEBUG:tasks.util.rgw: json result: {'id': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'name': 'MyZone', 'domain_root': 'MyZone.rgw.meta:root', 'control_pool': 'MyZone.rgw.control', 'gc_pool': 'MyZone.rgw.log:gc', 'lc_pool': 'MyZone.rgw.log:lc', 'log_pool': 'MyZone.rgw.log', 'intent_log_pool': 'MyZone.rgw.log:intent', 'usage_log_pool': 'MyZone.rgw.log:usage', 'roles_pool': 'MyZone.rgw.meta:roles', 'reshard_pool': 'MyZone.rgw.log:reshard', 'user_keys_pool': 'MyZone.rgw.meta:users.keys', 'user_email_pool': 'MyZone.rgw.meta:users.email', 'user_swift_pool': 'MyZone.rgw.meta:users.swift', 'user_uid_pool': 'MyZone.rgw.meta:users.uid', 'otp_pool': 'MyZone.rgw.otp', 'notif_pool': 'MyZone.rgw.log:notif', 'topics_pool': 'MyZone.rgw.meta:topics', 'account_pool': 'MyZone.rgw.meta:accounts', 'group_pool': 'MyZone.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'MyZone.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'MyZone.rgw.buckets.data'}}, 'data_extra_pool': 'MyZone.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': 'c960760b-b2d7-439f-9323-6ff955b035b5'} 2024-05-15T14:28:04.644 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-05-15T14:28:04.644 INFO:tasks.util.rgw:rgwadmin: client.1 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-05-15T14:28:04.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-05-15T14:28:04.644 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster ceph zonegroup placement add --rgw-zone MyZone --placement-id default-placement --storage-class FROZEN 2024-05-15T14:28:04.694 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:28:04.694 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:28:04.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.719+0000 7f1ed1b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:04.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.719+0000 7f1ed1b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:04.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.723+0000 7f1d907e0640 20 reqs_thread_entry: start 2024-05-15T14:28:04.738 INFO:teuthology.orchestra.run.smithi070.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-05-15T14:28:04.738 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-05-15T14:28:04.738 INFO:tasks.util.rgw:rgwadmin: client.1 : ['zone', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-05-15T14:28:04.738 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'MyZone', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-05-15T14:28:04.739 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster ceph zone placement add --rgw-zone MyZone --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-05-15T14:28:04.788 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:28:04.788 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:28:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.813+0000 7fde0200f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:28:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.813+0000 7fde0200f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:28:04.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:28:04.817+0000 7fdc3b7fe640 20 reqs_thread_entry: start 2024-05-15T14:28:04.834 INFO:teuthology.orchestra.run.smithi070.stdout:{"id":"d844ce7e-fd85-4b58-a5b6-40865194449a","name":"MyZone","domain_root":"MyZone.rgw.meta:root","control_pool":"MyZone.rgw.control","gc_pool":"MyZone.rgw.log:gc","lc_pool":"MyZone.rgw.log:lc","log_pool":"MyZone.rgw.log","intent_log_pool":"MyZone.rgw.log:intent","usage_log_pool":"MyZone.rgw.log:usage","roles_pool":"MyZone.rgw.meta:roles","reshard_pool":"MyZone.rgw.log:reshard","user_keys_pool":"MyZone.rgw.meta:users.keys","user_email_pool":"MyZone.rgw.meta:users.email","user_swift_pool":"MyZone.rgw.meta:users.swift","user_uid_pool":"MyZone.rgw.meta:users.uid","otp_pool":"MyZone.rgw.otp","notif_pool":"MyZone.rgw.log:notif","topics_pool":"MyZone.rgw.meta:topics","account_pool":"MyZone.rgw.meta:accounts","group_pool":"MyZone.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"MyZone.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"MyZone.rgw.buckets.data"}},"data_extra_pool":"MyZone.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c960760b-b2d7-439f-9323-6ff955b035b5"} 2024-05-15T14:28:04.834 DEBUG:tasks.util.rgw: json result: {'id': 'd844ce7e-fd85-4b58-a5b6-40865194449a', 'name': 'MyZone', 'domain_root': 'MyZone.rgw.meta:root', 'control_pool': 'MyZone.rgw.control', 'gc_pool': 'MyZone.rgw.log:gc', 'lc_pool': 'MyZone.rgw.log:lc', 'log_pool': 'MyZone.rgw.log', 'intent_log_pool': 'MyZone.rgw.log:intent', 'usage_log_pool': 'MyZone.rgw.log:usage', 'roles_pool': 'MyZone.rgw.meta:roles', 'reshard_pool': 'MyZone.rgw.log:reshard', 'user_keys_pool': 'MyZone.rgw.meta:users.keys', 'user_email_pool': 'MyZone.rgw.meta:users.email', 'user_swift_pool': 'MyZone.rgw.meta:users.swift', 'user_uid_pool': 'MyZone.rgw.meta:users.uid', 'otp_pool': 'MyZone.rgw.otp', 'notif_pool': 'MyZone.rgw.log:notif', 'topics_pool': 'MyZone.rgw.meta:topics', 'account_pool': 'MyZone.rgw.meta:accounts', 'group_pool': 'MyZone.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'MyZone.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'MyZone.rgw.buckets.data'}}, 'data_extra_pool': 'MyZone.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': 'c960760b-b2d7-439f-9323-6ff955b035b5'} 2024-05-15T14:28:04.834 INFO:tasks.rgw:Starting rgw... 2024-05-15T14:28:04.835 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-15T14:28:04.835 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-15T14:28:04.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo echo -n http://smithi018.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-15T14:28:04.864 INFO:teuthology.orchestra.run.smithi018.stdout:http://smithi018.front.sepia.ceph.com:80 2024-05-15T14:28:04.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-15T14:28:04.931 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-15T14:28:04.931 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-15T14:28:04.973 INFO:tasks.rgw.client.0:Started 2024-05-15T14:28:04.973 INFO:tasks.rgw:rgw client.1 config is {} 2024-05-15T14:28:04.973 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-15T14:28:04.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo echo -n http://smithi070.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-15T14:28:05.000 INFO:teuthology.orchestra.run.smithi070.stdout:http://smithi070.front.sepia.ceph.com:80 2024-05-15T14:28:05.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-15T14:28:05.066 INFO:tasks.rgw.client.1:Restarting daemon 2024-05-15T14:28:05.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.1 --cluster ceph -k /etc/ceph/ceph.client.1.keyring --log-file /var/log/ceph/rgw.ceph.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.1.stdout 2>&1 2024-05-15T14:28:05.108 INFO:tasks.rgw.client.1:Started 2024-05-15T14:28:05.108 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi018.front.sepia.ceph.com:80/ 2024-05-15T14:28:05.108 DEBUG:teuthology.orchestra.run.smithi018:> curl http://smithi018.front.sepia.ceph.com:80/ 2024-05-15T14:28:05.135 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-15T14:28:05.135 INFO:teuthology.orchestra.run.smithi018.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-15T14:28:05.135 INFO:teuthology.orchestra.run.smithi018.stderr: Dload Upload Total Spent Left Speed 2024-05-15T14:28:05.135 INFO:teuthology.orchestra.run.smithi018.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-15T14:28:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:curl: (7) Failed to connect to smithi018.front.sepia.ceph.com port 80: Connection refused 2024-05-15T14:28:05.160 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:28:05.160+0000 7fe218b83640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:28:05.161 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:28:05.160+0000 7fe218b83640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:28:05.161 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:28:05.160+0000 7fe218b83640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:28:05.161 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:28:05.160+0000 7fe218b83640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:28:05.302 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:28:05.302+0000 7f37cd518640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:28:05.303 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:28:05.302+0000 7f37cd518640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:28:05.303 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:28:05.302+0000 7f37cd518640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:28:05.303 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:28:05.302+0000 7f37cd518640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:28:06.136 DEBUG:teuthology.orchestra.run.smithi018:> curl http://smithi018.front.sepia.ceph.com:80/ 2024-05-15T14:28:06.161 INFO:teuthology.orchestra.run.smithi018.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-15T14:28:06.161 INFO:teuthology.orchestra.run.smithi018.stderr: Dload Upload Total Spent Left Speed 2024-05-15T14:28:06.162 INFO:teuthology.orchestra.run.smithi018.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-05-15T14:28:06.163 INFO:teuthology.orchestra.run.smithi018.stdout:anonymous 2024-05-15T14:28:06.163 INFO:tasks.rgw:Polling client.1 until it starts accepting connections on http://smithi070.front.sepia.ceph.com:80/ 2024-05-15T14:28:06.164 DEBUG:teuthology.orchestra.run.smithi070:> curl http://smithi070.front.sepia.ceph.com:80/ 2024-05-15T14:28:06.199 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-15T14:28:06.199 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-05-15T14:28:06.201 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 182k 2024-05-15T14:28:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:anonymous 2024-05-15T14:28:06.202 INFO:teuthology.run_tasks:Running task notification-tests... 2024-05-15T14:28:06.214 DEBUG:tasks.notification_tests:Notifications config is {'client.0': {'rgw_server': 'client.0'}} 2024-05-15T14:28:06.214 INFO:tasks.notification_tests:Downloading bucket-notifications-tests... 2024-05-15T14:28:06.214 INFO:tasks.notification_tests:Using branch wip-cbodley-testing from https://git.ceph.com/ceph-ci.git for bucket notifications tests 2024-05-15T14:28:06.214 DEBUG:teuthology.orchestra.run.smithi018:> git clone -b wip-cbodley-testing https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/ceph 2024-05-15T14:28:06.234 INFO:teuthology.orchestra.run.smithi018.stderr:Cloning into '/home/ubuntu/cephtest/ceph'... 2024-05-15T14:29:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:Updating files: 93% (11748/12532) Updating files: 94% (11781/12532) Updating files: 95% (11906/12532) Updating files: 96% (12031/12532) Updating files: 97% (12157/12532) Updating files: 98% (12282/12532) Updating files: 99% (12407/12532) Updating files: 100% (12532/12532) Updating files: 100% (12532/12532), done. 2024-05-15T14:29:32.754 INFO:tasks.notification_tests:Pre-processing... 2024-05-15T14:29:32.755 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p /home/ubuntu/.aws/models/s3/2006-03-01/ 2024-05-15T14:29:32.811 DEBUG:teuthology.orchestra.run.smithi018:> cd /home/ubuntu/.aws/models/s3/2006-03-01/ && cp /home/ubuntu/cephtest/ceph/examples/rgw/boto3/service-2.sdk-extras.json service-2.sdk-extras.json 2024-05-15T14:29:32.867 INFO:tasks.notification_tests:Creating rgw user... 2024-05-15T14:29:32.868 DEBUG:tasks.notification_tests:Creating user foo.client.0 on client.0 2024-05-15T14:29:32.868 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key MHWQSYCRCOLJHPGBGYLV --secret 0G62J+ksM5J/IJa422Gi6+lP5oZPQ7AFLTCf5iR2R8RMdMWWMeu+eA== --cluster ceph 2024-05-15T14:29:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:29:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:29:32.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.994+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.996+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:29:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.996+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.997+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:29:32.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.997+0000 7f5877e05800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:29:32.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.997+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:32.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.997+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:29:32.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.997+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:32.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.998+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:29:32.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.998+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:32.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.998+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:29:32.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.998+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:32.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.998+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:29:32.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.999+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:33.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.999+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:29:33.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:32.999+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:33.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.000+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:29:33.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.000+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:33.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:29:33.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 zone MyZone found 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 period zonegroup name MyZoneGroup 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:29:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:29:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 started sync module instance, tier type = 2024-05-15T14:29:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.001+0000 7f5877e05800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:29:33.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.013+0000 7f5877e05800 20 add_watcher() i=0 2024-05-15T14:29:33.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.013+0000 7f5877e05800 20 add_watcher() i=1 2024-05-15T14:29:33.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.013+0000 7f5877e05800 20 add_watcher() i=2 2024-05-15T14:29:33.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.013+0000 7f5877e05800 20 add_watcher() i=3 2024-05-15T14:29:33.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.013+0000 7f5877e05800 20 add_watcher() i=4 2024-05-15T14:29:33.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.013+0000 7f5877e05800 20 add_watcher() i=5 2024-05-15T14:29:33.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.013+0000 7f5877e05800 20 add_watcher() i=6 2024-05-15T14:29:33.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.014+0000 7f5877e05800 20 add_watcher() i=7 2024-05-15T14:29:33.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.014+0000 7f5877e05800 2 all 8 watchers are set, enabling cache 2024-05-15T14:29:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.016+0000 7f57277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:29:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.016+0000 7f5877e05800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:29:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.016+0000 7f5877e05800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:29:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.016+0000 7f5877e05800 5 note: GC not initialized 2024-05-15T14:29:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.016+0000 7f57267fc640 20 reqs_thread_entry: start 2024-05-15T14:29:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.016+0000 7f5877e05800 20 init_complete bucket index max shards: 11 2024-05-15T14:29:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.016+0000 7f5877e05800 20 Filter name: none 2024-05-15T14:29:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5697fff640 20 reqs_thread_entry: start 2024-05-15T14:29:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 10 cache get: name=MyZone.rgw.meta+users.uid+foo.client.0 : miss 2024-05-15T14:29:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 10 cache put: name=MyZone.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 10 adding MyZone.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 10 cache get: name=MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV : miss 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 20 rados->read ofs=0 len=0 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 10 cache put: name=MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV info.flags=0x0 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 10 adding MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV to cache LRU end 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 10 cache get: name=MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV : hit (negative entry) 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.017+0000 7f5877e05800 10 cache get: name=MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV : hit (negative entry) 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.019+0000 7f5877e05800 10 cache put: name=MyZone.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.019+0000 7f5877e05800 10 moving MyZone.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-05-15T14:29:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.019+0000 7f5877e05800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-05-15T14:29:33.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.019+0000 7f57597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 93875507371216 notifier 4734 bl.length()=627 2024-05-15T14:29:33.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.019+0000 7f57597fa640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-05-15T14:29:33.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.019+0000 7f57597fa640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-05-15T14:29:33.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.021+0000 7f5877e05800 10 cache put: name=MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV info.flags=0x7 2024-05-15T14:29:33.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.021+0000 7f5877e05800 10 moving MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV to cache LRU end 2024-05-15T14:29:33.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.021+0000 7f5877e05800 10 distributing notification oid=MyZone.rgw.control:notify.1 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:MHWQSYCRCOLJHPGBGYLV, ofs0, ns] 2024-05-15T14:29:33.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.021+0000 7f5758ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 93875507389504 notifier 4734 bl.length()=185 2024-05-15T14:29:33.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.021+0000 7f5758ff9640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV info.flags=0x7 2024-05-15T14:29:33.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.021+0000 7f5758ff9640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+MHWQSYCRCOLJHPGBGYLV to cache LRU end 2024-05-15T14:29:33.022 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:29:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "user_id": "foo.client.0", 2024-05-15T14:29:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "display_name": "Mr. foo.client.0", 2024-05-15T14:29:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "email": "", 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "suspended": 0, 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "max_buckets": 1000, 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "subusers": [], 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "keys": [ 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "user": "foo.client.0", 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "access_key": "MHWQSYCRCOLJHPGBGYLV", 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "secret_key": "0G62J+ksM5J/IJa422Gi6+lP5oZPQ7AFLTCf5iR2R8RMdMWWMeu+eA==", 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "active": true, 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "create_date": "2024-05-15T14:29:33.018516Z" 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "swift_keys": [], 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": [], 2024-05-15T14:29:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "op_mask": "read, write, delete", 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "default_placement": "", 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "default_storage_class": "", 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "placement_tags": [], 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bucket_quota": { 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "user_quota": { 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": false, 2024-05-15T14:29:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "check_on_raw": false, 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size": -1, 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max_size_kb": 0, 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max_objects": -1 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "temp_url_keys": [], 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "rgw", 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "mfa_ids": [], 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "account_id": "", 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "create_date": "2024-05-15T14:29:33.018502Z", 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "group_ids": [] 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:29:33.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.023+0000 7f57277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:29:33.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.025+0000 7f5877e05800 20 remove_watcher() i=0 2024-05-15T14:29:33.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.025+0000 7f5877e05800 2 removed watcher, disabling cache 2024-05-15T14:29:33.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.026+0000 7f5877e05800 20 remove_watcher() i=1 2024-05-15T14:29:33.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.027+0000 7f5877e05800 20 remove_watcher() i=2 2024-05-15T14:29:33.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.028+0000 7f5877e05800 20 remove_watcher() i=3 2024-05-15T14:29:33.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.029+0000 7f5877e05800 20 remove_watcher() i=4 2024-05-15T14:29:33.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.030+0000 7f5877e05800 20 remove_watcher() i=5 2024-05-15T14:29:33.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.031+0000 7f5877e05800 20 remove_watcher() i=6 2024-05-15T14:29:33.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:29:33.032+0000 7f5877e05800 20 remove_watcher() i=7 2024-05-15T14:29:33.044 INFO:tasks.notification_tests:Configuring bucket-notifications-tests... 2024-05-15T14:29:33.045 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-05-15T14:29:33.045 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf 2024-05-15T14:29:33.060 DEBUG:teuthology.orchestra.run.smithi018:> cd /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification && ./bootstrap 2024-05-15T14:29:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2024-05-15T14:29:36.813 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:04:40 ago on Wed 15 May 2024 02:24:56 PM UTC. 2024-05-15T14:29:36.950 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-05-15T14:29:36.951 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:29:36.951 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-05-15T14:29:36.951 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:29:36.951 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-05-15T14:29:36.951 INFO:teuthology.orchestra.run.smithi018.stdout: libevent-devel x86_64 2.1.12-6.el9 appstream 99 k 2024-05-15T14:29:36.951 INFO:teuthology.orchestra.run.smithi018.stdout: libxml2-devel x86_64 2.9.13-6.el9 appstream 898 k 2024-05-15T14:29:36.951 INFO:teuthology.orchestra.run.smithi018.stdout: libxslt-devel x86_64 1.1.34-9.el9 appstream 320 k 2024-05-15T14:29:36.951 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pika noarch 1.2.1-1.el9 epel 244 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: libxml2 x86_64 2.9.13-6.el9 baseos 748 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: python3-libxml2 x86_64 2.9.13-6.el9 baseos 226 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: cmake-filesystem x86_64 3.26.5-2.el9 appstream 19 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: libgpg-error-devel x86_64 1.42-5.el9 appstream 66 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: python3-Automat noarch 22.10.0-2.el9 epel 59 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: python3-constantly noarch 15.1.0-25.el9 epel 20 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: python3-hyperlink noarch 21.0.0-10.el9 epel 115 k 2024-05-15T14:29:36.952 INFO:teuthology.orchestra.run.smithi018.stdout: python3-incremental noarch 21.3.0-5.el9 epel 34 k 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout: python3-service-identity noarch 21.1.0-5.el9 epel 27 k 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zope-interface x86_64 5.4.0-5.el9.1 epel 168 k 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout: xz-devel x86_64 5.2.5-8.el9 appstream 55 k 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tornado x86_64 6.1.0-9.el9 appstream 698 k 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout: python3-twisted noarch 22.10.0-3.el9 epel 5.1 M 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout: python3-twisted+tls noarch 22.10.0-3.el9 epel 9.4 k 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout:Install 19 Packages 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 2 Packages 2024-05-15T14:29:36.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:29:36.954 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 8.9 M 2024-05-15T14:29:36.954 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-05-15T14:29:37.803 INFO:teuthology.orchestra.run.smithi018.stdout:(1/21): cmake-filesystem-3.26.5-2.el9.x86_64.rp 147 kB/s | 19 kB 00:00 2024-05-15T14:29:37.903 INFO:teuthology.orchestra.run.smithi018.stdout:(2/21): libevent-devel-2.1.12-6.el9.x86_64.rpm 436 kB/s | 99 kB 00:00 2024-05-15T14:29:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:(3/21): libgpg-error-devel-1.42-5.el9.x86_64.rp 261 kB/s | 66 kB 00:00 2024-05-15T14:29:38.054 INFO:teuthology.orchestra.run.smithi018.stdout:(4/21): python3-attrs-20.3.0-7.el9.noarch.rpm 700 kB/s | 87 kB 00:00 2024-05-15T14:29:38.079 INFO:teuthology.orchestra.run.smithi018.stdout:(5/21): libxslt-devel-1.1.34-9.el9.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2024-05-15T14:29:38.163 INFO:teuthology.orchestra.run.smithi018.stdout:(6/21): libxml2-devel-2.9.13-6.el9.x86_64.rpm 2.4 MB/s | 898 kB 00:00 2024-05-15T14:29:38.188 INFO:teuthology.orchestra.run.smithi018.stdout:(7/21): xz-devel-5.2.5-8.el9.x86_64.rpm 508 kB/s | 55 kB 00:00 2024-05-15T14:29:38.248 INFO:teuthology.orchestra.run.smithi018.stdout:(8/21): python3-tornado-6.1.0-9.el9.x86_64.rpm 3.5 MB/s | 698 kB 00:00 2024-05-15T14:29:38.273 INFO:teuthology.orchestra.run.smithi018.stdout:(9/21): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-05-15T14:29:38.731 INFO:teuthology.orchestra.run.smithi018.stdout:(10/21): python3-constantly-15.1.0-25.el9.noarc 41 kB/s | 20 kB 00:00 2024-05-15T14:29:38.814 INFO:teuthology.orchestra.run.smithi018.stdout:(11/21): python3-Automat-22.10.0-2.el9.noarch.r 94 kB/s | 59 kB 00:00 2024-05-15T14:29:38.948 INFO:teuthology.orchestra.run.smithi018.stdout:(12/21): python3-incremental-21.3.0-5.el9.noarc 158 kB/s | 34 kB 00:00 2024-05-15T14:29:39.007 INFO:teuthology.orchestra.run.smithi018.stdout:(13/21): python3-hyperlink-21.0.0-10.el9.noarch 157 kB/s | 115 kB 00:00 2024-05-15T14:29:39.132 INFO:teuthology.orchestra.run.smithi018.stdout:(14/21): python3-service-identity-21.1.0-5.el9. 145 kB/s | 27 kB 00:00 2024-05-15T14:29:39.157 INFO:teuthology.orchestra.run.smithi018.stdout:(15/21): python3-twisted+tls-22.10.0-3.el9.noar 63 kB/s | 9.4 kB 00:00 2024-05-15T14:29:39.216 INFO:teuthology.orchestra.run.smithi018.stdout:(16/21): python3-pika-1.2.1-1.el9.noarch.rpm 609 kB/s | 244 kB 00:00 2024-05-15T14:29:39.324 INFO:teuthology.orchestra.run.smithi018.stdout:(17/21): python3-xmltodict-0.12.0-15.el9.noarch 132 kB/s | 22 kB 00:00 2024-05-15T14:29:39.425 INFO:teuthology.orchestra.run.smithi018.stdout:(18/21): python3-zope-interface-5.4.0-5.el9.1.x 805 kB/s | 168 kB 00:00 2024-05-15T14:29:39.567 INFO:teuthology.orchestra.run.smithi018.stdout:(19/21): python3-libxml2-2.9.13-6.el9.x86_64.rp 1.6 MB/s | 226 kB 00:00 2024-05-15T14:29:39.600 INFO:teuthology.orchestra.run.smithi018.stdout:(20/21): libxml2-2.9.13-6.el9.x86_64.rpm 2.7 MB/s | 748 kB 00:00 2024-05-15T14:29:40.350 INFO:teuthology.orchestra.run.smithi018.stdout:(21/21): python3-twisted-22.10.0-3.el9.noarch.r 4.2 MB/s | 5.1 MB 00:01 2024-05-15T14:29:40.353 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-05-15T14:29:40.354 INFO:teuthology.orchestra.run.smithi018.stdout:Total 2.6 MB/s | 8.9 MB 00:03 2024-05-15T14:29:40.497 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-05-15T14:29:40.530 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-05-15T14:29:40.531 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-05-15T14:29:40.803 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-05-15T14:29:40.803 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-05-15T14:29:41.795 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-05-15T14:29:41.893 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 1/23 2024-05-15T14:29:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : libxml2-2.9.13-6.el9.x86_64 2/23 2024-05-15T14:29:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-Automat-22.10.0-2.el9.noarch 3/23 2024-05-15T14:29:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-service-identity-21.1.0-5.el9.noarch 4/23 2024-05-15T14:29:42.093 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zope-interface-5.4.0-5.el9.1.x86_64 5/23 2024-05-15T14:29:42.145 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-incremental-21.3.0-5.el9.noarch 6/23 2024-05-15T14:29:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-hyperlink-21.0.0-10.el9.noarch 7/23 2024-05-15T14:29:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-constantly-15.1.0-25.el9.noarch 8/23 2024-05-15T14:29:43.303 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-twisted+tls-22.10.0-3.el9.noarch 9/23 2024-05-15T14:29:43.368 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-twisted-22.10.0-3.el9.noarch 10/23 2024-05-15T14:29:43.409 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 11/23 2024-05-15T14:29:43.550 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xz-devel-5.2.5-8.el9.x86_64 12/23 2024-05-15T14:29:43.595 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tornado-6.1.0-9.el9.x86_64 13/23 2024-05-15T14:29:43.624 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgpg-error-devel-1.42-5.el9.x86_64 14/23 2024-05-15T14:29:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cmake-filesystem-3.26.5-2.el9.x86_64 15/23 2024-05-15T14:29:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libxml2-devel-2.9.13-6.el9.x86_64 16/23 2024-05-15T14:29:44.018 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libxslt-devel-1.1.34-9.el9.x86_64 17/23 2024-05-15T14:29:44.069 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pika-1.2.1-1.el9.noarch 18/23 2024-05-15T14:29:44.135 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : python3-libxml2-2.9.13-6.el9.x86_64 19/23 2024-05-15T14:29:44.182 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 20/23 2024-05-15T14:29:44.207 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libevent-devel-2.1.12-6.el9.x86_64 21/23 2024-05-15T14:29:44.232 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : python3-libxml2-2.9.13-5.el9.x86_64 22/23 2024-05-15T14:29:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : libxml2-2.9.13-5.el9.x86_64 23/23 2024-05-15T14:29:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libxml2-2.9.13-5.el9.x86_64 23/23 2024-05-15T14:29:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cmake-filesystem-3.26.5-2.el9.x86_64 1/23 2024-05-15T14:29:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libevent-devel-2.1.12-6.el9.x86_64 2/23 2024-05-15T14:29:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgpg-error-devel-1.42-5.el9.x86_64 3/23 2024-05-15T14:29:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libxml2-devel-2.9.13-6.el9.x86_64 4/23 2024-05-15T14:29:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libxslt-devel-1.1.34-9.el9.x86_64 5/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 6/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tornado-6.1.0-9.el9.x86_64 7/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xz-devel-5.2.5-8.el9.x86_64 8/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 9/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-Automat-22.10.0-2.el9.noarch 10/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-constantly-15.1.0-25.el9.noarch 11/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-hyperlink-21.0.0-10.el9.noarch 12/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-incremental-21.3.0-5.el9.noarch 13/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pika-1.2.1-1.el9.noarch 14/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-service-identity-21.1.0-5.el9.noarch 15/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-twisted+tls-22.10.0-3.el9.noarch 16/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-twisted-22.10.0-3.el9.noarch 17/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 18/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zope-interface-5.4.0-5.el9.1.x86_64 19/23 2024-05-15T14:29:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libxml2-2.9.13-6.el9.x86_64 20/23 2024-05-15T14:29:47.693 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libxml2-2.9.13-5.el9.x86_64 21/23 2024-05-15T14:29:47.693 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-libxml2-2.9.13-6.el9.x86_64 22/23 2024-05-15T14:29:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-libxml2-2.9.13-5.el9.x86_64 23/23 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: libxml2-2.9.13-6.el9.x86_64 python3-libxml2-2.9.13-6.el9.x86_64 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: cmake-filesystem-3.26.5-2.el9.x86_64 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: libevent-devel-2.1.12-6.el9.x86_64 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: libgpg-error-devel-1.42-5.el9.x86_64 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: libxml2-devel-2.9.13-6.el9.x86_64 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: libxslt-devel-1.1.34-9.el9.x86_64 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-Automat-22.10.0-2.el9.noarch 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-constantly-15.1.0-25.el9.noarch 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-hyperlink-21.0.0-10.el9.noarch 2024-05-15T14:29:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: python3-incremental-21.3.0-5.el9.noarch 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pika-1.2.1-1.el9.noarch 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: python3-service-identity-21.1.0-5.el9.noarch 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tornado-6.1.0-9.el9.x86_64 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: python3-twisted-22.10.0-3.el9.noarch 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: python3-twisted+tls-22.10.0-3.el9.noarch 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zope-interface-5.4.0-5.el9.1.x86_64 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: xz-devel-5.2.5-8.el9.x86_64 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:29:48.410 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-05-15T14:29:51.721 INFO:teuthology.orchestra.run.smithi018.stdout:Requirement already satisfied: pip in ./virtualenv/lib/python3.9/site-packages (21.3.1) 2024-05-15T14:29:52.043 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting pip 2024-05-15T14:29:52.208 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-05-15T14:29:52.726 INFO:teuthology.orchestra.run.smithi018.stdout:Installing collected packages: pip 2024-05-15T14:29:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: Attempting uninstall: pip 2024-05-15T14:29:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: Found existing installation: pip 21.3.1 2024-05-15T14:29:52.923 INFO:teuthology.orchestra.run.smithi018.stdout: Uninstalling pip-21.3.1: 2024-05-15T14:29:52.929 INFO:teuthology.orchestra.run.smithi018.stdout: Successfully uninstalled pip-21.3.1 2024-05-15T14:29:53.986 INFO:teuthology.orchestra.run.smithi018.stdout:Successfully installed pip-24.0 2024-05-15T14:29:54.840 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting nose>=1.0.0 (from -r requirements.txt (line 1)) 2024-05-15T14:29:54.940 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading nose-1.3.7-py3-none-any.whl.metadata (1.7 kB) 2024-05-15T14:29:55.081 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting boto>=2.6.0 (from -r requirements.txt (line 2)) 2024-05-15T14:29:55.108 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading boto-2.49.0-py2.py3-none-any.whl.metadata (7.3 kB) 2024-05-15T14:29:55.819 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting boto3>=1.0.0 (from -r requirements.txt (line 3)) 2024-05-15T14:29:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading boto3-1.34.105-py3-none-any.whl.metadata (6.6 kB) 2024-05-15T14:29:55.966 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting configparser>=5.0.0 (from -r requirements.txt (line 4)) 2024-05-15T14:29:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading configparser-7.0.0-py3-none-any.whl.metadata (5.4 kB) 2024-05-15T14:29:56.183 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting kafka-python>=2.0.0 (from -r requirements.txt (line 5)) 2024-05-15T14:29:56.226 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading kafka_python-2.0.2-py2.py3-none-any.whl.metadata (7.8 kB) 2024-05-15T14:29:56.278 INFO:teuthology.orchestra.run.smithi018.stdout:Requirement already satisfied: pika in /usr/lib/python3.9/site-packages (from -r requirements.txt (line 6)) (1.2.1) 2024-05-15T14:29:56.377 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting pika (from -r requirements.txt (line 6)) 2024-05-15T14:29:56.410 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading pika-1.3.2-py3-none-any.whl.metadata (13 kB) 2024-05-15T14:29:56.584 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting cloudevents (from -r requirements.txt (line 7)) 2024-05-15T14:29:56.636 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading cloudevents-1.10.1-py3-none-any.whl.metadata (6.9 kB) 2024-05-15T14:29:56.689 INFO:teuthology.orchestra.run.smithi018.stdout:Requirement already satisfied: xmltodict in /usr/lib/python3.9/site-packages (from -r requirements.txt (line 8)) (0.12.0) 2024-05-15T14:29:56.800 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting xmltodict (from -r requirements.txt (line 8)) 2024-05-15T14:29:56.842 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading xmltodict-0.13.0-py2.py3-none-any.whl.metadata (7.7 kB) 2024-05-15T14:29:57.631 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting botocore<1.35.0,>=1.34.105 (from boto3>=1.0.0->-r requirements.txt (line 3)) 2024-05-15T14:29:57.682 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading botocore-1.34.105-py3-none-any.whl.metadata (5.7 kB) 2024-05-15T14:29:57.837 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3>=1.0.0->-r requirements.txt (line 3)) 2024-05-15T14:29:57.876 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-05-15T14:29:58.027 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3>=1.0.0->-r requirements.txt (line 3)) 2024-05-15T14:29:58.055 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading s3transfer-0.10.1-py3-none-any.whl.metadata (1.7 kB) 2024-05-15T14:29:58.221 INFO:teuthology.orchestra.run.smithi018.stdout:Collecting deprecation<3.0,>=2.0 (from cloudevents->-r requirements.txt (line 7)) 2024-05-15T14:29:58.281 INFO:teuthology.orchestra.run.smithi018.stdout: Downloading deprecation-2.1.0-py2.py3-none-any.whl.metadata (4.6 kB) 2024-05-15T14:29:58.345 INFO:teuthology.orchestra.run.smithi018.stdout:Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3.9/site-packages (from botocore<1.35.0,>=1.34.105->boto3>=1.0.0->-r requirements.txt (line 3)) (2.8.1) 2024-05-15T14:29:58.346 INFO:teuthology.orchestra.run.smithi018.stdout:Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.35.0,>=1.34.105->boto3>=1.0.0->-r requirements.txt (line 3)) (1.26.5) 2024-05-15T14:29:58.348 INFO:teuthology.orchestra.run.smithi018.stdout:Requirement already satisfied: packaging in /usr/lib/python3.9/site-packages (from deprecation<3.0,>=2.0->cloudevents->-r requirements.txt (line 7)) (20.9) 2024-05-15T14:29:58.465 INFO:teuthology.orchestra.run.smithi018.stdout:Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.105->boto3>=1.0.0->-r requirements.txt (line 3)) (1.15.0) 2024-05-15T14:29:58.472 INFO:teuthology.orchestra.run.smithi018.stdout:Requirement already satisfied: pyparsing>=2.0.2 in /usr/lib/python3.9/site-packages (from packaging->deprecation<3.0,>=2.0->cloudevents->-r requirements.txt (line 7)) (2.4.7) 2024-05-15T14:29:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading nose-1.3.7-py3-none-any.whl (154 kB) 2024-05-15T14:29:58.588 INFO:teuthology.orchestra.run.smithi018.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 154.7/154.7 kB 1.7 MB/s eta 0:00:00 2024-05-15T14:29:58.614 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading boto-2.49.0-py2.py3-none-any.whl (1.4 MB) 2024-05-15T14:29:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 7.9 MB/s eta 0:00:00 2024-05-15T14:29:58.811 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading boto3-1.34.105-py3-none-any.whl (139 kB) 2024-05-15T14:29:58.864 INFO:teuthology.orchestra.run.smithi018.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 2.5 MB/s eta 0:00:00 2024-05-15T14:29:58.884 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading configparser-7.0.0-py3-none-any.whl (16 kB) 2024-05-15T14:29:58.960 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading kafka_python-2.0.2-py2.py3-none-any.whl (246 kB) 2024-05-15T14:29:59.024 INFO:teuthology.orchestra.run.smithi018.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 246.5/246.5 kB 3.8 MB/s eta 0:00:00 2024-05-15T14:29:59.047 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading pika-1.3.2-py3-none-any.whl (155 kB) 2024-05-15T14:29:59.100 INFO:teuthology.orchestra.run.smithi018.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.4/155.4 kB 2.9 MB/s eta 0:00:00 2024-05-15T14:29:59.122 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading cloudevents-1.10.1-py3-none-any.whl (55 kB) 2024-05-15T14:29:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.0/55.0 kB 885.5 kB/s eta 0:00:00 2024-05-15T14:29:59.198 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading xmltodict-0.13.0-py2.py3-none-any.whl (10.0 kB) 2024-05-15T14:29:59.278 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading botocore-1.34.105-py3-none-any.whl (12.2 MB) 2024-05-15T14:30:00.145 INFO:teuthology.orchestra.run.smithi018.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.2/12.2 MB 14.6 MB/s eta 0:00:00 2024-05-15T14:30:00.184 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading deprecation-2.1.0-py2.py3-none-any.whl (11 kB) 2024-05-15T14:30:00.278 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-05-15T14:30:00.372 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading s3transfer-0.10.1-py3-none-any.whl (82 kB) 2024-05-15T14:30:00.437 INFO:teuthology.orchestra.run.smithi018.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.2/82.2 kB 1.2 MB/s eta 0:00:00 2024-05-15T14:30:00.855 INFO:teuthology.orchestra.run.smithi018.stdout:Installing collected packages: nose, kafka-python, boto, xmltodict, pika, jmespath, configparser, deprecation, botocore, s3transfer, cloudevents, boto3 2024-05-15T14:30:01.734 INFO:teuthology.orchestra.run.smithi018.stdout: Attempting uninstall: xmltodict 2024-05-15T14:30:01.735 INFO:teuthology.orchestra.run.smithi018.stdout: Found existing installation: xmltodict 0.12.0 2024-05-15T14:30:01.736 INFO:teuthology.orchestra.run.smithi018.stdout: Not uninstalling xmltodict at /usr/lib/python3.9/site-packages, outside environment /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv 2024-05-15T14:30:01.736 INFO:teuthology.orchestra.run.smithi018.stdout: Can't uninstall 'xmltodict'. No files were found to uninstall. 2024-05-15T14:30:01.793 INFO:teuthology.orchestra.run.smithi018.stdout: Attempting uninstall: pika 2024-05-15T14:30:01.794 INFO:teuthology.orchestra.run.smithi018.stdout: Found existing installation: pika 1.2.1 2024-05-15T14:30:01.794 INFO:teuthology.orchestra.run.smithi018.stdout: Not uninstalling pika at /usr/lib/python3.9/site-packages, outside environment /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv 2024-05-15T14:30:01.794 INFO:teuthology.orchestra.run.smithi018.stdout: Can't uninstall 'pika'. No files were found to uninstall. 2024-05-15T14:30:02.981 INFO:teuthology.orchestra.run.smithi018.stdout:Successfully installed boto-2.49.0 boto3-1.34.105 botocore-1.34.105 cloudevents-1.10.1 configparser-7.0.0 deprecation-2.1.0 jmespath-1.0.1 kafka-python-2.0.2 nose-1.3.7 pika-1.3.2 s3transfer-0.10.1 xmltodict-0.13.0 2024-05-15T14:30:03.361 INFO:teuthology.orchestra.run.smithi018.stdout:running develop 2024-05-15T14:30:03.445 INFO:teuthology.orchestra.run.smithi018.stdout:running egg_info 2024-05-15T14:30:03.445 INFO:teuthology.orchestra.run.smithi018.stdout:creating bn_tests.egg-info 2024-05-15T14:30:03.445 INFO:teuthology.orchestra.run.smithi018.stdout:writing bn_tests.egg-info/PKG-INFO 2024-05-15T14:30:03.445 INFO:teuthology.orchestra.run.smithi018.stdout:writing dependency_links to bn_tests.egg-info/dependency_links.txt 2024-05-15T14:30:03.445 INFO:teuthology.orchestra.run.smithi018.stdout:writing requirements to bn_tests.egg-info/requires.txt 2024-05-15T14:30:03.445 INFO:teuthology.orchestra.run.smithi018.stdout:writing top-level names to bn_tests.egg-info/top_level.txt 2024-05-15T14:30:03.445 INFO:teuthology.orchestra.run.smithi018.stdout:writing manifest file 'bn_tests.egg-info/SOURCES.txt' 2024-05-15T14:30:03.446 INFO:teuthology.orchestra.run.smithi018.stdout:reading manifest file 'bn_tests.egg-info/SOURCES.txt' 2024-05-15T14:30:03.446 INFO:teuthology.orchestra.run.smithi018.stdout:writing manifest file 'bn_tests.egg-info/SOURCES.txt' 2024-05-15T14:30:03.458 INFO:teuthology.orchestra.run.smithi018.stdout:running build_ext 2024-05-15T14:30:03.467 INFO:teuthology.orchestra.run.smithi018.stdout:Creating /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages/bn-tests.egg-link (link to .) 2024-05-15T14:30:03.467 INFO:teuthology.orchestra.run.smithi018.stdout:Adding bn-tests 0.0.1 to easy-install.pth file 2024-05-15T14:30:03.468 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.468 INFO:teuthology.orchestra.run.smithi018.stdout:Installed /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification 2024-05-15T14:30:03.469 INFO:teuthology.orchestra.run.smithi018.stdout:Processing dependencies for bn-tests==0.0.1 2024-05-15T14:30:03.483 INFO:teuthology.orchestra.run.smithi018.stdout:Searching for boto3==1.34.105 2024-05-15T14:30:03.483 INFO:teuthology.orchestra.run.smithi018.stdout:Best match: boto3 1.34.105 2024-05-15T14:30:03.483 INFO:teuthology.orchestra.run.smithi018.stdout:Adding boto3 1.34.105 to easy-install.pth file 2024-05-15T14:30:03.483 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.483 INFO:teuthology.orchestra.run.smithi018.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2024-05-15T14:30:03.484 INFO:teuthology.orchestra.run.smithi018.stdout:Searching for boto==2.49.0 2024-05-15T14:30:03.484 INFO:teuthology.orchestra.run.smithi018.stdout:Best match: boto 2.49.0 2024-05-15T14:30:03.484 INFO:teuthology.orchestra.run.smithi018.stdout:Adding boto 2.49.0 to easy-install.pth file 2024-05-15T14:30:03.484 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.484 INFO:teuthology.orchestra.run.smithi018.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2024-05-15T14:30:03.485 INFO:teuthology.orchestra.run.smithi018.stdout:Searching for jmespath==1.0.1 2024-05-15T14:30:03.485 INFO:teuthology.orchestra.run.smithi018.stdout:Best match: jmespath 1.0.1 2024-05-15T14:30:03.486 INFO:teuthology.orchestra.run.smithi018.stdout:Adding jmespath 1.0.1 to easy-install.pth file 2024-05-15T14:30:03.486 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.486 INFO:teuthology.orchestra.run.smithi018.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2024-05-15T14:30:03.486 INFO:teuthology.orchestra.run.smithi018.stdout:Searching for botocore==1.34.105 2024-05-15T14:30:03.486 INFO:teuthology.orchestra.run.smithi018.stdout:Best match: botocore 1.34.105 2024-05-15T14:30:03.486 INFO:teuthology.orchestra.run.smithi018.stdout:Adding botocore 1.34.105 to easy-install.pth file 2024-05-15T14:30:03.486 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.486 INFO:teuthology.orchestra.run.smithi018.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2024-05-15T14:30:03.487 INFO:teuthology.orchestra.run.smithi018.stdout:Searching for s3transfer==0.10.1 2024-05-15T14:30:03.487 INFO:teuthology.orchestra.run.smithi018.stdout:Best match: s3transfer 0.10.1 2024-05-15T14:30:03.487 INFO:teuthology.orchestra.run.smithi018.stdout:Adding s3transfer 0.10.1 to easy-install.pth file 2024-05-15T14:30:03.487 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.487 INFO:teuthology.orchestra.run.smithi018.stdout:Using /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.9/site-packages 2024-05-15T14:30:03.488 INFO:teuthology.orchestra.run.smithi018.stdout:Searching for python-dateutil==2.8.1 2024-05-15T14:30:03.488 INFO:teuthology.orchestra.run.smithi018.stdout:Best match: python-dateutil 2.8.1 2024-05-15T14:30:03.488 INFO:teuthology.orchestra.run.smithi018.stdout:Adding python-dateutil 2.8.1 to easy-install.pth file 2024-05-15T14:30:03.488 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.488 INFO:teuthology.orchestra.run.smithi018.stdout:Using /usr/lib/python3.9/site-packages 2024-05-15T14:30:03.494 INFO:teuthology.orchestra.run.smithi018.stdout:Searching for urllib3==1.26.5 2024-05-15T14:30:03.494 INFO:teuthology.orchestra.run.smithi018.stdout:Best match: urllib3 1.26.5 2024-05-15T14:30:03.494 INFO:teuthology.orchestra.run.smithi018.stdout:Adding urllib3 1.26.5 to easy-install.pth file 2024-05-15T14:30:03.494 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.494 INFO:teuthology.orchestra.run.smithi018.stdout:Using /usr/lib/python3.9/site-packages 2024-05-15T14:30:03.495 INFO:teuthology.orchestra.run.smithi018.stdout:Searching for six==1.15.0 2024-05-15T14:30:03.495 INFO:teuthology.orchestra.run.smithi018.stdout:Best match: six 1.15.0 2024-05-15T14:30:03.495 INFO:teuthology.orchestra.run.smithi018.stdout:Adding six 1.15.0 to easy-install.pth file 2024-05-15T14:30:03.495 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:30:03.495 INFO:teuthology.orchestra.run.smithi018.stdout:Using /usr/lib/python3.9/site-packages 2024-05-15T14:30:03.495 INFO:teuthology.orchestra.run.smithi018.stdout:Finished processing dependencies for bn-tests==0.0.1 2024-05-15T14:30:03.513 INFO:tasks.notification_tests:Running bucket-notifications-tests... 2024-05-15T14:30:03.514 DEBUG:teuthology.orchestra.run.smithi018:bucket notification tests against different endpoints> BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a '!kafka_test,!amqp_test,!amqp_ssl_test,!kafka_security_test,!modification_required,!manual_test' 2024-05-15T14:30:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:test s3 topics set/get/delete on master ... ignoring --setuser ceph since I am not root 2024-05-15T14:30:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:04.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.040+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.042+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.042+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.043+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.043+0000 7f991ad2b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:04.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.043+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.043+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.043+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.044+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:04.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.044+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.044+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:04.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.044+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.044+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.044+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.045+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.045+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 20 zone MyZone found 2024-05-15T14:30:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.046+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.047+0000 7f991ad2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.047+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.047+0000 7f991ad2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.047+0000 7f991ad2b800 20 started sync module instance, tier type = 2024-05-15T14:30:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.047+0000 7f991ad2b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:04.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.058+0000 7f991ad2b800 20 add_watcher() i=0 2024-05-15T14:30:04.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.058+0000 7f991ad2b800 20 add_watcher() i=1 2024-05-15T14:30:04.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.058+0000 7f991ad2b800 20 add_watcher() i=2 2024-05-15T14:30:04.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.058+0000 7f991ad2b800 20 add_watcher() i=3 2024-05-15T14:30:04.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.058+0000 7f991ad2b800 20 add_watcher() i=4 2024-05-15T14:30:04.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.058+0000 7f991ad2b800 20 add_watcher() i=5 2024-05-15T14:30:04.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.058+0000 7f991ad2b800 20 add_watcher() i=6 2024-05-15T14:30:04.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.059+0000 7f991ad2b800 20 add_watcher() i=7 2024-05-15T14:30:04.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.059+0000 7f991ad2b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:04.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.061+0000 7f97cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.061+0000 7f991ad2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:04.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.061+0000 7f991ad2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:04.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.061+0000 7f991ad2b800 5 note: GC not initialized 2024-05-15T14:30:04.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.061+0000 7f9747fff640 20 reqs_thread_entry: start 2024-05-15T14:30:04.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.061+0000 7f991ad2b800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:04.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 20 Filter name: none 2024-05-15T14:30:04.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f9745ffb640 20 reqs_thread_entry: start 2024-05-15T14:30:04.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 10 cache get: name=MyZone.rgw.meta+users.uid+kaboom$superman1715783403.954869 : miss 2024-05-15T14:30:04.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom$superman1715783403.954869 info.flags=0x0 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 10 adding MyZone.rgw.meta+users.uid+kaboom$superman1715783403.954869 to cache LRU end 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783403.9548607 : miss 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783403.9548607 info.flags=0x0 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 10 adding MyZone.rgw.meta+users.keys+1715783403.9548607 to cache LRU end 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783403.9548607 : hit (negative entry) 2024-05-15T14:30:04.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.062+0000 7f991ad2b800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783403.9548607 : hit (negative entry) 2024-05-15T14:30:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.064+0000 7f991ad2b800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom$superman1715783403.954869 info.flags=0x17 2024-05-15T14:30:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.064+0000 7f991ad2b800 10 moving MyZone.rgw.meta+users.uid+kaboom$superman1715783403.954869 to cache LRU end 2024-05-15T14:30:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.064+0000 7f991ad2b800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:kaboom$superman1715783403.954869, ofs0, ns] 2024-05-15T14:30:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.064+0000 7f97fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94155231630752 notifier 4649 bl.length()=597 2024-05-15T14:30:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.064+0000 7f97fa7fc640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+kaboom$superman1715783403.954869 info.flags=0x17 2024-05-15T14:30:04.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.064+0000 7f97fa7fc640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+kaboom$superman1715783403.954869 to cache LRU end 2024-05-15T14:30:04.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.066+0000 7f991ad2b800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783403.9548607 info.flags=0x7 2024-05-15T14:30:04.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.066+0000 7f991ad2b800 10 moving MyZone.rgw.meta+users.keys+1715783403.9548607 to cache LRU end 2024-05-15T14:30:04.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.066+0000 7f991ad2b800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715783403.9548607, ofs0, ns] 2024-05-15T14:30:04.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.067+0000 7f97fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94155231630752 notifier 4649 bl.length()=203 2024-05-15T14:30:04.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.067+0000 7f97fa7fc640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715783403.9548607 info.flags=0x7 2024-05-15T14:30:04.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.067+0000 7f97fa7fc640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715783403.9548607 to cache LRU end 2024-05-15T14:30:04.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.068+0000 7f97cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.071+0000 7f991ad2b800 20 remove_watcher() i=0 2024-05-15T14:30:04.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.071+0000 7f991ad2b800 2 removed watcher, disabling cache 2024-05-15T14:30:04.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.072+0000 7f991ad2b800 20 remove_watcher() i=1 2024-05-15T14:30:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.073+0000 7f991ad2b800 20 remove_watcher() i=2 2024-05-15T14:30:04.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.074+0000 7f991ad2b800 20 remove_watcher() i=3 2024-05-15T14:30:04.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.075+0000 7f991ad2b800 20 remove_watcher() i=4 2024-05-15T14:30:04.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.076+0000 7f991ad2b800 20 remove_watcher() i=5 2024-05-15T14:30:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.077+0000 7f991ad2b800 20 remove_watcher() i=6 2024-05-15T14:30:04.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.078+0000 7f991ad2b800 20 remove_watcher() i=7 2024-05-15T14:30:04.129 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:04.129 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:04.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.168+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.170+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.170+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.171+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.171+0000 7f6762f2b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:04.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.171+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.171+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.171+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.172+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:04.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.172+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.172+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.172+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.172+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.172+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.173+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.173+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.174+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.174+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 zone MyZone found 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 started sync module instance, tier type = 2024-05-15T14:30:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.175+0000 7f6762f2b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:04.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.186+0000 7f6762f2b800 20 add_watcher() i=0 2024-05-15T14:30:04.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.186+0000 7f6762f2b800 20 add_watcher() i=1 2024-05-15T14:30:04.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.186+0000 7f6762f2b800 20 add_watcher() i=2 2024-05-15T14:30:04.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.186+0000 7f6762f2b800 20 add_watcher() i=3 2024-05-15T14:30:04.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.186+0000 7f6762f2b800 20 add_watcher() i=4 2024-05-15T14:30:04.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.186+0000 7f6762f2b800 20 add_watcher() i=5 2024-05-15T14:30:04.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.186+0000 7f6762f2b800 20 add_watcher() i=6 2024-05-15T14:30:04.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.187+0000 7f6762f2b800 20 add_watcher() i=7 2024-05-15T14:30:04.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.187+0000 7f6762f2b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:04.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.188+0000 7f66157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.189+0000 7f6762f2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.189+0000 7f6762f2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.189+0000 7f6762f2b800 5 note: GC not initialized 2024-05-15T14:30:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.189+0000 7f658ffff640 20 reqs_thread_entry: start 2024-05-15T14:30:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.189+0000 7f6762f2b800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.189+0000 7f6762f2b800 20 Filter name: none 2024-05-15T14:30:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.189+0000 7f658dffb640 20 reqs_thread_entry: start 2024-05-15T14:30:04.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.200+0000 7f66157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.202+0000 7f6762f2b800 20 remove_watcher() i=0 2024-05-15T14:30:04.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.202+0000 7f6762f2b800 2 removed watcher, disabling cache 2024-05-15T14:30:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.203+0000 7f6762f2b800 20 remove_watcher() i=1 2024-05-15T14:30:04.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.204+0000 7f6762f2b800 20 remove_watcher() i=2 2024-05-15T14:30:04.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.205+0000 7f6762f2b800 20 remove_watcher() i=3 2024-05-15T14:30:04.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.206+0000 7f6762f2b800 20 remove_watcher() i=4 2024-05-15T14:30:04.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.207+0000 7f6762f2b800 20 remove_watcher() i=5 2024-05-15T14:30:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.208+0000 7f6762f2b800 20 remove_watcher() i=6 2024-05-15T14:30:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.209+0000 7f6762f2b800 20 remove_watcher() i=7 2024-05-15T14:30:04.385 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:30:04.432 INFO:teuthology.orchestra.run.smithi018.stderr:test s3 topics set/get/delete on master ... ignoring --setuser ceph since I am not root 2024-05-15T14:30:04.432 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.471+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.472+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.472+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.473+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.473+0000 7f120fd27800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.473+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.473+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.473+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.474+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.474+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.475+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.475+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.475+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.475+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.476+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.476+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.476+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.476+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 20 zone MyZone found 2024-05-15T14:30:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.477+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.478+0000 7f120fd27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.478+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.478+0000 7f120fd27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.478+0000 7f120fd27800 20 started sync module instance, tier type = 2024-05-15T14:30:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.478+0000 7f120fd27800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:04.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.488+0000 7f120fd27800 20 add_watcher() i=0 2024-05-15T14:30:04.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.488+0000 7f120fd27800 20 add_watcher() i=1 2024-05-15T14:30:04.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.488+0000 7f120fd27800 20 add_watcher() i=2 2024-05-15T14:30:04.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.488+0000 7f120fd27800 20 add_watcher() i=3 2024-05-15T14:30:04.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.488+0000 7f120fd27800 20 add_watcher() i=4 2024-05-15T14:30:04.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.488+0000 7f120fd27800 20 add_watcher() i=5 2024-05-15T14:30:04.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.488+0000 7f120fd27800 20 add_watcher() i=6 2024-05-15T14:30:04.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.489+0000 7f120fd27800 20 add_watcher() i=7 2024-05-15T14:30:04.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.489+0000 7f120fd27800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:04.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.491+0000 7f10c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:04.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:04.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 5 note: GC not initialized 2024-05-15T14:30:04.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f10c0fe1640 20 reqs_thread_entry: start 2024-05-15T14:30:04.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:04.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 20 Filter name: none 2024-05-15T14:30:04.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f103a7fc640 20 reqs_thread_entry: start 2024-05-15T14:30:04.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 10 cache get: name=MyZone.rgw.meta+users.uid+kaboom$superman1715783404.3860426 : miss 2024-05-15T14:30:04.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom$superman1715783404.3860426 info.flags=0x0 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 10 adding MyZone.rgw.meta+users.uid+kaboom$superman1715783404.3860426 to cache LRU end 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783404.3860347 : miss 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.492+0000 7f120fd27800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.493+0000 7f120fd27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.493+0000 7f120fd27800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783404.3860347 info.flags=0x0 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.493+0000 7f120fd27800 10 adding MyZone.rgw.meta+users.keys+1715783404.3860347 to cache LRU end 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.493+0000 7f120fd27800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783404.3860347 : hit (negative entry) 2024-05-15T14:30:04.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.493+0000 7f120fd27800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783404.3860347 : hit (negative entry) 2024-05-15T14:30:04.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.494+0000 7f120fd27800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom$superman1715783404.3860426 info.flags=0x17 2024-05-15T14:30:04.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.494+0000 7f120fd27800 10 moving MyZone.rgw.meta+users.uid+kaboom$superman1715783404.3860426 to cache LRU end 2024-05-15T14:30:04.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.494+0000 7f120fd27800 10 distributing notification oid=MyZone.rgw.control:notify.1 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:kaboom$superman1715783404.3860426, ofs0, ns] 2024-05-15T14:30:04.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.494+0000 7f10eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94641180427936 notifier 4785 bl.length()=600 2024-05-15T14:30:04.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.494+0000 7f10eaffd640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+kaboom$superman1715783404.3860426 info.flags=0x17 2024-05-15T14:30:04.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.494+0000 7f10eaffd640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+kaboom$superman1715783404.3860426 to cache LRU end 2024-05-15T14:30:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.496+0000 7f120fd27800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783404.3860347 info.flags=0x7 2024-05-15T14:30:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.496+0000 7f120fd27800 10 moving MyZone.rgw.meta+users.keys+1715783404.3860347 to cache LRU end 2024-05-15T14:30:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.496+0000 7f120fd27800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715783404.3860347, ofs0, ns] 2024-05-15T14:30:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.496+0000 7f10eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94641180426880 notifier 4785 bl.length()=204 2024-05-15T14:30:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.496+0000 7f10eaffd640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715783404.3860347 info.flags=0x7 2024-05-15T14:30:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.496+0000 7f10eaffd640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715783404.3860347 to cache LRU end 2024-05-15T14:30:04.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.498+0000 7f10c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.500+0000 7f120fd27800 20 remove_watcher() i=0 2024-05-15T14:30:04.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.500+0000 7f120fd27800 2 removed watcher, disabling cache 2024-05-15T14:30:04.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.501+0000 7f120fd27800 20 remove_watcher() i=1 2024-05-15T14:30:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.502+0000 7f120fd27800 20 remove_watcher() i=2 2024-05-15T14:30:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.503+0000 7f120fd27800 20 remove_watcher() i=3 2024-05-15T14:30:04.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.504+0000 7f120fd27800 20 remove_watcher() i=4 2024-05-15T14:30:04.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.505+0000 7f120fd27800 20 remove_watcher() i=5 2024-05-15T14:30:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.506+0000 7f120fd27800 20 remove_watcher() i=6 2024-05-15T14:30:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.507+0000 7f120fd27800 20 remove_watcher() i=7 2024-05-15T14:30:04.558 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:04.558 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:04.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.597+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.599+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.599+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.600+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.600+0000 7fce2cd33800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.600+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.600+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.600+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.601+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:04.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.601+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.601+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.601+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.601+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.601+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.602+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.602+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.602+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.602+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 20 zone MyZone found 2024-05-15T14:30:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.603+0000 7fce2cd33800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.604+0000 7fce2cd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.604+0000 7fce2cd33800 20 started sync module instance, tier type = 2024-05-15T14:30:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.604+0000 7fce2cd33800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:04.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.614+0000 7fce2cd33800 20 add_watcher() i=0 2024-05-15T14:30:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.614+0000 7fce2cd33800 20 add_watcher() i=1 2024-05-15T14:30:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.614+0000 7fce2cd33800 20 add_watcher() i=2 2024-05-15T14:30:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.614+0000 7fce2cd33800 20 add_watcher() i=3 2024-05-15T14:30:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.614+0000 7fce2cd33800 20 add_watcher() i=4 2024-05-15T14:30:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.614+0000 7fce2cd33800 20 add_watcher() i=5 2024-05-15T14:30:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.614+0000 7fce2cd33800 20 add_watcher() i=6 2024-05-15T14:30:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.615+0000 7fce2cd33800 20 add_watcher() i=7 2024-05-15T14:30:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.615+0000 7fce2cd33800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:04.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.617+0000 7fccdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.617+0000 7fce2cd33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.617+0000 7fce2cd33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.617+0000 7fce2cd33800 5 note: GC not initialized 2024-05-15T14:30:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.617+0000 7fccde7e4640 20 reqs_thread_entry: start 2024-05-15T14:30:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.618+0000 7fce2cd33800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.618+0000 7fce2cd33800 20 Filter name: none 2024-05-15T14:30:04.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.618+0000 7fccd77fe640 20 reqs_thread_entry: start 2024-05-15T14:30:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.627+0000 7fccdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.629+0000 7fce2cd33800 20 remove_watcher() i=0 2024-05-15T14:30:04.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.629+0000 7fce2cd33800 2 removed watcher, disabling cache 2024-05-15T14:30:04.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.630+0000 7fce2cd33800 20 remove_watcher() i=1 2024-05-15T14:30:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.631+0000 7fce2cd33800 20 remove_watcher() i=2 2024-05-15T14:30:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.632+0000 7fce2cd33800 20 remove_watcher() i=3 2024-05-15T14:30:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.633+0000 7fce2cd33800 20 remove_watcher() i=4 2024-05-15T14:30:04.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.634+0000 7fce2cd33800 20 remove_watcher() i=5 2024-05-15T14:30:04.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.635+0000 7fce2cd33800 20 remove_watcher() i=6 2024-05-15T14:30:04.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.636+0000 7fce2cd33800 20 remove_watcher() i=7 2024-05-15T14:30:04.721 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:04.721 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.760+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.762+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.762+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.763+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.763+0000 7f06dfa13800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.763+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.763+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.763+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.764+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.764+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.764+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.764+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.764+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.764+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.764+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.764+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.765+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.765+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 zone MyZone found 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 started sync module instance, tier type = 2024-05-15T14:30:04.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.766+0000 7f06dfa13800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.776+0000 7f06dfa13800 20 add_watcher() i=0 2024-05-15T14:30:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.776+0000 7f06dfa13800 20 add_watcher() i=1 2024-05-15T14:30:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.776+0000 7f06dfa13800 20 add_watcher() i=2 2024-05-15T14:30:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.776+0000 7f06dfa13800 20 add_watcher() i=3 2024-05-15T14:30:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.776+0000 7f06dfa13800 20 add_watcher() i=4 2024-05-15T14:30:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.776+0000 7f06dfa13800 20 add_watcher() i=5 2024-05-15T14:30:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.776+0000 7f06dfa13800 20 add_watcher() i=6 2024-05-15T14:30:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.777+0000 7f06dfa13800 20 add_watcher() i=7 2024-05-15T14:30:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.777+0000 7f06dfa13800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:04.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.779+0000 7f0591fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.779+0000 7f06dfa13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:04.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.779+0000 7f06dfa13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:04.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.779+0000 7f06dfa13800 5 note: GC not initialized 2024-05-15T14:30:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.779+0000 7f0590fe1640 20 reqs_thread_entry: start 2024-05-15T14:30:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.779+0000 7f06dfa13800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.780+0000 7f06dfa13800 20 Filter name: none 2024-05-15T14:30:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.780+0000 7f050a7fc640 20 reqs_thread_entry: start 2024-05-15T14:30:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.780+0000 7f06dfa13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.780+0000 7f06dfa13800 20 rados_obj.operate() r=0 bl.length=234 2024-05-15T14:30:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.782+0000 7f0591fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.784+0000 7f06dfa13800 20 remove_watcher() i=0 2024-05-15T14:30:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.784+0000 7f06dfa13800 2 removed watcher, disabling cache 2024-05-15T14:30:04.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.785+0000 7f06dfa13800 20 remove_watcher() i=1 2024-05-15T14:30:04.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.786+0000 7f06dfa13800 20 remove_watcher() i=2 2024-05-15T14:30:04.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.787+0000 7f06dfa13800 20 remove_watcher() i=3 2024-05-15T14:30:04.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.788+0000 7f06dfa13800 20 remove_watcher() i=4 2024-05-15T14:30:04.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.789+0000 7f06dfa13800 20 remove_watcher() i=5 2024-05-15T14:30:04.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.790+0000 7f06dfa13800 20 remove_watcher() i=6 2024-05-15T14:30:04.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.791+0000 7f06dfa13800 20 remove_watcher() i=7 2024-05-15T14:30:04.843 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:04.844 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:04.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.883+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.885+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.885+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.886+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.886+0000 7f1a8132d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:04.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.886+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.886+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.886+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.887+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:04.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.887+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.887+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:04.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.887+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.887+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.887+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.888+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:04.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.888+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.888+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:04.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.888+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:04.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 20 zone MyZone found 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.889+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.890+0000 7f1a8132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.890+0000 7f1a8132d800 20 started sync module instance, tier type = 2024-05-15T14:30:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.890+0000 7f1a8132d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.900+0000 7f1a8132d800 20 add_watcher() i=0 2024-05-15T14:30:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.900+0000 7f1a8132d800 20 add_watcher() i=1 2024-05-15T14:30:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.900+0000 7f1a8132d800 20 add_watcher() i=2 2024-05-15T14:30:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.900+0000 7f1a8132d800 20 add_watcher() i=3 2024-05-15T14:30:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.900+0000 7f1a8132d800 20 add_watcher() i=4 2024-05-15T14:30:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.900+0000 7f1a8132d800 20 add_watcher() i=5 2024-05-15T14:30:04.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.900+0000 7f1a8132d800 20 add_watcher() i=6 2024-05-15T14:30:04.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.901+0000 7f1a8132d800 20 add_watcher() i=7 2024-05-15T14:30:04.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.901+0000 7f1a8132d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:04.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.903+0000 7f1932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.903+0000 7f1a8132d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.903+0000 7f1a8132d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.903+0000 7f1a8132d800 5 note: GC not initialized 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1931fe3640 20 reqs_thread_entry: start 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 20 Filter name: none 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f18a37fe640 20 reqs_thread_entry: start 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom : miss 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 10 cache put: name=MyZone.rgw.log++pubsub.kaboom info.flags=0x0 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 10 adding MyZone.rgw.log++pubsub.kaboom to cache LRU end 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom : hit (negative entry) 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 10 cache get: name=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_3 : miss 2024-05-15T14:30:04.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:04.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 20 rados_obj.operate() r=0 bl.length=234 2024-05-15T14:30:04.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 10 cache put: name=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_3 info.flags=0x15 2024-05-15T14:30:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 10 adding MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_3 to cache LRU end 2024-05-15T14:30:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.904+0000 7f1a8132d800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_3 2024-05-15T14:30:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.905+0000 7f1a8132d800 10 removing MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_3 from cache 2024-05-15T14:30:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.905+0000 7f1a8132d800 10 distributing notification oid=MyZone.rgw.control:notify.6 cni=[op: 1, obj: MyZone.rgw.meta:topics:topic.kaboom:vwwrqh-2_topic_3, ofs0, ns] 2024-05-15T14:30:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.906+0000 7f1953fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94209821692592 notifier 4839 bl.length()=174 2024-05-15T14:30:04.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.908+0000 7f1a8132d800 20 WARNING: failed to remove topic buckets obj buckets.kaboom:vwwrqh-2_topic_3 with: (2) No such file or directory 2024-05-15T14:30:04.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.908+0000 7f1932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.911+0000 7f1a8132d800 20 remove_watcher() i=0 2024-05-15T14:30:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.911+0000 7f1a8132d800 2 removed watcher, disabling cache 2024-05-15T14:30:04.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.912+0000 7f1a8132d800 20 remove_watcher() i=1 2024-05-15T14:30:04.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.913+0000 7f1a8132d800 20 remove_watcher() i=2 2024-05-15T14:30:04.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.914+0000 7f1a8132d800 20 remove_watcher() i=3 2024-05-15T14:30:04.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.915+0000 7f1a8132d800 20 remove_watcher() i=4 2024-05-15T14:30:04.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.916+0000 7f1a8132d800 20 remove_watcher() i=5 2024-05-15T14:30:04.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.917+0000 7f1a8132d800 20 remove_watcher() i=6 2024-05-15T14:30:04.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:04.918+0000 7f1a8132d800 20 remove_watcher() i=7 2024-05-15T14:30:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:04.971 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.009+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.011+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.011+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.012+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.012+0000 7f1e57c98800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.012+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.012+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.012+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.013+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:05.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.013+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.013+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:05.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.013+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.013+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.013+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.014+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.014+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.014+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.014+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:05.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 20 zone MyZone found 2024-05-15T14:30:05.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.015+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.016+0000 7f1e57c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.016+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.016+0000 7f1e57c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.016+0000 7f1e57c98800 20 started sync module instance, tier type = 2024-05-15T14:30:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.016+0000 7f1e57c98800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.026+0000 7f1e57c98800 20 add_watcher() i=0 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.026+0000 7f1e57c98800 20 add_watcher() i=1 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.026+0000 7f1e57c98800 20 add_watcher() i=2 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.026+0000 7f1e57c98800 20 add_watcher() i=3 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.026+0000 7f1e57c98800 20 add_watcher() i=4 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.026+0000 7f1e57c98800 20 add_watcher() i=5 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.026+0000 7f1e57c98800 20 add_watcher() i=6 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.027+0000 7f1e57c98800 20 add_watcher() i=7 2024-05-15T14:30:05.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.027+0000 7f1e57c98800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.029+0000 7f1d0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.029+0000 7f1e57c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.029+0000 7f1e57c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.029+0000 7f1e57c98800 5 note: GC not initialized 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.029+0000 7f1d0a7e4640 20 reqs_thread_entry: start 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.029+0000 7f1e57c98800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.029+0000 7f1e57c98800 20 Filter name: none 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.029+0000 7f1c7bfff640 20 reqs_thread_entry: start 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.030+0000 7f1e57c98800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not get topic: 2024-05-15T14:30:05.030+0000 7f1e57c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:(2) No such file or directory 2024-05-15T14:30:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.030+0000 7f1e57c98800 1 failed to read topic info for name: vwwrqh-2_topic_3 tenant: kaboom, ret=-2 2024-05-15T14:30:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.031+0000 7f1d0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.033+0000 7f1e57c98800 20 remove_watcher() i=0 2024-05-15T14:30:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.033+0000 7f1e57c98800 2 removed watcher, disabling cache 2024-05-15T14:30:05.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.034+0000 7f1e57c98800 20 remove_watcher() i=1 2024-05-15T14:30:05.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.035+0000 7f1e57c98800 20 remove_watcher() i=2 2024-05-15T14:30:05.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.036+0000 7f1e57c98800 20 remove_watcher() i=3 2024-05-15T14:30:05.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.037+0000 7f1e57c98800 20 remove_watcher() i=4 2024-05-15T14:30:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.038+0000 7f1e57c98800 20 remove_watcher() i=5 2024-05-15T14:30:05.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.039+0000 7f1e57c98800 20 remove_watcher() i=6 2024-05-15T14:30:05.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.040+0000 7f1e57c98800 20 remove_watcher() i=7 2024-05-15T14:30:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.130+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.131+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.131+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.132+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.132+0000 7f07f05af800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.132+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.132+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.132+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.133+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.133+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.133+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.133+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.134+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.134+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.134+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.134+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 20 zone MyZone found 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.135+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.136+0000 7f07f05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.136+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.136+0000 7f07f05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.136+0000 7f07f05af800 20 started sync module instance, tier type = 2024-05-15T14:30:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.136+0000 7f07f05af800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:05.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.146+0000 7f07f05af800 20 add_watcher() i=0 2024-05-15T14:30:05.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.146+0000 7f07f05af800 20 add_watcher() i=1 2024-05-15T14:30:05.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.146+0000 7f07f05af800 20 add_watcher() i=2 2024-05-15T14:30:05.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.146+0000 7f07f05af800 20 add_watcher() i=3 2024-05-15T14:30:05.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.146+0000 7f07f05af800 20 add_watcher() i=4 2024-05-15T14:30:05.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.146+0000 7f07f05af800 20 add_watcher() i=5 2024-05-15T14:30:05.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.146+0000 7f07f05af800 20 add_watcher() i=6 2024-05-15T14:30:05.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.147+0000 7f07f05af800 20 add_watcher() i=7 2024-05-15T14:30:05.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.147+0000 7f07f05af800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.149+0000 7f06a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.149+0000 7f07f05af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.149+0000 7f07f05af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.149+0000 7f07f05af800 5 note: GC not initialized 2024-05-15T14:30:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.149+0000 7f061f7fe640 20 reqs_thread_entry: start 2024-05-15T14:30:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.149+0000 7f07f05af800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.149+0000 7f07f05af800 20 Filter name: none 2024-05-15T14:30:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.149+0000 7f061d7fa640 20 reqs_thread_entry: start 2024-05-15T14:30:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.158+0000 7f07f05af800 20 RGWRados::pool_iterate: got topic.kaboom:vwwrqh-2_topic_1 2024-05-15T14:30:05.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.158+0000 7f07f05af800 20 RGWRados::pool_iterate: got topic.kaboom:vwwrqh-2_topic_2 2024-05-15T14:30:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.158+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.159+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=288 2024-05-15T14:30:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.159+0000 7f07f05af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.159+0000 7f07f05af800 20 rados_obj.operate() r=0 bl.length=257 2024-05-15T14:30:05.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.161+0000 7f06a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.163+0000 7f07f05af800 20 remove_watcher() i=0 2024-05-15T14:30:05.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.163+0000 7f07f05af800 2 removed watcher, disabling cache 2024-05-15T14:30:05.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.164+0000 7f07f05af800 20 remove_watcher() i=1 2024-05-15T14:30:05.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.165+0000 7f07f05af800 20 remove_watcher() i=2 2024-05-15T14:30:05.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.166+0000 7f07f05af800 20 remove_watcher() i=3 2024-05-15T14:30:05.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.167+0000 7f07f05af800 20 remove_watcher() i=4 2024-05-15T14:30:05.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.168+0000 7f07f05af800 20 remove_watcher() i=5 2024-05-15T14:30:05.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.169+0000 7f07f05af800 20 remove_watcher() i=6 2024-05-15T14:30:05.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.170+0000 7f07f05af800 20 remove_watcher() i=7 2024-05-15T14:30:05.223 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:05.223 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.263+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.264+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.264+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.265+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.265+0000 7fcad8e87800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.265+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.265+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.265+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.266+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.266+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.266+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.266+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.266+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.266+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.267+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.267+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.267+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.267+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:05.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 20 zone MyZone found 2024-05-15T14:30:05.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.268+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.269+0000 7fcad8e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.269+0000 7fcad8e87800 20 started sync module instance, tier type = 2024-05-15T14:30:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.269+0000 7fcad8e87800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.279+0000 7fcad8e87800 20 add_watcher() i=0 2024-05-15T14:30:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.279+0000 7fcad8e87800 20 add_watcher() i=1 2024-05-15T14:30:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.279+0000 7fcad8e87800 20 add_watcher() i=2 2024-05-15T14:30:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.279+0000 7fcad8e87800 20 add_watcher() i=3 2024-05-15T14:30:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.279+0000 7fcad8e87800 20 add_watcher() i=4 2024-05-15T14:30:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.279+0000 7fcad8e87800 20 add_watcher() i=5 2024-05-15T14:30:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.279+0000 7fcad8e87800 20 add_watcher() i=6 2024-05-15T14:30:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.280+0000 7fcad8e87800 20 add_watcher() i=7 2024-05-15T14:30:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.280+0000 7fcad8e87800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.281+0000 7fc98d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.282+0000 7fcad8e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.282+0000 7fcad8e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.282+0000 7fcad8e87800 5 note: GC not initialized 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.282+0000 7fc907fff640 20 reqs_thread_entry: start 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.282+0000 7fcad8e87800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.282+0000 7fcad8e87800 20 Filter name: none 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.282+0000 7fc905ffb640 20 reqs_thread_entry: start 2024-05-15T14:30:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.282+0000 7fcad8e87800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom : miss 2024-05-15T14:30:05.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 10 cache put: name=MyZone.rgw.log++pubsub.kaboom info.flags=0x0 2024-05-15T14:30:05.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 10 adding MyZone.rgw.log++pubsub.kaboom to cache LRU end 2024-05-15T14:30:05.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom : hit (negative entry) 2024-05-15T14:30:05.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 10 cache get: name=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_1 : miss 2024-05-15T14:30:05.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 20 rados_obj.operate() r=0 bl.length=288 2024-05-15T14:30:05.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 10 cache put: name=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_1 info.flags=0x15 2024-05-15T14:30:05.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 10 adding MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_1 to cache LRU end 2024-05-15T14:30:05.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.283+0000 7fcad8e87800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_1 2024-05-15T14:30:05.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.284+0000 7fcad8e87800 10 removing MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_1 from cache 2024-05-15T14:30:05.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.284+0000 7fcad8e87800 10 distributing notification oid=MyZone.rgw.control:notify.6 cni=[op: 1, obj: MyZone.rgw.meta:topics:topic.kaboom:vwwrqh-2_topic_1, ofs0, ns] 2024-05-15T14:30:05.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.284+0000 7fc9ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94448202145008 notifier 4781 bl.length()=174 2024-05-15T14:30:05.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.286+0000 7fcad8e87800 20 WARNING: failed to remove topic buckets obj buckets.kaboom:vwwrqh-2_topic_1 with: (2) No such file or directory 2024-05-15T14:30:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.287+0000 7fc98d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.289+0000 7fcad8e87800 20 remove_watcher() i=0 2024-05-15T14:30:05.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.289+0000 7fcad8e87800 2 removed watcher, disabling cache 2024-05-15T14:30:05.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.290+0000 7fcad8e87800 20 remove_watcher() i=1 2024-05-15T14:30:05.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.291+0000 7fcad8e87800 20 remove_watcher() i=2 2024-05-15T14:30:05.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.292+0000 7fcad8e87800 20 remove_watcher() i=3 2024-05-15T14:30:05.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.293+0000 7fcad8e87800 20 remove_watcher() i=4 2024-05-15T14:30:05.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.294+0000 7fcad8e87800 20 remove_watcher() i=5 2024-05-15T14:30:05.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.295+0000 7fcad8e87800 20 remove_watcher() i=6 2024-05-15T14:30:05.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.296+0000 7fcad8e87800 20 remove_watcher() i=7 2024-05-15T14:30:05.348 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:05.348 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:05.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.387+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.388+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.388+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.389+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.389+0000 7f7c8dd2e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:05.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.389+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.390+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.390+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.390+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:05.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.390+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.390+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:05.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.391+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.391+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.391+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.391+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.391+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.392+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.392+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:05.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 20 zone MyZone found 2024-05-15T14:30:05.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:05.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:05.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:05.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:05.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.393+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.394+0000 7f7c8dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.394+0000 7f7c8dd2e800 20 started sync module instance, tier type = 2024-05-15T14:30:05.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.394+0000 7f7c8dd2e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:05.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.404+0000 7f7c8dd2e800 20 add_watcher() i=0 2024-05-15T14:30:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.404+0000 7f7c8dd2e800 20 add_watcher() i=1 2024-05-15T14:30:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.404+0000 7f7c8dd2e800 20 add_watcher() i=2 2024-05-15T14:30:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.404+0000 7f7c8dd2e800 20 add_watcher() i=3 2024-05-15T14:30:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.404+0000 7f7c8dd2e800 20 add_watcher() i=4 2024-05-15T14:30:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.404+0000 7f7c8dd2e800 20 add_watcher() i=5 2024-05-15T14:30:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.404+0000 7f7c8dd2e800 20 add_watcher() i=6 2024-05-15T14:30:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.405+0000 7f7c8dd2e800 20 add_watcher() i=7 2024-05-15T14:30:05.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.405+0000 7f7c8dd2e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7b3bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7c8dd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7c8dd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7c8dd2e800 5 note: GC not initialized 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7b3affd640 20 reqs_thread_entry: start 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7c8dd2e800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7c8dd2e800 20 Filter name: none 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7b38ff9640 20 reqs_thread_entry: start 2024-05-15T14:30:05.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.407+0000 7f7c8dd2e800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom : miss 2024-05-15T14:30:05.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 10 cache put: name=MyZone.rgw.log++pubsub.kaboom info.flags=0x0 2024-05-15T14:30:05.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 10 adding MyZone.rgw.log++pubsub.kaboom to cache LRU end 2024-05-15T14:30:05.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom : hit (negative entry) 2024-05-15T14:30:05.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 10 cache get: name=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_2 : miss 2024-05-15T14:30:05.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 20 rados_obj.operate() r=0 bl.length=257 2024-05-15T14:30:05.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 10 cache put: name=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_2 info.flags=0x15 2024-05-15T14:30:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 10 adding MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_2 to cache LRU end 2024-05-15T14:30:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.408+0000 7f7c8dd2e800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_2 2024-05-15T14:30:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.409+0000 7f7c8dd2e800 10 removing MyZone.rgw.meta+topics+topic.kaboom:vwwrqh-2_topic_2 from cache 2024-05-15T14:30:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.409+0000 7f7c8dd2e800 10 distributing notification oid=MyZone.rgw.control:notify.6 cni=[op: 1, obj: MyZone.rgw.meta:topics:topic.kaboom:vwwrqh-2_topic_2, ofs0, ns] 2024-05-15T14:30:05.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.409+0000 7f7b6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94679425637024 notifier 4911 bl.length()=174 2024-05-15T14:30:05.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.411+0000 7f7c8dd2e800 20 WARNING: failed to remove topic buckets obj buckets.kaboom:vwwrqh-2_topic_2 with: (2) No such file or directory 2024-05-15T14:30:05.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.413+0000 7f7c8dd2e800 20 INFO: queue: kaboom:vwwrqh-2_topic_2 removed from queue list 2024-05-15T14:30:05.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.414+0000 7f7b3bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.416+0000 7f7c8dd2e800 20 remove_watcher() i=0 2024-05-15T14:30:05.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.416+0000 7f7c8dd2e800 2 removed watcher, disabling cache 2024-05-15T14:30:05.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.417+0000 7f7c8dd2e800 20 remove_watcher() i=1 2024-05-15T14:30:05.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.418+0000 7f7c8dd2e800 20 remove_watcher() i=2 2024-05-15T14:30:05.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.419+0000 7f7c8dd2e800 20 remove_watcher() i=3 2024-05-15T14:30:05.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.420+0000 7f7c8dd2e800 20 remove_watcher() i=4 2024-05-15T14:30:05.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.421+0000 7f7c8dd2e800 20 remove_watcher() i=5 2024-05-15T14:30:05.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.422+0000 7f7c8dd2e800 20 remove_watcher() i=6 2024-05-15T14:30:05.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.423+0000 7f7c8dd2e800 20 remove_watcher() i=7 2024-05-15T14:30:05.473 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:05.473 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:05.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.512+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.514+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.514+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.515+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.515+0000 7f6a0c728800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:05.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.515+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.515+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.515+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.516+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:05.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.516+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.516+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.516+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.516+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.516+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.517+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.517+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.517+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.517+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 20 zone MyZone found 2024-05-15T14:30:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.518+0000 7f6a0c728800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.519+0000 7f6a0c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.519+0000 7f6a0c728800 20 started sync module instance, tier type = 2024-05-15T14:30:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.519+0000 7f6a0c728800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:05.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.529+0000 7f6a0c728800 20 add_watcher() i=0 2024-05-15T14:30:05.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.529+0000 7f6a0c728800 20 add_watcher() i=1 2024-05-15T14:30:05.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.529+0000 7f6a0c728800 20 add_watcher() i=2 2024-05-15T14:30:05.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.529+0000 7f6a0c728800 20 add_watcher() i=3 2024-05-15T14:30:05.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.529+0000 7f6a0c728800 20 add_watcher() i=4 2024-05-15T14:30:05.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.529+0000 7f6a0c728800 20 add_watcher() i=5 2024-05-15T14:30:05.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.529+0000 7f6a0c728800 20 add_watcher() i=6 2024-05-15T14:30:05.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.530+0000 7f6a0c728800 20 add_watcher() i=7 2024-05-15T14:30:05.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.530+0000 7f6a0c728800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:05.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.532+0000 7f68be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.532+0000 7f6a0c728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:05.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.532+0000 7f6a0c728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:05.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.532+0000 7f6a0c728800 5 note: GC not initialized 2024-05-15T14:30:05.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.532+0000 7f68bd7e2640 20 reqs_thread_entry: start 2024-05-15T14:30:05.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.532+0000 7f6a0c728800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:05.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.532+0000 7f6a0c728800 20 Filter name: none 2024-05-15T14:30:05.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.533+0000 7f682effd640 20 reqs_thread_entry: start 2024-05-15T14:30:05.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.542+0000 7f68be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.544+0000 7f6a0c728800 20 remove_watcher() i=0 2024-05-15T14:30:05.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.544+0000 7f6a0c728800 2 removed watcher, disabling cache 2024-05-15T14:30:05.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.545+0000 7f6a0c728800 20 remove_watcher() i=1 2024-05-15T14:30:05.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.546+0000 7f6a0c728800 20 remove_watcher() i=2 2024-05-15T14:30:05.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.547+0000 7f6a0c728800 20 remove_watcher() i=3 2024-05-15T14:30:05.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.548+0000 7f6a0c728800 20 remove_watcher() i=4 2024-05-15T14:30:05.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.549+0000 7f6a0c728800 20 remove_watcher() i=5 2024-05-15T14:30:05.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.550+0000 7f6a0c728800 20 remove_watcher() i=6 2024-05-15T14:30:05.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.551+0000 7f6a0c728800 20 remove_watcher() i=7 2024-05-15T14:30:05.564 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:30:05.612 INFO:teuthology.orchestra.run.smithi018.stderr:test s3 notification list/get/delete on master ... ignoring --setuser ceph since I am not root 2024-05-15T14:30:05.613 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:05.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.652+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.653+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.653+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.654+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.654+0000 7f684d535800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.654+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.654+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.654+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.655+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.655+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.655+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.656+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.656+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.656+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.656+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.656+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.657+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.657+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 20 zone MyZone found 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.658+0000 7f684d535800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.659+0000 7f684d535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.659+0000 7f684d535800 20 started sync module instance, tier type = 2024-05-15T14:30:05.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.659+0000 7f684d535800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:05.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.669+0000 7f684d535800 20 add_watcher() i=0 2024-05-15T14:30:05.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.669+0000 7f684d535800 20 add_watcher() i=1 2024-05-15T14:30:05.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.669+0000 7f684d535800 20 add_watcher() i=2 2024-05-15T14:30:05.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.669+0000 7f684d535800 20 add_watcher() i=3 2024-05-15T14:30:05.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.669+0000 7f684d535800 20 add_watcher() i=4 2024-05-15T14:30:05.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.669+0000 7f684d535800 20 add_watcher() i=5 2024-05-15T14:30:05.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.669+0000 7f684d535800 20 add_watcher() i=6 2024-05-15T14:30:05.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.670+0000 7f684d535800 20 add_watcher() i=7 2024-05-15T14:30:05.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.670+0000 7f684d535800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:05.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.672+0000 7f66ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.672+0000 7f684d535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.672+0000 7f684d535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.672+0000 7f684d535800 5 note: GC not initialized 2024-05-15T14:30:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.672+0000 7f66fe7e4640 20 reqs_thread_entry: start 2024-05-15T14:30:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.672+0000 7f684d535800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.672+0000 7f684d535800 20 Filter name: none 2024-05-15T14:30:05.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.672+0000 7f666ffff640 20 reqs_thread_entry: start 2024-05-15T14:30:05.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.682+0000 7f66ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.684+0000 7f684d535800 20 remove_watcher() i=0 2024-05-15T14:30:05.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.684+0000 7f684d535800 2 removed watcher, disabling cache 2024-05-15T14:30:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.685+0000 7f684d535800 20 remove_watcher() i=1 2024-05-15T14:30:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.686+0000 7f684d535800 20 remove_watcher() i=2 2024-05-15T14:30:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.687+0000 7f684d535800 20 remove_watcher() i=3 2024-05-15T14:30:05.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.688+0000 7f684d535800 20 remove_watcher() i=4 2024-05-15T14:30:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.689+0000 7f684d535800 20 remove_watcher() i=5 2024-05-15T14:30:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.690+0000 7f684d535800 20 remove_watcher() i=6 2024-05-15T14:30:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.691+0000 7f684d535800 20 remove_watcher() i=7 2024-05-15T14:30:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.860+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.862+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.862+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.863+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.863+0000 7fb7d5333800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.863+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.863+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.863+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.864+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.864+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.864+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.864+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.864+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.864+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.865+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.865+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.865+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.865+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:05.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 20 zone MyZone found 2024-05-15T14:30:05.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:05.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:05.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.866+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.867+0000 7fb7d5333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.867+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.867+0000 7fb7d5333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.867+0000 7fb7d5333800 20 started sync module instance, tier type = 2024-05-15T14:30:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.867+0000 7fb7d5333800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.877+0000 7fb7d5333800 20 add_watcher() i=0 2024-05-15T14:30:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.877+0000 7fb7d5333800 20 add_watcher() i=1 2024-05-15T14:30:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.877+0000 7fb7d5333800 20 add_watcher() i=2 2024-05-15T14:30:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.877+0000 7fb7d5333800 20 add_watcher() i=3 2024-05-15T14:30:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.877+0000 7fb7d5333800 20 add_watcher() i=4 2024-05-15T14:30:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.877+0000 7fb7d5333800 20 add_watcher() i=5 2024-05-15T14:30:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.877+0000 7fb7d5333800 20 add_watcher() i=6 2024-05-15T14:30:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.878+0000 7fb7d5333800 20 add_watcher() i=7 2024-05-15T14:30:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.878+0000 7fb7d5333800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.880+0000 7fb6877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.880+0000 7fb7d5333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.880+0000 7fb7d5333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.880+0000 7fb7d5333800 5 note: GC not initialized 2024-05-15T14:30:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.880+0000 7fb6867e4640 20 reqs_thread_entry: start 2024-05-15T14:30:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.880+0000 7fb7d5333800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.881+0000 7fb7d5333800 20 Filter name: none 2024-05-15T14:30:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.881+0000 7fb67f7fe640 20 reqs_thread_entry: start 2024-05-15T14:30:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.881+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.881+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:30:05.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.881+0000 7fb7d5333800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.882+0000 7fb7d5333800 20 rados_obj.operate() r=0 bl.length=400 2024-05-15T14:30:05.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.882+0000 7fb7d5333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:30:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.883+0000 7fb6877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.885+0000 7fb7d5333800 20 remove_watcher() i=0 2024-05-15T14:30:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.885+0000 7fb7d5333800 2 removed watcher, disabling cache 2024-05-15T14:30:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.886+0000 7fb7d5333800 20 remove_watcher() i=1 2024-05-15T14:30:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.887+0000 7fb7d5333800 20 remove_watcher() i=2 2024-05-15T14:30:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.888+0000 7fb7d5333800 20 remove_watcher() i=3 2024-05-15T14:30:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.889+0000 7fb7d5333800 20 remove_watcher() i=4 2024-05-15T14:30:05.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.890+0000 7fb7d5333800 20 remove_watcher() i=5 2024-05-15T14:30:05.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.891+0000 7fb7d5333800 20 remove_watcher() i=6 2024-05-15T14:30:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.892+0000 7fb7d5333800 20 remove_watcher() i=7 2024-05-15T14:30:05.944 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:05.945 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:05.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.983+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.985+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.985+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.986+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.986+0000 7fee56210800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:05.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.986+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.986+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.986+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.987+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:05.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.987+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.987+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:05.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.987+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.987+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.987+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.988+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:05.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.988+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.988+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:05.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.988+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 20 zone MyZone found 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.989+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.990+0000 7fee56210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.990+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:05.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.990+0000 7fee56210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:05.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.990+0000 7fee56210800 20 started sync module instance, tier type = 2024-05-15T14:30:05.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:05.990+0000 7fee56210800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.000+0000 7fee56210800 20 add_watcher() i=0 2024-05-15T14:30:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.000+0000 7fee56210800 20 add_watcher() i=1 2024-05-15T14:30:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.000+0000 7fee56210800 20 add_watcher() i=2 2024-05-15T14:30:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.000+0000 7fee56210800 20 add_watcher() i=3 2024-05-15T14:30:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.000+0000 7fee56210800 20 add_watcher() i=4 2024-05-15T14:30:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.000+0000 7fee56210800 20 add_watcher() i=5 2024-05-15T14:30:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.000+0000 7fee56210800 20 add_watcher() i=6 2024-05-15T14:30:06.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.001+0000 7fee56210800 20 add_watcher() i=7 2024-05-15T14:30:06.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.001+0000 7fee56210800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:06.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.003+0000 7fed037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.003+0000 7fee56210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.003+0000 7fee56210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.004+0000 7fee56210800 5 note: GC not initialized 2024-05-15T14:30:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.004+0000 7fed027fc640 20 reqs_thread_entry: start 2024-05-15T14:30:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.004+0000 7fee56210800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.004+0000 7fee56210800 20 Filter name: none 2024-05-15T14:30:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.004+0000 7fec73fff640 20 reqs_thread_entry: start 2024-05-15T14:30:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.004+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.004+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:30:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.004+0000 7fee56210800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.005+0000 7fee56210800 20 rados_obj.operate() r=0 bl.length=400 2024-05-15T14:30:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.005+0000 7fee56210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:30:06.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.006+0000 7fed037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.008+0000 7fee56210800 20 remove_watcher() i=0 2024-05-15T14:30:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.008+0000 7fee56210800 2 removed watcher, disabling cache 2024-05-15T14:30:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.009+0000 7fee56210800 20 remove_watcher() i=1 2024-05-15T14:30:06.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.010+0000 7fee56210800 20 remove_watcher() i=2 2024-05-15T14:30:06.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.011+0000 7fee56210800 20 remove_watcher() i=3 2024-05-15T14:30:06.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.012+0000 7fee56210800 20 remove_watcher() i=4 2024-05-15T14:30:06.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.013+0000 7fee56210800 20 remove_watcher() i=5 2024-05-15T14:30:06.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.014+0000 7fee56210800 20 remove_watcher() i=6 2024-05-15T14:30:06.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.015+0000 7fee56210800 20 remove_watcher() i=7 2024-05-15T14:30:06.068 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:06.068 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:06.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.107+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.108+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.108+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.109+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.109+0000 7f80b452d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:06.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.109+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.109+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.109+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.110+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:06.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.110+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.110+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.110+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.111+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.111+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.111+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.111+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.112+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.112+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 zone MyZone found 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:06.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:06.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 started sync module instance, tier type = 2024-05-15T14:30:06.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.113+0000 7f80b452d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.123+0000 7f80b452d800 20 add_watcher() i=0 2024-05-15T14:30:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.123+0000 7f80b452d800 20 add_watcher() i=1 2024-05-15T14:30:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.123+0000 7f80b452d800 20 add_watcher() i=2 2024-05-15T14:30:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.123+0000 7f80b452d800 20 add_watcher() i=3 2024-05-15T14:30:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.123+0000 7f80b452d800 20 add_watcher() i=4 2024-05-15T14:30:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.123+0000 7f80b452d800 20 add_watcher() i=5 2024-05-15T14:30:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.123+0000 7f80b452d800 20 add_watcher() i=6 2024-05-15T14:30:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.124+0000 7f80b452d800 20 add_watcher() i=7 2024-05-15T14:30:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.124+0000 7f80b452d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.126+0000 7f7f66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.126+0000 7f80b452d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.126+0000 7f80b452d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.126+0000 7f80b452d800 5 note: GC not initialized 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f7f65fdb640 20 reqs_thread_entry: start 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 20 Filter name: none 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f7ed77fe640 20 reqs_thread_entry: start 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 10 cache get: name=MyZone.rgw.meta+root+vwwrqh-3 : miss 2024-05-15T14:30:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:30:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 10 cache put: name=MyZone.rgw.meta+root+vwwrqh-3 info.flags=0x11 2024-05-15T14:30:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 10 adding MyZone.rgw.meta+root+vwwrqh-3 to cache LRU end 2024-05-15T14:30:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 10 cache get: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 : miss 2024-05-15T14:30:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.127+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=400 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 info.flags=0x17 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 adding MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 to cache LRU end 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 updating xattr: name=user.rgw.bucket-notification bl.length()=1217 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:30:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 RGWRados::convert_old_bucket_info(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]) 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 10 cache get: name=MyZone.rgw.meta+root+vwwrqh-3 : type miss (requested=0x17, cached=0x11) 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.128+0000 7f80b452d800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.129+0000 7f80b452d800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.129+0000 7f80b452d800 10 cache put: name=MyZone.rgw.meta+root+vwwrqh-3 info.flags=0x17 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.129+0000 7f80b452d800 10 moving MyZone.rgw.meta+root+vwwrqh-3 to cache LRU end 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.129+0000 7f80b452d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f80b452d800 10 cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 info.flags=0x17 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f80b452d800 10 moving MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 to cache LRU end 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f80b452d800 10 updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f80b452d800 10 updating xattr: name=user.rgw.bucket-notification bl.length()=800 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f80b452d800 10 distributing notification oid=MyZone.rgw.control:notify.2 cni=[op: 0, obj: MyZone.rgw.meta:root:.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1, ofs0, ns] 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f7f877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94758680725136 notifier 5007 bl.length()=1673 2024-05-15T14:30:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f7f877fe640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 info.flags=0x17 2024-05-15T14:30:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f7f877fe640 10 rgw watcher librados: moving MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 to cache LRU end 2024-05-15T14:30:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f7f877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:30:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.130+0000 7f7f877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.bucket-notification bl.length()=800 2024-05-15T14:30:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.131+0000 7f80b452d800 20 handle_bi_update(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]): orig_sources= new_sources= 2024-05-15T14:30:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.131+0000 7f80b452d800 20 handle_bi_update(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]): potential sources added=[] removed=[] 2024-05-15T14:30:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.131+0000 7f80b452d800 20 handle_bi_update(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]): orig_dests= new_dests= 2024-05-15T14:30:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.131+0000 7f80b452d800 20 handle_bi_update(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]): potential dests added=[] removed=[] 2024-05-15T14:30:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.132+0000 7f7f66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.134+0000 7f80b452d800 20 remove_watcher() i=0 2024-05-15T14:30:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.134+0000 7f80b452d800 2 removed watcher, disabling cache 2024-05-15T14:30:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.135+0000 7f80b452d800 20 remove_watcher() i=1 2024-05-15T14:30:06.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.136+0000 7f80b452d800 20 remove_watcher() i=2 2024-05-15T14:30:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.137+0000 7f80b452d800 20 remove_watcher() i=3 2024-05-15T14:30:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.138+0000 7f80b452d800 20 remove_watcher() i=4 2024-05-15T14:30:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.139+0000 7f80b452d800 20 remove_watcher() i=5 2024-05-15T14:30:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.140+0000 7f80b452d800 20 remove_watcher() i=6 2024-05-15T14:30:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.141+0000 7f80b452d800 20 remove_watcher() i=7 2024-05-15T14:30:06.191 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:06.191 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:06.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.229+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.231+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.231+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.232+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.232+0000 7f3d78723800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:06.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.232+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.232+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.232+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.233+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:06.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.233+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.233+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.233+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.233+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.233+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.234+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.234+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.234+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.234+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 20 zone MyZone found 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.235+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.236+0000 7f3d78723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.236+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.236+0000 7f3d78723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.236+0000 7f3d78723800 20 started sync module instance, tier type = 2024-05-15T14:30:06.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.236+0000 7f3d78723800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:06.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.246+0000 7f3d78723800 20 add_watcher() i=0 2024-05-15T14:30:06.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.246+0000 7f3d78723800 20 add_watcher() i=1 2024-05-15T14:30:06.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.246+0000 7f3d78723800 20 add_watcher() i=2 2024-05-15T14:30:06.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.246+0000 7f3d78723800 20 add_watcher() i=3 2024-05-15T14:30:06.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.246+0000 7f3d78723800 20 add_watcher() i=4 2024-05-15T14:30:06.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.246+0000 7f3d78723800 20 add_watcher() i=5 2024-05-15T14:30:06.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.246+0000 7f3d78723800 20 add_watcher() i=6 2024-05-15T14:30:06.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.247+0000 7f3d78723800 20 add_watcher() i=7 2024-05-15T14:30:06.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.247+0000 7f3d78723800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:06.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.249+0000 7f3c2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.249+0000 7f3d78723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.249+0000 7f3d78723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.249+0000 7f3d78723800 5 note: GC not initialized 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.249+0000 7f3c29fdb640 20 reqs_thread_entry: start 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.250+0000 7f3d78723800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.250+0000 7f3d78723800 20 Filter name: none 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.250+0000 7f3b9b7fe640 20 reqs_thread_entry: start 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.250+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.250+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:30:06.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.250+0000 7f3d78723800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.251+0000 7f3d78723800 20 rados_obj.operate() r=0 bl.length=400 2024-05-15T14:30:06.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.251+0000 7f3d78723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:30:06.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.252+0000 7f3c2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.254+0000 7f3d78723800 20 remove_watcher() i=0 2024-05-15T14:30:06.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.254+0000 7f3d78723800 2 removed watcher, disabling cache 2024-05-15T14:30:06.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.255+0000 7f3d78723800 20 remove_watcher() i=1 2024-05-15T14:30:06.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.257+0000 7f3d78723800 20 remove_watcher() i=2 2024-05-15T14:30:06.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.258+0000 7f3d78723800 20 remove_watcher() i=3 2024-05-15T14:30:06.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.259+0000 7f3d78723800 20 remove_watcher() i=4 2024-05-15T14:30:06.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.260+0000 7f3d78723800 20 remove_watcher() i=5 2024-05-15T14:30:06.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.261+0000 7f3d78723800 20 remove_watcher() i=6 2024-05-15T14:30:06.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.262+0000 7f3d78723800 20 remove_watcher() i=7 2024-05-15T14:30:06.312 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:06.312 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:06.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.352+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.353+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.353+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.354+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.354+0000 7f1a05a0e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:06.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.354+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.354+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.354+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.355+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.355+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.355+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.355+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.355+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.355+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.356+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.356+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.356+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.356+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:06.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 20 zone MyZone found 2024-05-15T14:30:06.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:06.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.357+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.358+0000 7f1a05a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.358+0000 7f1a05a0e800 20 started sync module instance, tier type = 2024-05-15T14:30:06.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.358+0000 7f1a05a0e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.368+0000 7f1a05a0e800 20 add_watcher() i=0 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.368+0000 7f1a05a0e800 20 add_watcher() i=1 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.368+0000 7f1a05a0e800 20 add_watcher() i=2 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.368+0000 7f1a05a0e800 20 add_watcher() i=3 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.368+0000 7f1a05a0e800 20 add_watcher() i=4 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.368+0000 7f1a05a0e800 20 add_watcher() i=5 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.368+0000 7f1a05a0e800 20 add_watcher() i=6 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.369+0000 7f1a05a0e800 20 add_watcher() i=7 2024-05-15T14:30:06.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.369+0000 7f1a05a0e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:06.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.371+0000 7f18b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.371+0000 7f1a05a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.371+0000 7f1a05a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.371+0000 7f1a05a0e800 5 note: GC not initialized 2024-05-15T14:30:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.371+0000 7f18b8fe1640 20 reqs_thread_entry: start 2024-05-15T14:30:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.371+0000 7f1a05a0e800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.371+0000 7f1a05a0e800 20 Filter name: none 2024-05-15T14:30:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.371+0000 7f18327fc640 20 reqs_thread_entry: start 2024-05-15T14:30:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.372+0000 7f1a05a0e800 10 cache get: name=MyZone.rgw.meta+root+vwwrqh-3 : miss 2024-05-15T14:30:06.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.372+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.372+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.372+0000 7f1a05a0e800 10 cache put: name=MyZone.rgw.meta+root+vwwrqh-3 info.flags=0x11 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.372+0000 7f1a05a0e800 10 adding MyZone.rgw.meta+root+vwwrqh-3 to cache LRU end 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.372+0000 7f1a05a0e800 10 cache get: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 : miss 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.372+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=400 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 info.flags=0x17 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 adding MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 to cache LRU end 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:30:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 updating xattr: name=user.rgw.bucket-notification bl.length()=800 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 RGWRados::convert_old_bucket_info(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]) 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 cache get: name=MyZone.rgw.meta+root+vwwrqh-3 : type miss (requested=0x17, cached=0x11) 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 cache put: name=MyZone.rgw.meta+root+vwwrqh-3 info.flags=0x17 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 moving MyZone.rgw.meta+root+vwwrqh-3 to cache LRU end 2024-05-15T14:30:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.373+0000 7f1a05a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:30:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.375+0000 7f1a05a0e800 10 cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 info.flags=0x17 2024-05-15T14:30:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.375+0000 7f1a05a0e800 10 moving MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 to cache LRU end 2024-05-15T14:30:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.375+0000 7f1a05a0e800 10 updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:30:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.375+0000 7f1a05a0e800 10 distributing notification oid=MyZone.rgw.control:notify.2 cni=[op: 0, obj: MyZone.rgw.meta:root:.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1, ofs0, ns] 2024-05-15T14:30:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.375+0000 7f18e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 93829255108112 notifier 5046 bl.length()=837 2024-05-15T14:30:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.375+0000 7f18e6ffd640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 info.flags=0x17 2024-05-15T14:30:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.375+0000 7f18e6ffd640 10 rgw watcher librados: moving MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 to cache LRU end 2024-05-15T14:30:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.375+0000 7f18e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:30:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.376+0000 7f1a05a0e800 20 handle_bi_update(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]): orig_sources= new_sources= 2024-05-15T14:30:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.376+0000 7f1a05a0e800 20 handle_bi_update(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]): potential sources added=[] removed=[] 2024-05-15T14:30:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.376+0000 7f1a05a0e800 20 handle_bi_update(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]): orig_dests= new_dests= 2024-05-15T14:30:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.376+0000 7f1a05a0e800 20 handle_bi_update(): bucket=:vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1]): potential dests added=[] removed=[] 2024-05-15T14:30:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.377+0000 7f1a05a0e800 20 Successfully removed topic bucket mapping for bucket: vwwrqh-3 and topic: vwwrqh-3_topic_1 2024-05-15T14:30:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.378+0000 7f18b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.380+0000 7f1a05a0e800 20 remove_watcher() i=0 2024-05-15T14:30:06.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.380+0000 7f1a05a0e800 2 removed watcher, disabling cache 2024-05-15T14:30:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.381+0000 7f1a05a0e800 20 remove_watcher() i=1 2024-05-15T14:30:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.382+0000 7f1a05a0e800 20 remove_watcher() i=2 2024-05-15T14:30:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.383+0000 7f1a05a0e800 20 remove_watcher() i=3 2024-05-15T14:30:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.384+0000 7f1a05a0e800 20 remove_watcher() i=4 2024-05-15T14:30:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.385+0000 7f1a05a0e800 20 remove_watcher() i=5 2024-05-15T14:30:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.386+0000 7f1a05a0e800 20 remove_watcher() i=6 2024-05-15T14:30:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.387+0000 7f1a05a0e800 20 remove_watcher() i=7 2024-05-15T14:30:06.437 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:06.437 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:06.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.476+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.479+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.479+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.479+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.479+0000 7fb85f1af800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.479+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.480+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.480+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.480+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:06.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.480+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.481+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:06.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.481+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.481+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.481+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.481+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:06.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.482+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.482+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:06.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.482+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 20 zone MyZone found 2024-05-15T14:30:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.483+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.484+0000 7fb85f1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.484+0000 7fb85f1af800 20 started sync module instance, tier type = 2024-05-15T14:30:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.484+0000 7fb85f1af800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.494+0000 7fb85f1af800 20 add_watcher() i=0 2024-05-15T14:30:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.494+0000 7fb85f1af800 20 add_watcher() i=1 2024-05-15T14:30:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.494+0000 7fb85f1af800 20 add_watcher() i=2 2024-05-15T14:30:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.494+0000 7fb85f1af800 20 add_watcher() i=3 2024-05-15T14:30:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.494+0000 7fb85f1af800 20 add_watcher() i=4 2024-05-15T14:30:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.494+0000 7fb85f1af800 20 add_watcher() i=5 2024-05-15T14:30:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.494+0000 7fb85f1af800 20 add_watcher() i=6 2024-05-15T14:30:06.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.495+0000 7fb85f1af800 20 add_watcher() i=7 2024-05-15T14:30:06.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.495+0000 7fb85f1af800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.497+0000 7fb712fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.497+0000 7fb85f1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:06.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.497+0000 7fb85f1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:06.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.497+0000 7fb85f1af800 5 note: GC not initialized 2024-05-15T14:30:06.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.498+0000 7fb711fe3640 20 reqs_thread_entry: start 2024-05-15T14:30:06.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.498+0000 7fb85f1af800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:06.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.498+0000 7fb85f1af800 20 Filter name: none 2024-05-15T14:30:06.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.498+0000 7fb6837fe640 20 reqs_thread_entry: start 2024-05-15T14:30:06.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.498+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.499+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:30:06.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.499+0000 7fb85f1af800 20 rados->read ofs=0 len=0 2024-05-15T14:30:06.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.499+0000 7fb85f1af800 20 rados_obj.operate() r=0 bl.length=400 2024-05-15T14:30:06.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.499+0000 7fb85f1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:30:06.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.500+0000 7fb712fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:06.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.502+0000 7fb85f1af800 20 remove_watcher() i=0 2024-05-15T14:30:06.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.502+0000 7fb85f1af800 2 removed watcher, disabling cache 2024-05-15T14:30:06.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.503+0000 7fb85f1af800 20 remove_watcher() i=1 2024-05-15T14:30:06.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.504+0000 7fb85f1af800 20 remove_watcher() i=2 2024-05-15T14:30:06.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.505+0000 7fb85f1af800 20 remove_watcher() i=3 2024-05-15T14:30:06.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.506+0000 7fb85f1af800 20 remove_watcher() i=4 2024-05-15T14:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.507+0000 7fb85f1af800 20 remove_watcher() i=5 2024-05-15T14:30:06.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.508+0000 7fb85f1af800 20 remove_watcher() i=6 2024-05-15T14:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:06.509+0000 7fb85f1af800 20 remove_watcher() i=7 2024-05-15T14:30:06.523 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:30:06.684 INFO:teuthology.orchestra.run.smithi018.stderr:test s3 notification set/get/delete on master ... ok 2024-05-15T14:30:06.807 INFO:teuthology.orchestra.run.smithi018.stderr:test s3 notification set/get/delete on master with empty config ... ok 2024-05-15T14:30:06.957 INFO:teuthology.orchestra.run.smithi018.stderr:test s3 notification set/get/delete on master ... ok 2024-05-15T14:30:06.960 INFO:teuthology.orchestra.run.smithi018.stderr:test deletion of multiple keys on master ... 127.0.0.1 - - [15/May/2024 14:30:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.081 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.081 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.082 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.083 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.594 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:30:12.609 INFO:teuthology.orchestra.run.smithi018.stderr:test pushing http s3 notification ... 172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.759 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.792 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.792 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.830 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.830 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.855 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.891 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.891 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.928 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.948 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.966 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:12.987 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:12] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.063 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.085 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.120 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.142 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.198 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.217 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.257 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.306 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.344 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.365 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.402 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.422 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.457 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.477 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.579 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.646 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.647 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.667 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.704 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.786 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.809 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.875 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.955 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.016 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.020 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.061 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.159 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.181 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.205 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.229 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.265 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.292 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.334 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.334 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.348 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.390 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.417 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.431 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.515 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.535 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.598 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.618 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.636 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.682 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.686 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.699 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.710 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.727 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.730 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.737 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.754 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.783 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.793 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.796 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.809 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.818 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.825 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.830 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.851 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.856 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.860 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.870 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.871 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.892 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.895 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.897 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:14.899 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.967 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.971 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.974 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.978 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.979 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.981 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.989 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.991 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.993 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.995 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:19] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:19.999 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.002 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.007 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.009 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.009 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.012 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.014 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.018 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.020 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.024 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.027 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.027 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.032 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.034 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.038 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.041 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.042 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.044 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.046 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.048 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.050 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.054 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.056 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.061 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.062 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.063 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.067 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.069 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.071 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.082 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.093 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.097 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.098 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.098 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.102 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.104 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.107 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.120 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.120 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.132 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.136 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.136 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.137 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.138 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.139 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.139 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:20.140 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.012 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.013 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.014 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.015 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.076 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.077 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.078 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.078 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.079 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.080 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.081 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.082 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.082 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.140 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.142 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:21.145 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:30:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.157 INFO:teuthology.orchestra.run.smithi018.stderr:FAIL 2024-05-15T14:30:26.166 INFO:teuthology.orchestra.run.smithi018.stderr:test pushing cloudevents notification on master ... 127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.217 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.220 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.222 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.223 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.225 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.226 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.228 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.229 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:26.231 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.258 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.260 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.262 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.263 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.265 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.266 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.267 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.268 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.269 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:31.270 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:30:36.781 INFO:teuthology.orchestra.run.smithi018.stderr:test that opaque id set in topic, is sent in notification on master ... 127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.834 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.834 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.835 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.837 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.838 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.839 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.840 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:36.842 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:36] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.878 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.885 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.889 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.895 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.900 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.906 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.911 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.917 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.922 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:41.927 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:30:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:42.429 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:30:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:test that when object is deleted due to lifecycle policy, notification is sent on master ... 127.0.0.1 - - [15/May/2024 14:30:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:30:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:30:42.619 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:30:42.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.660+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.662+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:42.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.662+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.662+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:42.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.662+0000 7f2ebde13800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:30:42.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.662+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.663+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:42.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.663+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.664+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:30:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.664+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.664+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:30:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.664+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.664+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.664+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.664+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:30:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.664+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.665+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:30:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.665+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:30:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 20 zone MyZone found 2024-05-15T14:30:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:30:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:30:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:30:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:30:42.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 20 period zonegroup name MyZoneGroup 2024-05-15T14:30:42.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:30:42.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:42.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.666+0000 7f2ebde13800 20 rados->read ofs=0 len=0 2024-05-15T14:30:42.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.667+0000 7f2ebde13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:30:42.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.667+0000 7f2ebde13800 20 started sync module instance, tier type = 2024-05-15T14:30:42.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.667+0000 7f2ebde13800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:30:42.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.677+0000 7f2ebde13800 20 add_watcher() i=0 2024-05-15T14:30:42.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.677+0000 7f2ebde13800 20 add_watcher() i=1 2024-05-15T14:30:42.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.677+0000 7f2ebde13800 20 add_watcher() i=2 2024-05-15T14:30:42.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.677+0000 7f2ebde13800 20 add_watcher() i=3 2024-05-15T14:30:42.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.677+0000 7f2ebde13800 20 add_watcher() i=4 2024-05-15T14:30:42.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.677+0000 7f2ebde13800 20 add_watcher() i=5 2024-05-15T14:30:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.677+0000 7f2ebde13800 20 add_watcher() i=6 2024-05-15T14:30:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.678+0000 7f2ebde13800 20 add_watcher() i=7 2024-05-15T14:30:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.678+0000 7f2ebde13800 2 all 8 watchers are set, enabling cache 2024-05-15T14:30:42.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.680+0000 7f2d6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:42.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.680+0000 7f2ebde13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:30:42.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.680+0000 7f2ebde13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:30:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.715+0000 7f2d6e7e4640 20 reqs_thread_entry: start 2024-05-15T14:30:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.715+0000 7f2ebde13800 20 init_complete bucket index max shards: 11 2024-05-15T14:30:42.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.715+0000 7f2ebde13800 20 Filter name: none 2024-05-15T14:30:42.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.716+0000 7f2cdffff640 20 reqs_thread_entry: start 2024-05-15T14:30:42.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.716+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 4 worker ix: 0 2024-05-15T14:30:42.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.717+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.4 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.717+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.719+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 31 worker ix: 0 2024-05-15T14:30:42.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.720+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.31 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.720+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.721+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 26 worker ix: 0 2024-05-15T14:30:42.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.722+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.26 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.722+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.723+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 29 worker ix: 0 2024-05-15T14:30:42.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.725+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.29 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.725+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.726+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 21 worker ix: 0 2024-05-15T14:30:42.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.727+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.21 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.728+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.729+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 18 worker ix: 0 2024-05-15T14:30:42.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.730+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.18 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.731+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.732+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 15 worker ix: 0 2024-05-15T14:30:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.733+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.15 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.733+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.734+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 30 worker ix: 0 2024-05-15T14:30:42.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.735+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.30 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.736+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.737+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 24 worker ix: 0 2024-05-15T14:30:42.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.738+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.24 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.738+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.739+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 23 worker ix: 0 2024-05-15T14:30:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.740+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.23 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.741+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.742+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 19 worker ix: 0 2024-05-15T14:30:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.743+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.19 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.743+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.744+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 22 worker ix: 0 2024-05-15T14:30:42.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.746+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.22 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.746+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:42.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.747+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 17 worker ix: 0 2024-05-15T14:30:42.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.748+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.17 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:42.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.748+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): START entry 1: :vwwrqh-11:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9:lc.17:0:0 index: 17 worker ix: 0 2024-05-15T14:30:42.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.750+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): START entry 2: :vwwrqh-11:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9:lc.17:1715783442:1 index: 17 worker ix: 0 2024-05-15T14:30:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.751+0000 7f2ebde13800 5 lifecycle: RGWLC::bucket_lc_process ENTER bucket=vwwrqh-11 2024-05-15T14:30:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.751+0000 7f2ebde13800 10 lifecycle: cache get: name=MyZone.rgw.meta+root+vwwrqh-11 : miss 2024-05-15T14:30:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.751+0000 7f2ebde13800 20 lifecycle: rados->read ofs=0 len=0 2024-05-15T14:30:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.751+0000 7f2ebde13800 20 lifecycle: rados_obj.operate() r=0 bl.length=187 2024-05-15T14:30:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.751+0000 7f2ebde13800 10 lifecycle: cache put: name=MyZone.rgw.meta+root+vwwrqh-11 info.flags=0x11 2024-05-15T14:30:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.751+0000 7f2ebde13800 10 lifecycle: adding MyZone.rgw.meta+root+vwwrqh-11 to cache LRU end 2024-05-15T14:30:42.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.751+0000 7f2ebde13800 10 lifecycle: cache get: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-11:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9 : miss 2024-05-15T14:30:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.751+0000 7f2ebde13800 20 lifecycle: rados->read ofs=0 len=0 2024-05-15T14:30:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 20 lifecycle: rados_obj.operate() r=0 bl.length=401 2024-05-15T14:30:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 10 lifecycle: cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-11:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9 info.flags=0x17 2024-05-15T14:30:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 10 lifecycle: adding MyZone.rgw.meta+root+.bucket.meta.vwwrqh-11:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9 to cache LRU end 2024-05-15T14:30:42.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:30:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:30:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 10 lifecycle: updating xattr: name=user.rgw.bucket-notification bl.length()=422 2024-05-15T14:30:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 10 lifecycle: updating xattr: name=user.rgw.lc bl.length()=167 2024-05-15T14:30:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 10 lifecycle: chain_cache_entry: cache_locator=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-11:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9 2024-05-15T14:30:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 10 lifecycle: bucket_lc_process() prefix_map size=1 2024-05-15T14:30:42.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.752+0000 7f2ebde13800 20 lifecycle: bucket_lc_process(): prefix=ooo 2024-05-15T14:30:42.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.753+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo5 2024-05-15T14:30:42.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.753+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo9 2024-05-15T14:30:42.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.754+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo1 2024-05-15T14:30:42.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.754+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo8 2024-05-15T14:30:42.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.754+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo0 2024-05-15T14:30:42.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.755+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo4 2024-05-15T14:30:42.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.755+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo3 2024-05-15T14:30:42.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.755+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo7 2024-05-15T14:30:42.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.756+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo2 2024-05-15T14:30:42.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.756+0000 7f2ebde13800 10 lifecycle: cls_bucket_list_unordered: got ooo6 2024-05-15T14:30:42.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cde7fc640 20 lifecycle: operator()(): key=ooo9wp_thrd: 0, 1 2024-05-15T14:30:42.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 20 lifecycle: operator()(): key=ooo1wp_thrd: 0, 2 2024-05-15T14:30:42.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cdeffd640 20 lifecycle: operator()(): key=ooo8wp_thrd: 0, 0 2024-05-15T14:30:42.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cde7fc640 20 lifecycle: check(): key=ooo9: is_expired=1 size_check_p: 1 wp_thrd: 0, 1 2024-05-15T14:30:42.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 20 lifecycle: check(): key=ooo1: is_expired=1 size_check_p: 1 wp_thrd: 0, 2 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cdeffd640 20 lifecycle: check(): key=ooo8: is_expired=1 size_check_p: 1 wp_thrd: 0, 0 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002ad0 obj=vwwrqh-11:ooo9 state=0x7f2ccc002db8 s->prefetch_data=0 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8002ab0 obj=vwwrqh-11:ooo8 state=0x7f2cc8002d98 s->prefetch_data=0 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo1 state=0x7f2cc4002db8 s->prefetch_data=0 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.13854001970682126491 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cde7fc640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cde7fc640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.13019580653675739846 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cdeffd640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cdeffd640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.16633906702438588435 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:30:42.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 10 lifecycle: cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 10 lifecycle: adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic : miss 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.757+0000 7f2cddffb640 20 lifecycle: rados->read ofs=0 len=0 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 10 lifecycle: cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 10 lifecycle: moving MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic : miss 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 20 lifecycle: rados->read ofs=0 len=0 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 10 lifecycle: cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:30:42.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 10 lifecycle: moving MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic : miss 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 20 lifecycle: rados->read ofs=0 len=0 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cddffb640 20 lifecycle: rados_obj.operate() r=0 bl.length=241 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cddffb640 10 lifecycle: cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic info.flags=0x15 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cddffb640 10 lifecycle: adding MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic to cache LRU end 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cddffb640 10 lifecycle: chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 20 lifecycle: rados_obj.operate() r=0 bl.length=241 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 10 lifecycle: cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic info.flags=0x15 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 10 lifecycle: moving MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic to cache LRU end 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cde7fc640 10 lifecycle: chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 20 lifecycle: rados_obj.operate() r=0 bl.length=241 2024-05-15T14:30:42.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 10 lifecycle: cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic info.flags=0x15 2024-05-15T14:30:42.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 10 lifecycle: moving MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic to cache LRU end 2024-05-15T14:30:42.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.758+0000 7f2cdeffd640 10 lifecycle: chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.:vwwrqh-11_topic 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.760+0000 7f2cddffb640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.760+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.760+0000 7f2cde7fc640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.760+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.761+0000 7f2cdeffd640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.761+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.761+0000 7f2cddffb640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.761+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo1 state=0x7f2cc4002db8 s->prefetch_data=0 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.761+0000 7f2cddffb640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.480154+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.761+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo1 state=0x7f2cc4002db8 s->prefetch_data=0 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.761+0000 7f2cddffb640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2cc4002db8 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.761+0000 7f2cddffb640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.2 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.762+0000 7f2cde7fc640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.762+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002ad0 obj=vwwrqh-11:ooo9 state=0x7f2ccc002db8 s->prefetch_data=0 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.762+0000 7f2cde7fc640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.488597+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.762+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002ad0 obj=vwwrqh-11:ooo9 state=0x7f2ccc002db8 s->prefetch_data=0 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.762+0000 7f2cde7fc640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2ccc002db8 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.762+0000 7f2cde7fc640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.1 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.763+0000 7f2cdeffd640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.763+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8002ab0 obj=vwwrqh-11:ooo8 state=0x7f2cc8002d98 s->prefetch_data=0 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.763+0000 7f2cdeffd640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.488657+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.763+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8002ab0 obj=vwwrqh-11:ooo8 state=0x7f2cc8002d98 s->prefetch_data=0 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.763+0000 7f2cdeffd640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2cc8002d98 2024-05-15T14:30:42.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.763+0000 7f2cdeffd640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.3 2024-05-15T14:30:42.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.764+0000 7f2cddffb640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo1 wp_thrd: 0, 2 2024-05-15T14:30:42.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.764+0000 7f2cddffb640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo1 wp_thrd: 0, 2 2024-05-15T14:30:42.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.764+0000 7f2cddffb640 20 lifecycle: operator()(): key=ooo2wp_thrd: 0, 2 2024-05-15T14:30:42.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.764+0000 7f2cddffb640 20 lifecycle: check(): key=ooo2: is_expired=1 size_check_p: 1 wp_thrd: 0, 2 2024-05-15T14:30:42.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.764+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo2 state=0x7f2cc4004a18 s->prefetch_data=0 2024-05-15T14:30:42.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.765+0000 7f2cddffb640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.765+0000 7f2cddffb640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.16394074341462963275 2024-05-15T14:30:42.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.765+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.765+0000 7f2cddffb640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.765+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.765+0000 7f2cde7fc640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo9 wp_thrd: 0, 1 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2d9cff9640 20 handle_completion(): completion ok for obj=ooo1 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cdeffd640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo8 wp_thrd: 0, 0 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cde7fc640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo9 wp_thrd: 0, 1 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cdeffd640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo8 wp_thrd: 0, 0 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cde7fc640 20 lifecycle: operator()(): key=ooo7wp_thrd: 0, 1 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cdeffd640 20 lifecycle: operator()(): key=ooo6wp_thrd: 0, 0 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cde7fc640 20 lifecycle: check(): key=ooo7: is_expired=1 size_check_p: 1 wp_thrd: 0, 1 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cdeffd640 20 lifecycle: check(): key=ooo6: is_expired=1 size_check_p: 1 wp_thrd: 0, 0 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002ad0 obj=vwwrqh-11:ooo7 state=0x7f2ccc004a18 s->prefetch_data=0 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8002ab0 obj=vwwrqh-11:ooo6 state=0x7f2cc80049a8 s->prefetch_data=0 2024-05-15T14:30:42.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cde7fc640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cde7fc640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.17112670380444719503 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.766+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2cde7fc640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2d8bfff640 20 handle_completion(): completion ok for obj=ooo9 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2cdeffd640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2cdeffd640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.13392714696461060907 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2cdeffd640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.767+0000 7f2d9cff9640 20 handle_completion(): completion ok for obj=ooo8 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.768+0000 7f2cddffb640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.768+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.772+0000 7f2cde7fc640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.772+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.772+0000 7f2cdeffd640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.772+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.773+0000 7f2cddffb640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.773+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo2 state=0x7f2cc4004a18 s->prefetch_data=0 2024-05-15T14:30:42.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.773+0000 7f2cddffb640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.481709+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.773+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo2 state=0x7f2cc4004a18 s->prefetch_data=0 2024-05-15T14:30:42.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.773+0000 7f2cddffb640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2cc4004a18 2024-05-15T14:30:42.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.773+0000 7f2cddffb640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.9 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cde7fc640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002ad0 obj=vwwrqh-11:ooo7 state=0x7f2ccc004a18 s->prefetch_data=0 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cde7fc640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.486159+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002ad0 obj=vwwrqh-11:ooo7 state=0x7f2ccc004a18 s->prefetch_data=0 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cde7fc640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2ccc004a18 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cde7fc640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.7 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cdeffd640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8002ab0 obj=vwwrqh-11:ooo6 state=0x7f2cc80049a8 s->prefetch_data=0 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cdeffd640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.487782+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8002ab0 obj=vwwrqh-11:ooo6 state=0x7f2cc80049a8 s->prefetch_data=0 2024-05-15T14:30:42.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cdeffd640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2cc80049a8 2024-05-15T14:30:42.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.774+0000 7f2cdeffd640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.9 2024-05-15T14:30:42.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo2 wp_thrd: 0, 2 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo2 wp_thrd: 0, 2 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 20 lifecycle: operator()(): key=ooo4wp_thrd: 0, 2 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 20 lifecycle: check(): key=ooo4: is_expired=1 size_check_p: 1 wp_thrd: 0, 2 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo4 state=0x7f2cc4002db8 s->prefetch_data=0 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.2775311086552196150 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.776+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo7 wp_thrd: 0, 1 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo7 wp_thrd: 0, 1 2024-05-15T14:30:42.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 20 lifecycle: operator()(): key=ooo0wp_thrd: 0, 1 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 20 lifecycle: check(): key=ooo0: is_expired=1 size_check_p: 1 wp_thrd: 0, 1 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002a50 obj=vwwrqh-11:ooo0 state=0x7f2ccc004a18 s->prefetch_data=0 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2d8bfff640 20 handle_completion(): completion ok for obj=ooo2 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.304861159354489109 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cdeffd640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo6 wp_thrd: 0, 0 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cdeffd640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo6 wp_thrd: 0, 0 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cdeffd640 20 lifecycle: operator()(): key=ooo3wp_thrd: 0, 0 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cdeffd640 20 lifecycle: check(): key=ooo3: is_expired=1 size_check_p: 1 wp_thrd: 0, 0 2024-05-15T14:30:42.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8004250 obj=vwwrqh-11:ooo3 state=0x7f2cc80049a8 s->prefetch_data=0 2024-05-15T14:30:42.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cdeffd640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cdeffd640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6142404530727936877 2024-05-15T14:30:42.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.777+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.778+0000 7f2cdeffd640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.778+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.778+0000 7f2d9cff9640 20 handle_completion(): completion ok for obj=ooo7 2024-05-15T14:30:42.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.778+0000 7f2d8bfff640 20 handle_completion(): completion ok for obj=ooo6 2024-05-15T14:30:42.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.779+0000 7f2cddffb640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.779+0000 7f2cddffb640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.782+0000 7f2cde7fc640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.782+0000 7f2cde7fc640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.783+0000 7f2cdeffd640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.783+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.783+0000 7f2cddffb640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.783+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo4 state=0x7f2cc4002db8 s->prefetch_data=0 2024-05-15T14:30:42.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.783+0000 7f2cddffb640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.480423+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.783+0000 7f2cddffb640 20 lifecycle: get_obj_state: octx=0x7f2cc4002ad0 obj=vwwrqh-11:ooo4 state=0x7f2cc4002db8 s->prefetch_data=0 2024-05-15T14:30:42.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.783+0000 7f2cddffb640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2cc4002db8 2024-05-15T14:30:42.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.783+0000 7f2cddffb640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.5 2024-05-15T14:30:42.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.784+0000 7f2cde7fc640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.784+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002a50 obj=vwwrqh-11:ooo0 state=0x7f2ccc004a18 s->prefetch_data=0 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.784+0000 7f2cde7fc640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.476251+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.784+0000 7f2cde7fc640 20 lifecycle: get_obj_state: octx=0x7f2ccc002a50 obj=vwwrqh-11:ooo0 state=0x7f2ccc004a18 s->prefetch_data=0 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.784+0000 7f2cde7fc640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2ccc004a18 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.784+0000 7f2cde7fc640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.4 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.785+0000 7f2cdeffd640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.785+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8004250 obj=vwwrqh-11:ooo3 state=0x7f2cc80049a8 s->prefetch_data=0 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.785+0000 7f2cdeffd640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.482145+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.785+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8004250 obj=vwwrqh-11:ooo3 state=0x7f2cc80049a8 s->prefetch_data=0 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.785+0000 7f2cdeffd640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2cc80049a8 2024-05-15T14:30:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.785+0000 7f2cdeffd640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.7 2024-05-15T14:30:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.786+0000 7f2cddffb640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo4 wp_thrd: 0, 2 2024-05-15T14:30:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.786+0000 7f2cddffb640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo4 wp_thrd: 0, 2 2024-05-15T14:30:42.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.787+0000 7f2cde7fc640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo0 wp_thrd: 0, 1 2024-05-15T14:30:42.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.787+0000 7f2cde7fc640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo0 wp_thrd: 0, 1 2024-05-15T14:30:42.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.787+0000 7f2d9cff9640 20 handle_completion(): completion ok for obj=ooo4 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.787+0000 7f2cdeffd640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo3 wp_thrd: 0, 0 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.787+0000 7f2cdeffd640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo3 wp_thrd: 0, 0 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.787+0000 7f2cdeffd640 20 lifecycle: operator()(): key=ooo5wp_thrd: 0, 0 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.787+0000 7f2cdeffd640 20 lifecycle: check(): key=ooo5: is_expired=1 size_check_p: 1 wp_thrd: 0, 0 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.787+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8001ea0 obj=vwwrqh-11:ooo5 state=0x7f2cc8002d98 s->prefetch_data=0 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.788+0000 7f2cdeffd640 10 lifecycle: manifest: total_size = 3 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.788+0000 7f2cdeffd640 20 lifecycle: get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.5504975874142839261 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.788+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.788+0000 7f2cdeffd640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:ObjectLifecycle:Expiration:Current' 2024-05-15T14:30:42.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.788+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.788+0000 7f2d8bfff640 20 handle_completion(): completion ok for obj=ooo0 2024-05-15T14:30:42.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.789+0000 7f2d9cff9640 20 handle_completion(): completion ok for obj=ooo3 2024-05-15T14:30:42.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.791+0000 7f2cdeffd640 20 lifecycle: INFO: notification: 'vwwrqh-11_notif' on topic: 'vwwrqh-11_topic' and bucket: 'vwwrqh-11' (unique topic: 'vwwrqh-11_topic') apply to event of type: 's3:LifecycleExpiration:Delete' 2024-05-15T14:30:42.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.791+0000 7f2cdeffd640 10 lifecycle: cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:30:42.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.792+0000 7f2cdeffd640 20 lifecycle: checking zone tier_type= 2024-05-15T14:30:42.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.792+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8001ea0 obj=vwwrqh-11:ooo5 state=0x7f2cc8002d98 s->prefetch_data=0 2024-05-15T14:30:42.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.792+0000 7f2cdeffd640 10 lifecycle: If-UnModified-Since: 2024-05-15T14:30:42.484158+0000 Last-Modified: 2024-05-15T14:30:42.000000+0000 2024-05-15T14:30:42.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.792+0000 7f2cdeffd640 20 lifecycle: get_obj_state: octx=0x7f2cc8001ea0 obj=vwwrqh-11:ooo5 state=0x7f2cc8002d98 s->prefetch_data=0 2024-05-15T14:30:42.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.792+0000 7f2cdeffd640 20 lifecycle: prepare_atomic_modification: state is not atomic. state=0x7f2cc8002d98 2024-05-15T14:30:42.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.792+0000 7f2cdeffd640 20 lifecycle: bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9.1 2024-05-15T14:30:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.795+0000 7f2cdeffd640 2 lifecycle: DELETED::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo5 wp_thrd: 0, 0 2024-05-15T14:30:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.795+0000 7f2cdeffd640 20 lifecycle: processed::vwwrqh-11[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9]):ooo5 wp_thrd: 0, 0 2024-05-15T14:30:42.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:42.796+0000 7f2d8bfff640 20 handle_completion(): completion ok for obj=ooo5 2024-05-15T14:30:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.557+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): END entry 2: :vwwrqh-11:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9:lc.17:1715783442:1 index: 17 worker ix: 0 ret: 0 2024-05-15T14:30:44.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.560+0000 7f2ebde13800 5 lifecycle: RGWLC::process() next_entry not found. cycle finished lc_shard=lc.17 worker=0 2024-05-15T14:30:44.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.563+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 3 worker ix: 0 2024-05-15T14:30:44.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.565+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.3 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.565+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.567+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 13 worker ix: 0 2024-05-15T14:30:44.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.569+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.13 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.569+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.570+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 9 worker ix: 0 2024-05-15T14:30:44.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.573+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.9 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.573+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.574+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 8 worker ix: 0 2024-05-15T14:30:44.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.576+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.8 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.576+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.578+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 12 worker ix: 0 2024-05-15T14:30:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.580+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.12 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.580+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.581+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 10 worker ix: 0 2024-05-15T14:30:44.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.583+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.10 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.583+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.585+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 6 worker ix: 0 2024-05-15T14:30:44.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.586+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.6 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.587+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.588+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 1 worker ix: 0 2024-05-15T14:30:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.590+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.1 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.590+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.591+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 25 worker ix: 0 2024-05-15T14:30:44.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.593+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.25 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.594+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.595+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 14 worker ix: 0 2024-05-15T14:30:44.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.597+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.14 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.597+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.598+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 27 worker ix: 0 2024-05-15T14:30:44.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.600+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.27 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.601+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.602+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 0 worker ix: 0 2024-05-15T14:30:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.603+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.0 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.604+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.605+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 16 worker ix: 0 2024-05-15T14:30:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.607+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.16 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.607+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.608+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 5 worker ix: 0 2024-05-15T14:30:44.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.610+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.5 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.611+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.612+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 28 worker ix: 0 2024-05-15T14:30:44.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.614+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.28 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.614+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.615+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 2 worker ix: 0 2024-05-15T14:30:44.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.617+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.2 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.617+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.618+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 11 worker ix: 0 2024-05-15T14:30:44.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.620+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.11 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.620+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.621+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 7 worker ix: 0 2024-05-15T14:30:44.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.623+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.7 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.623+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.625+0000 7f2ebde13800 5 lifecycle: RGWLC::process(): ENTER: index: 20 worker ix: 0 2024-05-15T14:30:44.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.626+0000 7f2ebde13800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.20 head.marker= head.shard_rollover_date=0 2024-05-15T14:30:44.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.627+0000 7f2ebde13800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:30:44.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.796+0000 7f2d6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:30:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.799+0000 7f2ebde13800 20 remove_watcher() i=0 2024-05-15T14:30:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.799+0000 7f2ebde13800 2 removed watcher, disabling cache 2024-05-15T14:30:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.801+0000 7f2ebde13800 20 remove_watcher() i=1 2024-05-15T14:30:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.802+0000 7f2ebde13800 20 remove_watcher() i=2 2024-05-15T14:30:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.804+0000 7f2ebde13800 20 remove_watcher() i=3 2024-05-15T14:30:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.805+0000 7f2ebde13800 20 remove_watcher() i=4 2024-05-15T14:30:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.807+0000 7f2ebde13800 20 remove_watcher() i=5 2024-05-15T14:30:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.808+0000 7f2ebde13800 20 remove_watcher() i=6 2024-05-15T14:30:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:30:44.810+0000 7f2ebde13800 20 remove_watcher() i=7 2024-05-15T14:31:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:31:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.938+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.940+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.940+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.941+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.941+0000 7fc0c632f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.941+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.941+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.941+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.942+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.942+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.942+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.942+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.943+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.943+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.943+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.943+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.944+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.944+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 20 zone MyZone found 2024-05-15T14:31:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.945+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.946+0000 7fc0c632f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.946+0000 7fc0c632f800 20 started sync module instance, tier type = 2024-05-15T14:31:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.946+0000 7fc0c632f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:04.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.957+0000 7fc0c632f800 20 add_watcher() i=0 2024-05-15T14:31:04.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.957+0000 7fc0c632f800 20 add_watcher() i=1 2024-05-15T14:31:04.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.957+0000 7fc0c632f800 20 add_watcher() i=2 2024-05-15T14:31:04.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.957+0000 7fc0c632f800 20 add_watcher() i=3 2024-05-15T14:31:04.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.957+0000 7fc0c632f800 20 add_watcher() i=4 2024-05-15T14:31:04.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.957+0000 7fc0c632f800 20 add_watcher() i=5 2024-05-15T14:31:04.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.957+0000 7fc0c632f800 20 add_watcher() i=6 2024-05-15T14:31:04.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.958+0000 7fc0c632f800 20 add_watcher() i=7 2024-05-15T14:31:04.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.958+0000 7fc0c632f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:04.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.960+0000 7fbf737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:04.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.960+0000 7fc0c632f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:04.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.960+0000 7fc0c632f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:04.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.961+0000 7fc0c632f800 5 note: GC not initialized 2024-05-15T14:31:04.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.961+0000 7fbf727fc640 20 reqs_thread_entry: start 2024-05-15T14:31:04.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.961+0000 7fc0c632f800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:04.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.961+0000 7fc0c632f800 20 Filter name: none 2024-05-15T14:31:04.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.961+0000 7fbee3fff640 20 reqs_thread_entry: start 2024-05-15T14:31:04.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.962+0000 7fc0c632f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:04.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.962+0000 7fc0c632f800 20 rados_obj.operate() r=0 bl.length=241 2024-05-15T14:31:04.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.964+0000 7fbf737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:04.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.966+0000 7fc0c632f800 20 remove_watcher() i=0 2024-05-15T14:31:04.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.966+0000 7fc0c632f800 2 removed watcher, disabling cache 2024-05-15T14:31:04.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.967+0000 7fc0c632f800 20 remove_watcher() i=1 2024-05-15T14:31:04.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.968+0000 7fc0c632f800 20 remove_watcher() i=2 2024-05-15T14:31:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.969+0000 7fc0c632f800 20 remove_watcher() i=3 2024-05-15T14:31:04.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.970+0000 7fc0c632f800 20 remove_watcher() i=4 2024-05-15T14:31:04.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.972+0000 7fc0c632f800 20 remove_watcher() i=5 2024-05-15T14:31:04.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.972+0000 7fc0c632f800 20 remove_watcher() i=6 2024-05-15T14:31:04.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:04.973+0000 7fc0c632f800 20 remove_watcher() i=7 2024-05-15T14:31:06.883 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.884 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.884 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.884 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.885 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.886 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.886 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.887 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.887 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.888 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.888 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.889 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:06.890 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:06] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:07.924 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:07.924 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:07.925 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:07.925 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:07.926 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:10.037 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:31:10.038 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:10.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.082+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.084+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.084+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.085+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.085+0000 7f3b8d230800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.085+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.085+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:10.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.085+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.086+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:10.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.086+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.086+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.086+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.087+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.087+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.087+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.087+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.088+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.088+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:10.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 zone MyZone found 2024-05-15T14:31:10.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:10.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 started sync module instance, tier type = 2024-05-15T14:31:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.089+0000 7f3b8d230800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:10.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.101+0000 7f3b8d230800 20 add_watcher() i=0 2024-05-15T14:31:10.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.101+0000 7f3b8d230800 20 add_watcher() i=1 2024-05-15T14:31:10.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.101+0000 7f3b8d230800 20 add_watcher() i=2 2024-05-15T14:31:10.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.101+0000 7f3b8d230800 20 add_watcher() i=3 2024-05-15T14:31:10.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.101+0000 7f3b8d230800 20 add_watcher() i=4 2024-05-15T14:31:10.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.101+0000 7f3b8d230800 20 add_watcher() i=5 2024-05-15T14:31:10.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.101+0000 7f3b8d230800 20 add_watcher() i=6 2024-05-15T14:31:10.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.102+0000 7f3b8d230800 20 add_watcher() i=7 2024-05-15T14:31:10.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.102+0000 7f3b8d230800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:10.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.104+0000 7f3a3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.104+0000 7f3b8d230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.104+0000 7f3b8d230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.104+0000 7f3b8d230800 5 note: GC not initialized 2024-05-15T14:31:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.104+0000 7f3a3d7e2640 20 reqs_thread_entry: start 2024-05-15T14:31:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.104+0000 7f3b8d230800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.104+0000 7f3b8d230800 20 Filter name: none 2024-05-15T14:31:10.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.105+0000 7f39aeffd640 20 reqs_thread_entry: start 2024-05-15T14:31:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.105+0000 7f3b8d230800 20 rados->read ofs=0 len=0 2024-05-15T14:31:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.106+0000 7f3b8d230800 20 rados_obj.operate() r=0 bl.length=241 2024-05-15T14:31:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.107+0000 7f3a3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.110+0000 7f3b8d230800 20 remove_watcher() i=0 2024-05-15T14:31:10.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.110+0000 7f3b8d230800 2 removed watcher, disabling cache 2024-05-15T14:31:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.111+0000 7f3b8d230800 20 remove_watcher() i=1 2024-05-15T14:31:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.112+0000 7f3b8d230800 20 remove_watcher() i=2 2024-05-15T14:31:10.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.113+0000 7f3b8d230800 20 remove_watcher() i=3 2024-05-15T14:31:10.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.114+0000 7f3b8d230800 20 remove_watcher() i=4 2024-05-15T14:31:10.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.115+0000 7f3b8d230800 20 remove_watcher() i=5 2024-05-15T14:31:10.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.116+0000 7f3b8d230800 20 remove_watcher() i=6 2024-05-15T14:31:10.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:10.117+0000 7f3b8d230800 20 remove_watcher() i=7 2024-05-15T14:31:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:31:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:test that when a multipart upload is aborted by lifecycle policy, notification is sent on master ... 127.0.0.1 - - [15/May/2024 14:31:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:16.742 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:31:16.743 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.785+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.787+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.787+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.788+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.788+0000 7f56a583f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.788+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.788+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.788+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.789+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.789+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.789+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.789+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.790+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:16.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.790+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.790+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:16.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.790+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.791+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.791+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 20 zone MyZone found 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.792+0000 7f56a583f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.793+0000 7f56a583f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.793+0000 7f56a583f800 20 started sync module instance, tier type = 2024-05-15T14:31:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.793+0000 7f56a583f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.804+0000 7f56a583f800 20 add_watcher() i=0 2024-05-15T14:31:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.804+0000 7f56a583f800 20 add_watcher() i=1 2024-05-15T14:31:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.804+0000 7f56a583f800 20 add_watcher() i=2 2024-05-15T14:31:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.804+0000 7f56a583f800 20 add_watcher() i=3 2024-05-15T14:31:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.804+0000 7f56a583f800 20 add_watcher() i=4 2024-05-15T14:31:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.804+0000 7f56a583f800 20 add_watcher() i=5 2024-05-15T14:31:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.804+0000 7f56a583f800 20 add_watcher() i=6 2024-05-15T14:31:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.805+0000 7f56a583f800 20 add_watcher() i=7 2024-05-15T14:31:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.805+0000 7f56a583f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.806+0000 7f5559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.807+0000 7f56a583f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.807+0000 7f56a583f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.843+0000 7f5558fe1640 20 reqs_thread_entry: start 2024-05-15T14:31:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.843+0000 7f56a583f800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.843+0000 7f56a583f800 20 Filter name: none 2024-05-15T14:31:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.843+0000 7f54d27fc640 20 reqs_thread_entry: start 2024-05-15T14:31:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.843+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 26 worker ix: 0 2024-05-15T14:31:16.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.844+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.26 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:16.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.845+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.846+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 24 worker ix: 0 2024-05-15T14:31:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.847+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.24 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.848+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:16.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.849+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 10 worker ix: 0 2024-05-15T14:31:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.850+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.10 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.850+0000 7f56a583f800 5 lifecycle: RGWLC::process(): START entry 1: :vwwrqh-12:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10:lc.10:0:0 index: 10 worker ix: 0 2024-05-15T14:31:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.852+0000 7f56a583f800 5 lifecycle: RGWLC::process(): START entry 2: :vwwrqh-12:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10:lc.10:1715783476:1 index: 10 worker ix: 0 2024-05-15T14:31:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.853+0000 7f56a583f800 5 lifecycle: RGWLC::bucket_lc_process ENTER bucket=vwwrqh-12 2024-05-15T14:31:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.853+0000 7f56a583f800 10 lifecycle: cache get: name=MyZone.rgw.meta+root+vwwrqh-12 : miss 2024-05-15T14:31:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.853+0000 7f56a583f800 20 lifecycle: rados->read ofs=0 len=0 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 20 lifecycle: rados_obj.operate() r=0 bl.length=189 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: cache put: name=MyZone.rgw.meta+root+vwwrqh-12 info.flags=0x11 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: adding MyZone.rgw.meta+root+vwwrqh-12 to cache LRU end 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: cache get: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-12:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10 : miss 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 20 lifecycle: rados->read ofs=0 len=0 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 20 lifecycle: rados_obj.operate() r=0 bl.length=403 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-12:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10 info.flags=0x17 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: adding MyZone.rgw.meta+root+.bucket.meta.vwwrqh-12:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10 to cache LRU end 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:31:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:31:16.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: updating xattr: name=user.rgw.bucket-notification bl.length()=394 2024-05-15T14:31:16.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: updating xattr: name=user.rgw.lc bl.length()=150 2024-05-15T14:31:16.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: chain_cache_entry: cache_locator=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-12:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10 2024-05-15T14:31:16.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.854+0000 7f56a583f800 10 lifecycle: bucket_lc_process() prefix_map size=1 2024-05-15T14:31:16.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.856+0000 7f56a583f800 10 lifecycle: cls_bucket_list_unordered: got _multipart_ooo1.2~yuSj4ZUX7ltpPwic3Z8qRUixSOMJhM-.1 2024-05-15T14:31:16.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.856+0000 7f56a583f800 10 lifecycle: cls_bucket_list_unordered: got _multipart_ooo1.2~yuSj4ZUX7ltpPwic3Z8qRUixSOMJhM-.meta 2024-05-15T14:31:16.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.859+0000 7f56a583f800 20 lifecycle: list_objects_unordered: skipping "_multipart_ooo1.2~yuSj4ZUX7ltpPwic3Z8qRUixSOMJhM-.1" because doesn't match filter 2024-05-15T14:31:16.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:16.859+0000 7f54d17fa640 20 lifecycle: obj_has_expired(): mtime=2024-05-15T14:31:16.582753+0000 days=1 base_time=2024-05-15T00:00:00.000000+0000 timediff=-52276 cmp=86400 is_expired=0 2024-05-15T14:31:18.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.060+0000 7f56a583f800 5 lifecycle: RGWLC::process(): END entry 2: :vwwrqh-12:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10:lc.10:1715783476:1 index: 10 worker ix: 0 ret: 0 2024-05-15T14:31:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.063+0000 7f56a583f800 5 lifecycle: RGWLC::process() next_entry not found. cycle finished lc_shard=lc.10 worker=0 2024-05-15T14:31:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.065+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 28 worker ix: 0 2024-05-15T14:31:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.067+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.28 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.068+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.070+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 5 worker ix: 0 2024-05-15T14:31:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.072+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.5 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.072+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.074+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 29 worker ix: 0 2024-05-15T14:31:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.076+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.29 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.076+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.077+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 31 worker ix: 0 2024-05-15T14:31:18.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.083+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.31 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.083+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.085+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 12 worker ix: 0 2024-05-15T14:31:18.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.087+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.12 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.088+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.089+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 14 worker ix: 0 2024-05-15T14:31:18.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.091+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.14 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.091+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.093+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 9 worker ix: 0 2024-05-15T14:31:18.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.095+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.9 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.095+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.097+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 21 worker ix: 0 2024-05-15T14:31:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.098+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.21 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.099+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.100+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 25 worker ix: 0 2024-05-15T14:31:18.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.102+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.25 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.102+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.104+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 19 worker ix: 0 2024-05-15T14:31:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.106+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.19 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.106+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.107+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 16 worker ix: 0 2024-05-15T14:31:18.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.109+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.16 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.109+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.111+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 23 worker ix: 0 2024-05-15T14:31:18.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.112+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.23 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.113+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.114+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 7 worker ix: 0 2024-05-15T14:31:18.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.116+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.7 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.116+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.118+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 4 worker ix: 0 2024-05-15T14:31:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.120+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.4 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.120+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.121+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 8 worker ix: 0 2024-05-15T14:31:18.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.123+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.8 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.123+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.124+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 2 worker ix: 0 2024-05-15T14:31:18.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.126+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.2 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.126+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.127+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 15 worker ix: 0 2024-05-15T14:31:18.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.129+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.15 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.129+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.131+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 27 worker ix: 0 2024-05-15T14:31:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.132+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.27 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.133+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.134+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 22 worker ix: 0 2024-05-15T14:31:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.135+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.22 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.136+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.137+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 18 worker ix: 0 2024-05-15T14:31:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.138+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.18 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.138+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.140+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 6 worker ix: 0 2024-05-15T14:31:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.141+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.6 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.141+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.142+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 3 worker ix: 0 2024-05-15T14:31:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.144+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.3 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.144+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.145+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 13 worker ix: 0 2024-05-15T14:31:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.147+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.13 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.147+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.148+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 30 worker ix: 0 2024-05-15T14:31:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.150+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.30 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.150+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.151+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 20 worker ix: 0 2024-05-15T14:31:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.153+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.20 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.153+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.154+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 1 worker ix: 0 2024-05-15T14:31:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.155+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.1 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.155+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.157+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 11 worker ix: 0 2024-05-15T14:31:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.158+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.11 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.158+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.159+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 17 worker ix: 0 2024-05-15T14:31:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.161+0000 7f56a583f800 0 lifecycle: RGWLC::process() head.marker !empty() at START for shard==lc.17 head last stored at Wed May 15 14:30:42 2024 2024-05-15T14:31:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.163+0000 7f56a583f800 5 lifecycle: RGWLC::process() next_entry not found. cycle finished lc_shard=lc.17 worker=0 2024-05-15T14:31:18.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.165+0000 7f56a583f800 5 lifecycle: RGWLC::process(): ENTER: index: 0 worker ix: 0 2024-05-15T14:31:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.166+0000 7f56a583f800 5 lifecycle: RGWLC::process() process shard rollover lc_shard=lc.0 head.marker= head.shard_rollover_date=0 2024-05-15T14:31:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.167+0000 7f56a583f800 5 lifecycle: RGWLC::process() entry.bucket.empty() == true at START 1 (this is possible mainly before any lc policy has been stored or after removal of an lc_shard object) 2024-05-15T14:31:18.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.261+0000 7f5559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.263+0000 7f56a583f800 20 remove_watcher() i=0 2024-05-15T14:31:18.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.263+0000 7f56a583f800 2 removed watcher, disabling cache 2024-05-15T14:31:18.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.265+0000 7f56a583f800 20 remove_watcher() i=1 2024-05-15T14:31:18.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.266+0000 7f56a583f800 20 remove_watcher() i=2 2024-05-15T14:31:18.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.267+0000 7f56a583f800 20 remove_watcher() i=3 2024-05-15T14:31:18.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.268+0000 7f56a583f800 20 remove_watcher() i=4 2024-05-15T14:31:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.270+0000 7f56a583f800 20 remove_watcher() i=5 2024-05-15T14:31:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.271+0000 7f56a583f800 20 remove_watcher() i=6 2024-05-15T14:31:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:18.272+0000 7f56a583f800 20 remove_watcher() i=7 2024-05-15T14:31:38.352 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:31:38.352 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:38.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.394+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.396+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:38.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.396+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.397+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:38.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.397+0000 7fc3b2546800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:38.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.397+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.398+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:38.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.398+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.399+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:38.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.399+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.399+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.399+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.399+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.399+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.400+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:38.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.400+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.400+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:38.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.400+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 20 zone MyZone found 2024-05-15T14:31:38.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.401+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.402+0000 7fc3b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.402+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.402+0000 7fc3b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.402+0000 7fc3b2546800 20 started sync module instance, tier type = 2024-05-15T14:31:38.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.402+0000 7fc3b2546800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.413+0000 7fc3b2546800 20 add_watcher() i=0 2024-05-15T14:31:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.413+0000 7fc3b2546800 20 add_watcher() i=1 2024-05-15T14:31:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.413+0000 7fc3b2546800 20 add_watcher() i=2 2024-05-15T14:31:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.413+0000 7fc3b2546800 20 add_watcher() i=3 2024-05-15T14:31:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.413+0000 7fc3b2546800 20 add_watcher() i=4 2024-05-15T14:31:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.413+0000 7fc3b2546800 20 add_watcher() i=5 2024-05-15T14:31:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.413+0000 7fc3b2546800 20 add_watcher() i=6 2024-05-15T14:31:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.414+0000 7fc3b2546800 20 add_watcher() i=7 2024-05-15T14:31:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.414+0000 7fc3b2546800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.417+0000 7fc266fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.417+0000 7fc3b2546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.417+0000 7fc3b2546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.417+0000 7fc3b2546800 5 note: GC not initialized 2024-05-15T14:31:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.417+0000 7fc265fdb640 20 reqs_thread_entry: start 2024-05-15T14:31:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.417+0000 7fc3b2546800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.417+0000 7fc3b2546800 20 Filter name: none 2024-05-15T14:31:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.417+0000 7fc1d77fe640 20 reqs_thread_entry: start 2024-05-15T14:31:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.418+0000 7fc3b2546800 20 rados->read ofs=0 len=0 2024-05-15T14:31:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.418+0000 7fc3b2546800 20 rados_obj.operate() r=0 bl.length=241 2024-05-15T14:31:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.420+0000 7fc266fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:38.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.423+0000 7fc3b2546800 20 remove_watcher() i=0 2024-05-15T14:31:38.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.423+0000 7fc3b2546800 2 removed watcher, disabling cache 2024-05-15T14:31:38.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.424+0000 7fc3b2546800 20 remove_watcher() i=1 2024-05-15T14:31:38.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.425+0000 7fc3b2546800 20 remove_watcher() i=2 2024-05-15T14:31:38.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.426+0000 7fc3b2546800 20 remove_watcher() i=3 2024-05-15T14:31:38.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.427+0000 7fc3b2546800 20 remove_watcher() i=4 2024-05-15T14:31:38.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.428+0000 7fc3b2546800 20 remove_watcher() i=5 2024-05-15T14:31:38.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.429+0000 7fc3b2546800 20 remove_watcher() i=6 2024-05-15T14:31:38.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:38.430+0000 7fc3b2546800 20 remove_watcher() i=7 2024-05-15T14:31:43.977 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:31:43.980 INFO:teuthology.orchestra.run.smithi018.stderr:test http multipart object upload on master ... 127.0.0.1 - - [15/May/2024 14:31:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:44.524 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:49.542 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:49] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:50.043 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:31:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:test persistent topic stats ... ignoring --setuser ceph since I am not root 2024-05-15T14:31:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.170+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.171+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.172+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.172+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.172+0000 7f75ec951800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.172+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.173+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.173+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.173+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.173+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.174+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.174+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.174+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.174+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.174+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.174+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.175+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.175+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 20 zone MyZone found 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.176+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.177+0000 7f75ec951800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.177+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.177+0000 7f75ec951800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.177+0000 7f75ec951800 20 started sync module instance, tier type = 2024-05-15T14:31:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.177+0000 7f75ec951800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:50.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.188+0000 7f75ec951800 20 add_watcher() i=0 2024-05-15T14:31:50.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.188+0000 7f75ec951800 20 add_watcher() i=1 2024-05-15T14:31:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.188+0000 7f75ec951800 20 add_watcher() i=2 2024-05-15T14:31:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.188+0000 7f75ec951800 20 add_watcher() i=3 2024-05-15T14:31:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.188+0000 7f75ec951800 20 add_watcher() i=4 2024-05-15T14:31:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.188+0000 7f75ec951800 20 add_watcher() i=5 2024-05-15T14:31:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.188+0000 7f75ec951800 20 add_watcher() i=6 2024-05-15T14:31:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.189+0000 7f75ec951800 20 add_watcher() i=7 2024-05-15T14:31:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.189+0000 7f75ec951800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.190+0000 7f74a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.191+0000 7f75ec951800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.191+0000 7f75ec951800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.191+0000 7f75ec951800 5 note: GC not initialized 2024-05-15T14:31:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.191+0000 7f741b7fe640 20 reqs_thread_entry: start 2024-05-15T14:31:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.191+0000 7f75ec951800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.191+0000 7f75ec951800 20 Filter name: none 2024-05-15T14:31:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.191+0000 7f74197fa640 20 reqs_thread_entry: start 2024-05-15T14:31:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.192+0000 7f75ec951800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.192+0000 7f75ec951800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:31:50.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.194+0000 7f74a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:50.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.196+0000 7f75ec951800 20 remove_watcher() i=0 2024-05-15T14:31:50.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.196+0000 7f75ec951800 2 removed watcher, disabling cache 2024-05-15T14:31:50.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.197+0000 7f75ec951800 20 remove_watcher() i=1 2024-05-15T14:31:50.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.198+0000 7f75ec951800 20 remove_watcher() i=2 2024-05-15T14:31:50.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.199+0000 7f75ec951800 20 remove_watcher() i=3 2024-05-15T14:31:50.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.200+0000 7f75ec951800 20 remove_watcher() i=4 2024-05-15T14:31:50.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.201+0000 7f75ec951800 20 remove_watcher() i=5 2024-05-15T14:31:50.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.202+0000 7f75ec951800 20 remove_watcher() i=6 2024-05-15T14:31:50.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.203+0000 7f75ec951800 20 remove_watcher() i=7 2024-05-15T14:31:50.733 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:31:50.734 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:50.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.773+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.775+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.775+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.776+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.776+0000 7fb07443f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:50.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.776+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.776+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.776+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.776+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.777+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.777+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.777+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.777+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.777+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.778+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.778+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.778+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.778+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 20 zone MyZone found 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.779+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.780+0000 7fb07443f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.780+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.780+0000 7fb07443f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.780+0000 7fb07443f800 20 started sync module instance, tier type = 2024-05-15T14:31:50.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.780+0000 7fb07443f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:50.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 20 add_watcher() i=0 2024-05-15T14:31:50.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 20 add_watcher() i=1 2024-05-15T14:31:50.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 20 add_watcher() i=2 2024-05-15T14:31:50.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 20 add_watcher() i=3 2024-05-15T14:31:50.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 20 add_watcher() i=4 2024-05-15T14:31:50.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 20 add_watcher() i=5 2024-05-15T14:31:50.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 20 add_watcher() i=6 2024-05-15T14:31:50.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 20 add_watcher() i=7 2024-05-15T14:31:50.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.790+0000 7fb07443f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.792+0000 7faf23fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.793+0000 7fb07443f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.793+0000 7fb07443f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.793+0000 7fb07443f800 5 note: GC not initialized 2024-05-15T14:31:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.793+0000 7faf22ffd640 20 reqs_thread_entry: start 2024-05-15T14:31:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.793+0000 7fb07443f800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.793+0000 7fb07443f800 20 Filter name: none 2024-05-15T14:31:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.793+0000 7faf20ff9640 20 reqs_thread_entry: start 2024-05-15T14:31:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.793+0000 7fb07443f800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.794+0000 7fb07443f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:31:50.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.795+0000 7faf23fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:50.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.797+0000 7fb07443f800 20 remove_watcher() i=0 2024-05-15T14:31:50.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.797+0000 7fb07443f800 2 removed watcher, disabling cache 2024-05-15T14:31:50.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.798+0000 7fb07443f800 20 remove_watcher() i=1 2024-05-15T14:31:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.799+0000 7fb07443f800 20 remove_watcher() i=2 2024-05-15T14:31:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.800+0000 7fb07443f800 20 remove_watcher() i=3 2024-05-15T14:31:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.801+0000 7fb07443f800 20 remove_watcher() i=4 2024-05-15T14:31:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.802+0000 7fb07443f800 20 remove_watcher() i=5 2024-05-15T14:31:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.803+0000 7fb07443f800 20 remove_watcher() i=6 2024-05-15T14:31:50.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.804+0000 7fb07443f800 20 remove_watcher() i=7 2024-05-15T14:31:50.897 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:31:50.897 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:50.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.936+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.938+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.938+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.938+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.938+0000 7f3f2532d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:50.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.938+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.939+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.939+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.939+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:50.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.939+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.940+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:50.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.940+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.940+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.940+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.940+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:50.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.940+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.941+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:50.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.941+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:50.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 zone MyZone found 2024-05-15T14:31:50.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:50.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:50.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:50.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:50.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:50.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:50.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:50.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:50.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 started sync module instance, tier type = 2024-05-15T14:31:50.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.942+0000 7f3f2532d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:50.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.953+0000 7f3f2532d800 20 add_watcher() i=0 2024-05-15T14:31:50.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.953+0000 7f3f2532d800 20 add_watcher() i=1 2024-05-15T14:31:50.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.953+0000 7f3f2532d800 20 add_watcher() i=2 2024-05-15T14:31:50.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.953+0000 7f3f2532d800 20 add_watcher() i=3 2024-05-15T14:31:50.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.953+0000 7f3f2532d800 20 add_watcher() i=4 2024-05-15T14:31:50.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.953+0000 7f3f2532d800 20 add_watcher() i=5 2024-05-15T14:31:50.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.953+0000 7f3f2532d800 20 add_watcher() i=6 2024-05-15T14:31:50.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.954+0000 7f3f2532d800 20 add_watcher() i=7 2024-05-15T14:31:50.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.954+0000 7f3f2532d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:50.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.956+0000 7f3dd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:50.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.957+0000 7f3f2532d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:50.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.957+0000 7f3f2532d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:50.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.957+0000 7f3f2532d800 5 note: GC not initialized 2024-05-15T14:31:50.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.957+0000 7f3dd67e4640 20 reqs_thread_entry: start 2024-05-15T14:31:50.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.957+0000 7f3f2532d800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:50.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.957+0000 7f3f2532d800 20 Filter name: none 2024-05-15T14:31:50.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.957+0000 7f3dcf7fe640 20 reqs_thread_entry: start 2024-05-15T14:31:50.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.957+0000 7f3f2532d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:50.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.958+0000 7f3f2532d800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:31:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.960+0000 7f3dd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.962+0000 7f3f2532d800 20 remove_watcher() i=0 2024-05-15T14:31:50.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.962+0000 7f3f2532d800 2 removed watcher, disabling cache 2024-05-15T14:31:50.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.963+0000 7f3f2532d800 20 remove_watcher() i=1 2024-05-15T14:31:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.964+0000 7f3f2532d800 20 remove_watcher() i=2 2024-05-15T14:31:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.965+0000 7f3f2532d800 20 remove_watcher() i=3 2024-05-15T14:31:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.966+0000 7f3f2532d800 20 remove_watcher() i=4 2024-05-15T14:31:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.967+0000 7f3f2532d800 20 remove_watcher() i=5 2024-05-15T14:31:50.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.968+0000 7f3f2532d800 20 remove_watcher() i=6 2024-05-15T14:31:50.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:50.969+0000 7f3f2532d800 20 remove_watcher() i=7 2024-05-15T14:31:50.984 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:31:50] "POST / HTTP/1.1" 200 - 2024-05-15T14:31:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:31:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:51.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.064+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.066+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:51.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.066+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.067+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.067+0000 7f7c1b72d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.067+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.067+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:51.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.067+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.067+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:51.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.067+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.068+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:51.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.068+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.068+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:51.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.068+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.068+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:51.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.068+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.069+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:51.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.069+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 20 zone MyZone found 2024-05-15T14:31:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.070+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.071+0000 7f7c1b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.071+0000 7f7c1b72d800 20 started sync module instance, tier type = 2024-05-15T14:31:51.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.071+0000 7f7c1b72d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.080+0000 7f7c1b72d800 20 add_watcher() i=0 2024-05-15T14:31:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.080+0000 7f7c1b72d800 20 add_watcher() i=1 2024-05-15T14:31:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.080+0000 7f7c1b72d800 20 add_watcher() i=2 2024-05-15T14:31:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.080+0000 7f7c1b72d800 20 add_watcher() i=3 2024-05-15T14:31:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.080+0000 7f7c1b72d800 20 add_watcher() i=4 2024-05-15T14:31:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.080+0000 7f7c1b72d800 20 add_watcher() i=5 2024-05-15T14:31:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.080+0000 7f7c1b72d800 20 add_watcher() i=6 2024-05-15T14:31:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.081+0000 7f7c1b72d800 20 add_watcher() i=7 2024-05-15T14:31:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.081+0000 7f7c1b72d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.083+0000 7f7acdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.083+0000 7f7c1b72d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.083+0000 7f7c1b72d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.083+0000 7f7c1b72d800 5 note: GC not initialized 2024-05-15T14:31:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.083+0000 7f7accfe1640 20 reqs_thread_entry: start 2024-05-15T14:31:51.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.084+0000 7f7c1b72d800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.084+0000 7f7c1b72d800 20 Filter name: none 2024-05-15T14:31:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.084+0000 7f7a467fc640 20 reqs_thread_entry: start 2024-05-15T14:31:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.084+0000 7f7c1b72d800 20 rados->read ofs=0 len=0 2024-05-15T14:31:51.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.085+0000 7f7c1b72d800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:31:51.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.086+0000 7f7acdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:51.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.088+0000 7f7c1b72d800 20 remove_watcher() i=0 2024-05-15T14:31:51.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.088+0000 7f7c1b72d800 2 removed watcher, disabling cache 2024-05-15T14:31:51.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.089+0000 7f7c1b72d800 20 remove_watcher() i=1 2024-05-15T14:31:51.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.090+0000 7f7c1b72d800 20 remove_watcher() i=2 2024-05-15T14:31:51.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.091+0000 7f7c1b72d800 20 remove_watcher() i=3 2024-05-15T14:31:51.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.092+0000 7f7c1b72d800 20 remove_watcher() i=4 2024-05-15T14:31:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.093+0000 7f7c1b72d800 20 remove_watcher() i=5 2024-05-15T14:31:51.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.094+0000 7f7c1b72d800 20 remove_watcher() i=6 2024-05-15T14:31:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:51.095+0000 7f7c1b72d800 20 remove_watcher() i=7 2024-05-15T14:31:56.160 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:31:56.160 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:31:56.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.204+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.206+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:56.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.206+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.207+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:56.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.207+0000 7f4778c85800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:31:56.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.207+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.208+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:56.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.208+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.209+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:31:56.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.209+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.209+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:31:56.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.209+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.209+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:56.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.209+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.210+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:31:56.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.210+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.210+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:31:56.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.210+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:31:56.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 20 zone MyZone found 2024-05-15T14:31:56.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:31:56.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:31:56.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:31:56.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:31:56.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 20 period zonegroup name MyZoneGroup 2024-05-15T14:31:56.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:31:56.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.211+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.212+0000 7f4778c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:56.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.212+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.212+0000 7f4778c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:31:56.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.212+0000 7f4778c85800 20 started sync module instance, tier type = 2024-05-15T14:31:56.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.212+0000 7f4778c85800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:31:56.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.223+0000 7f4778c85800 20 add_watcher() i=0 2024-05-15T14:31:56.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.223+0000 7f4778c85800 20 add_watcher() i=1 2024-05-15T14:31:56.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.223+0000 7f4778c85800 20 add_watcher() i=2 2024-05-15T14:31:56.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.223+0000 7f4778c85800 20 add_watcher() i=3 2024-05-15T14:31:56.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.223+0000 7f4778c85800 20 add_watcher() i=4 2024-05-15T14:31:56.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.223+0000 7f4778c85800 20 add_watcher() i=5 2024-05-15T14:31:56.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.223+0000 7f4778c85800 20 add_watcher() i=6 2024-05-15T14:31:56.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.224+0000 7f4778c85800 20 add_watcher() i=7 2024-05-15T14:31:56.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.224+0000 7f4778c85800 2 all 8 watchers are set, enabling cache 2024-05-15T14:31:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.226+0000 7f462cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:56.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.226+0000 7f4778c85800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:31:56.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.226+0000 7f4778c85800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:31:56.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.227+0000 7f4778c85800 5 note: GC not initialized 2024-05-15T14:31:56.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.227+0000 7f45a77fe640 20 reqs_thread_entry: start 2024-05-15T14:31:56.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.227+0000 7f4778c85800 20 init_complete bucket index max shards: 11 2024-05-15T14:31:56.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.227+0000 7f4778c85800 20 Filter name: none 2024-05-15T14:31:56.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.227+0000 7f45a57fa640 20 reqs_thread_entry: start 2024-05-15T14:31:56.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.227+0000 7f4778c85800 20 rados->read ofs=0 len=0 2024-05-15T14:31:56.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.228+0000 7f4778c85800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:31:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.230+0000 7f462cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:31:56.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.232+0000 7f4778c85800 20 remove_watcher() i=0 2024-05-15T14:31:56.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.232+0000 7f4778c85800 2 removed watcher, disabling cache 2024-05-15T14:31:56.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.233+0000 7f4778c85800 20 remove_watcher() i=1 2024-05-15T14:31:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.234+0000 7f4778c85800 20 remove_watcher() i=2 2024-05-15T14:31:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.236+0000 7f4778c85800 20 remove_watcher() i=3 2024-05-15T14:31:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.237+0000 7f4778c85800 20 remove_watcher() i=4 2024-05-15T14:31:56.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.238+0000 7f4778c85800 20 remove_watcher() i=5 2024-05-15T14:31:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.239+0000 7f4778c85800 20 remove_watcher() i=6 2024-05-15T14:31:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:31:56.240+0000 7f4778c85800 20 remove_watcher() i=7 2024-05-15T14:32:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:32:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:32:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.346+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.348+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:01.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.348+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.349+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.349+0000 7f1567146800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:32:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.349+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.350+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.350+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.350+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:32:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.350+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.351+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:32:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.351+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.351+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.351+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.351+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.351+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.352+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:01.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.352+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:32:01.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 20 zone MyZone found 2024-05-15T14:32:01.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:32:01.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:32:01.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:32:01.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:32:01.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 20 period zonegroup name MyZoneGroup 2024-05-15T14:32:01.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:32:01.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.353+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.354+0000 7f1567146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.354+0000 7f1567146800 20 started sync module instance, tier type = 2024-05-15T14:32:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.354+0000 7f1567146800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:32:01.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.365+0000 7f1567146800 20 add_watcher() i=0 2024-05-15T14:32:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.365+0000 7f1567146800 20 add_watcher() i=1 2024-05-15T14:32:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.365+0000 7f1567146800 20 add_watcher() i=2 2024-05-15T14:32:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.365+0000 7f1567146800 20 add_watcher() i=3 2024-05-15T14:32:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.365+0000 7f1567146800 20 add_watcher() i=4 2024-05-15T14:32:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.365+0000 7f1567146800 20 add_watcher() i=5 2024-05-15T14:32:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.365+0000 7f1567146800 20 add_watcher() i=6 2024-05-15T14:32:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.366+0000 7f1567146800 20 add_watcher() i=7 2024-05-15T14:32:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.366+0000 7f1567146800 2 all 8 watchers are set, enabling cache 2024-05-15T14:32:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.368+0000 7f141afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.368+0000 7f1567146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:32:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.368+0000 7f1567146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:32:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.368+0000 7f1567146800 5 note: GC not initialized 2024-05-15T14:32:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.368+0000 7f1419fe3640 20 reqs_thread_entry: start 2024-05-15T14:32:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.369+0000 7f1567146800 20 init_complete bucket index max shards: 11 2024-05-15T14:32:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.369+0000 7f1567146800 20 Filter name: none 2024-05-15T14:32:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.369+0000 7f138b7fe640 20 reqs_thread_entry: start 2024-05-15T14:32:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.369+0000 7f1567146800 20 rados->read ofs=0 len=0 2024-05-15T14:32:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.370+0000 7f1567146800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:32:01.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.372+0000 7f141afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:01.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.374+0000 7f1567146800 20 remove_watcher() i=0 2024-05-15T14:32:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.374+0000 7f1567146800 2 removed watcher, disabling cache 2024-05-15T14:32:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.375+0000 7f1567146800 20 remove_watcher() i=1 2024-05-15T14:32:01.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.376+0000 7f1567146800 20 remove_watcher() i=2 2024-05-15T14:32:01.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.377+0000 7f1567146800 20 remove_watcher() i=3 2024-05-15T14:32:01.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.378+0000 7f1567146800 20 remove_watcher() i=4 2024-05-15T14:32:01.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.379+0000 7f1567146800 20 remove_watcher() i=5 2024-05-15T14:32:01.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.380+0000 7f1567146800 20 remove_watcher() i=6 2024-05-15T14:32:01.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:01.381+0000 7f1567146800 20 remove_watcher() i=7 2024-05-15T14:32:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:32:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:32:06.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.489+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.492+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:06.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.492+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.492+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:06.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.492+0000 7f8ef003f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:32:06.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.492+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.493+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:06.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.493+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.494+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:32:06.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.494+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.494+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:32:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.494+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.494+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.494+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.495+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:06.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.495+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.495+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:06.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.495+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:32:06.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 20 zone MyZone found 2024-05-15T14:32:06.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:32:06.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.496+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.497+0000 7f8ef003f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.497+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.497+0000 7f8ef003f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.497+0000 7f8ef003f800 20 started sync module instance, tier type = 2024-05-15T14:32:06.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.497+0000 7f8ef003f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:32:06.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.508+0000 7f8ef003f800 20 add_watcher() i=0 2024-05-15T14:32:06.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.508+0000 7f8ef003f800 20 add_watcher() i=1 2024-05-15T14:32:06.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.508+0000 7f8ef003f800 20 add_watcher() i=2 2024-05-15T14:32:06.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.508+0000 7f8ef003f800 20 add_watcher() i=3 2024-05-15T14:32:06.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.508+0000 7f8ef003f800 20 add_watcher() i=4 2024-05-15T14:32:06.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.508+0000 7f8ef003f800 20 add_watcher() i=5 2024-05-15T14:32:06.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.508+0000 7f8ef003f800 20 add_watcher() i=6 2024-05-15T14:32:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.509+0000 7f8ef003f800 20 add_watcher() i=7 2024-05-15T14:32:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.509+0000 7f8ef003f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:32:06.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.511+0000 7f8d9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:06.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.511+0000 7f8ef003f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:32:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.511+0000 7f8ef003f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:32:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.512+0000 7f8ef003f800 5 note: GC not initialized 2024-05-15T14:32:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.512+0000 7f8d9e7fc640 20 reqs_thread_entry: start 2024-05-15T14:32:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.512+0000 7f8ef003f800 20 init_complete bucket index max shards: 11 2024-05-15T14:32:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.512+0000 7f8ef003f800 20 Filter name: none 2024-05-15T14:32:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.512+0000 7f8d0ffff640 20 reqs_thread_entry: start 2024-05-15T14:32:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.513+0000 7f8ef003f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:06.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.513+0000 7f8ef003f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:32:06.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.515+0000 7f8d9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.517+0000 7f8ef003f800 20 remove_watcher() i=0 2024-05-15T14:32:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.517+0000 7f8ef003f800 2 removed watcher, disabling cache 2024-05-15T14:32:06.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.519+0000 7f8ef003f800 20 remove_watcher() i=1 2024-05-15T14:32:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.520+0000 7f8ef003f800 20 remove_watcher() i=2 2024-05-15T14:32:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.521+0000 7f8ef003f800 20 remove_watcher() i=3 2024-05-15T14:32:06.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.522+0000 7f8ef003f800 20 remove_watcher() i=4 2024-05-15T14:32:06.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.523+0000 7f8ef003f800 20 remove_watcher() i=5 2024-05-15T14:32:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.524+0000 7f8ef003f800 20 remove_watcher() i=6 2024-05-15T14:32:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:06.525+0000 7f8ef003f800 20 remove_watcher() i=7 2024-05-15T14:32:07.360 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.361 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.362 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.362 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.363 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.363 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.364 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.364 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.366 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.366 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.366 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.367 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.368 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.368 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.369 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.369 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.370 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.370 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.371 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:07] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.404 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.405 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.405 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.407 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.407 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.612 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.612 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.619 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.620 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.620 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.621 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.621 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.622 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.623 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.623 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.626 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.626 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:08] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.691 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.692 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.692 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.693 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.693 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.694 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.694 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.695 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:09.695 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:32:09] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:11.589 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:32:11.589 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:32:11.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.632+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.635+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:11.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.635+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.636+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.636+0000 7ff6b8126800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:32:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.636+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.636+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.636+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.637+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:32:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.637+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.637+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:32:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.637+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.637+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.637+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.638+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.638+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.638+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:11.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.638+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:32:11.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 zone MyZone found 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 period zonegroup name MyZoneGroup 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 started sync module instance, tier type = 2024-05-15T14:32:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.640+0000 7ff6b8126800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:32:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.652+0000 7ff6b8126800 20 add_watcher() i=0 2024-05-15T14:32:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.652+0000 7ff6b8126800 20 add_watcher() i=1 2024-05-15T14:32:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.652+0000 7ff6b8126800 20 add_watcher() i=2 2024-05-15T14:32:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.652+0000 7ff6b8126800 20 add_watcher() i=3 2024-05-15T14:32:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.652+0000 7ff6b8126800 20 add_watcher() i=4 2024-05-15T14:32:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.652+0000 7ff6b8126800 20 add_watcher() i=5 2024-05-15T14:32:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.652+0000 7ff6b8126800 20 add_watcher() i=6 2024-05-15T14:32:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.653+0000 7ff6b8126800 20 add_watcher() i=7 2024-05-15T14:32:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.653+0000 7ff6b8126800 2 all 8 watchers are set, enabling cache 2024-05-15T14:32:11.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.655+0000 7ff569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.655+0000 7ff6b8126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:32:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.655+0000 7ff6b8126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:32:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.655+0000 7ff6b8126800 5 note: GC not initialized 2024-05-15T14:32:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.655+0000 7ff568fe1640 20 reqs_thread_entry: start 2024-05-15T14:32:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.655+0000 7ff6b8126800 20 init_complete bucket index max shards: 11 2024-05-15T14:32:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.655+0000 7ff6b8126800 20 Filter name: none 2024-05-15T14:32:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.655+0000 7ff4e27fc640 20 reqs_thread_entry: start 2024-05-15T14:32:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.656+0000 7ff6b8126800 20 rados->read ofs=0 len=0 2024-05-15T14:32:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.657+0000 7ff6b8126800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:32:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.658+0000 7ff569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.661+0000 7ff6b8126800 20 remove_watcher() i=0 2024-05-15T14:32:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.661+0000 7ff6b8126800 2 removed watcher, disabling cache 2024-05-15T14:32:11.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.662+0000 7ff6b8126800 20 remove_watcher() i=1 2024-05-15T14:32:11.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.663+0000 7ff6b8126800 20 remove_watcher() i=2 2024-05-15T14:32:11.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.664+0000 7ff6b8126800 20 remove_watcher() i=3 2024-05-15T14:32:11.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.666+0000 7ff6b8126800 20 remove_watcher() i=4 2024-05-15T14:32:11.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.667+0000 7ff6b8126800 20 remove_watcher() i=5 2024-05-15T14:32:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.668+0000 7ff6b8126800 20 remove_watcher() i=6 2024-05-15T14:32:11.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:11.669+0000 7ff6b8126800 20 remove_watcher() i=7 2024-05-15T14:32:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:32:17.212 INFO:teuthology.orchestra.run.smithi018.stderr:test persistent topic configurations with time_to_live ... 127.0.0.1 - - [15/May/2024 14:32:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:32:37.785 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:32:37.785 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:32:37.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.829+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.831+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:37.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.831+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.832+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:37.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.832+0000 7fef9a33f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:32:37.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.832+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.832+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:37.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.832+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.833+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:32:37.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.833+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.833+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:32:37.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.833+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.833+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:37.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.833+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.834+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:37.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.834+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.835+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:37.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.835+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 zone MyZone found 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:37.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 started sync module instance, tier type = 2024-05-15T14:32:37.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.836+0000 7fef9a33f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:32:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.847+0000 7fef9a33f800 20 add_watcher() i=0 2024-05-15T14:32:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.847+0000 7fef9a33f800 20 add_watcher() i=1 2024-05-15T14:32:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.847+0000 7fef9a33f800 20 add_watcher() i=2 2024-05-15T14:32:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.847+0000 7fef9a33f800 20 add_watcher() i=3 2024-05-15T14:32:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.847+0000 7fef9a33f800 20 add_watcher() i=4 2024-05-15T14:32:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.847+0000 7fef9a33f800 20 add_watcher() i=5 2024-05-15T14:32:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.847+0000 7fef9a33f800 20 add_watcher() i=6 2024-05-15T14:32:37.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.848+0000 7fef9a33f800 20 add_watcher() i=7 2024-05-15T14:32:37.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.848+0000 7fef9a33f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:32:37.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.850+0000 7fee4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:37.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.850+0000 7fef9a33f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:32:37.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.850+0000 7fef9a33f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:32:37.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.850+0000 7fef9a33f800 5 note: GC not initialized 2024-05-15T14:32:37.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.851+0000 7fedc77fe640 20 reqs_thread_entry: start 2024-05-15T14:32:37.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.851+0000 7fef9a33f800 20 init_complete bucket index max shards: 11 2024-05-15T14:32:37.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.851+0000 7fef9a33f800 20 Filter name: none 2024-05-15T14:32:37.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.851+0000 7fedc57fa640 20 reqs_thread_entry: start 2024-05-15T14:32:37.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.851+0000 7fef9a33f800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.852+0000 7fef9a33f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:32:37.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.853+0000 7fee4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:37.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.856+0000 7fef9a33f800 20 remove_watcher() i=0 2024-05-15T14:32:37.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.856+0000 7fef9a33f800 2 removed watcher, disabling cache 2024-05-15T14:32:37.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.857+0000 7fef9a33f800 20 remove_watcher() i=1 2024-05-15T14:32:37.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.858+0000 7fef9a33f800 20 remove_watcher() i=2 2024-05-15T14:32:37.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.859+0000 7fef9a33f800 20 remove_watcher() i=3 2024-05-15T14:32:37.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.860+0000 7fef9a33f800 20 remove_watcher() i=4 2024-05-15T14:32:37.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.861+0000 7fef9a33f800 20 remove_watcher() i=5 2024-05-15T14:32:37.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.862+0000 7fef9a33f800 20 remove_watcher() i=6 2024-05-15T14:32:37.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.863+0000 7fef9a33f800 20 remove_watcher() i=7 2024-05-15T14:32:37.916 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:32:37.916 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:32:37.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.955+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.957+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:37.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.957+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.957+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:37.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.957+0000 7fb03f12a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:32:37.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.957+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.958+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:37.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.958+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.958+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:32:37.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.958+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.959+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:32:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.959+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.959+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.959+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.959+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.959+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.960+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:37.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.960+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:32:37.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 20 zone MyZone found 2024-05-15T14:32:37.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:32:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:32:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:32:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:32:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:32:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:32:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.961+0000 7fb03f12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:37.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.962+0000 7fb03f12a800 20 started sync module instance, tier type = 2024-05-15T14:32:37.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.962+0000 7fb03f12a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:32:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.972+0000 7fb03f12a800 20 add_watcher() i=0 2024-05-15T14:32:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.972+0000 7fb03f12a800 20 add_watcher() i=1 2024-05-15T14:32:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.972+0000 7fb03f12a800 20 add_watcher() i=2 2024-05-15T14:32:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.972+0000 7fb03f12a800 20 add_watcher() i=3 2024-05-15T14:32:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.972+0000 7fb03f12a800 20 add_watcher() i=4 2024-05-15T14:32:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.972+0000 7fb03f12a800 20 add_watcher() i=5 2024-05-15T14:32:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.972+0000 7fb03f12a800 20 add_watcher() i=6 2024-05-15T14:32:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.973+0000 7fb03f12a800 20 add_watcher() i=7 2024-05-15T14:32:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.973+0000 7fb03f12a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:32:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.975+0000 7faef17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.975+0000 7fb03f12a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:32:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.975+0000 7fb03f12a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:32:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.975+0000 7fb03f12a800 5 note: GC not initialized 2024-05-15T14:32:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.975+0000 7fae6bfff640 20 reqs_thread_entry: start 2024-05-15T14:32:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.975+0000 7fb03f12a800 20 init_complete bucket index max shards: 11 2024-05-15T14:32:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.975+0000 7fb03f12a800 20 Filter name: none 2024-05-15T14:32:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.976+0000 7fae69ffb640 20 reqs_thread_entry: start 2024-05-15T14:32:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.976+0000 7fb03f12a800 20 rados->read ofs=0 len=0 2024-05-15T14:32:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.976+0000 7fb03f12a800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:32:37.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.978+0000 7faef17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.980+0000 7fb03f12a800 20 remove_watcher() i=0 2024-05-15T14:32:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.980+0000 7fb03f12a800 2 removed watcher, disabling cache 2024-05-15T14:32:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.982+0000 7fb03f12a800 20 remove_watcher() i=1 2024-05-15T14:32:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.983+0000 7fb03f12a800 20 remove_watcher() i=2 2024-05-15T14:32:37.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.984+0000 7fb03f12a800 20 remove_watcher() i=3 2024-05-15T14:32:37.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.985+0000 7fb03f12a800 20 remove_watcher() i=4 2024-05-15T14:32:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.986+0000 7fb03f12a800 20 remove_watcher() i=5 2024-05-15T14:32:37.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.987+0000 7fb03f12a800 20 remove_watcher() i=6 2024-05-15T14:32:37.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:37.988+0000 7fb03f12a800 20 remove_watcher() i=7 2024-05-15T14:32:38.283 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:32:38.284 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:32:38.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.325+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.327+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.327+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.327+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.327+0000 7fdb0b523800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:32:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.327+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.328+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.328+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.329+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:32:38.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.329+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.329+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:32:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.329+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.329+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.329+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.330+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:32:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.330+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:32:38.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 20 zone MyZone found 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 20 period zonegroup name MyZoneGroup 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.331+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.332+0000 7fdb0b523800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.332+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.332+0000 7fdb0b523800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.332+0000 7fdb0b523800 20 started sync module instance, tier type = 2024-05-15T14:32:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.332+0000 7fdb0b523800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:32:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.344+0000 7fdb0b523800 20 add_watcher() i=0 2024-05-15T14:32:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.344+0000 7fdb0b523800 20 add_watcher() i=1 2024-05-15T14:32:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.344+0000 7fdb0b523800 20 add_watcher() i=2 2024-05-15T14:32:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.344+0000 7fdb0b523800 20 add_watcher() i=3 2024-05-15T14:32:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.344+0000 7fdb0b523800 20 add_watcher() i=4 2024-05-15T14:32:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.344+0000 7fdb0b523800 20 add_watcher() i=5 2024-05-15T14:32:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.344+0000 7fdb0b523800 20 add_watcher() i=6 2024-05-15T14:32:38.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.346+0000 7fdb0b523800 20 add_watcher() i=7 2024-05-15T14:32:38.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.346+0000 7fdb0b523800 2 all 8 watchers are set, enabling cache 2024-05-15T14:32:38.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.348+0000 7fd9bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:38.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.349+0000 7fdb0b523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:32:38.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.349+0000 7fdb0b523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:32:38.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.349+0000 7fdb0b523800 5 note: GC not initialized 2024-05-15T14:32:38.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.349+0000 7fd9bcfe1640 20 reqs_thread_entry: start 2024-05-15T14:32:38.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.349+0000 7fdb0b523800 20 init_complete bucket index max shards: 11 2024-05-15T14:32:38.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.349+0000 7fdb0b523800 20 Filter name: none 2024-05-15T14:32:38.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.349+0000 7fd9367fc640 20 reqs_thread_entry: start 2024-05-15T14:32:38.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.350+0000 7fdb0b523800 20 rados->read ofs=0 len=0 2024-05-15T14:32:38.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.350+0000 7fdb0b523800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:32:38.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.352+0000 7fd9bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:32:38.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.354+0000 7fdb0b523800 20 remove_watcher() i=0 2024-05-15T14:32:38.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.354+0000 7fdb0b523800 2 removed watcher, disabling cache 2024-05-15T14:32:38.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.356+0000 7fdb0b523800 20 remove_watcher() i=1 2024-05-15T14:32:38.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.357+0000 7fdb0b523800 20 remove_watcher() i=2 2024-05-15T14:32:38.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.358+0000 7fdb0b523800 20 remove_watcher() i=3 2024-05-15T14:32:38.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.359+0000 7fdb0b523800 20 remove_watcher() i=4 2024-05-15T14:32:38.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.360+0000 7fdb0b523800 20 remove_watcher() i=5 2024-05-15T14:32:38.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.361+0000 7fdb0b523800 20 remove_watcher() i=6 2024-05-15T14:32:38.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:32:38.362+0000 7fdb0b523800 20 remove_watcher() i=7 2024-05-15T14:33:18.425 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:33:18.425 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:33:18.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.468+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.470+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:18.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.470+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.471+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:18.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.471+0000 7f3ac230c800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:33:18.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.471+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.472+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:18.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.472+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.472+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:33:18.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.472+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.473+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:33:18.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.473+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.473+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:18.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.473+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.473+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:18.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.473+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.474+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:18.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.474+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:33:18.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 20 zone MyZone found 2024-05-15T14:33:18.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:33:18.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:33:18.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:33:18.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:33:18.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 20 period zonegroup name MyZoneGroup 2024-05-15T14:33:18.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:33:18.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.475+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.476+0000 7f3ac230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:33:18.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.476+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.476+0000 7f3ac230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:33:18.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.476+0000 7f3ac230c800 20 started sync module instance, tier type = 2024-05-15T14:33:18.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.476+0000 7f3ac230c800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:33:18.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.488+0000 7f3ac230c800 20 add_watcher() i=0 2024-05-15T14:33:18.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.488+0000 7f3ac230c800 20 add_watcher() i=1 2024-05-15T14:33:18.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.488+0000 7f3ac230c800 20 add_watcher() i=2 2024-05-15T14:33:18.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.488+0000 7f3ac230c800 20 add_watcher() i=3 2024-05-15T14:33:18.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.488+0000 7f3ac230c800 20 add_watcher() i=4 2024-05-15T14:33:18.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.488+0000 7f3ac230c800 20 add_watcher() i=5 2024-05-15T14:33:18.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.488+0000 7f3ac230c800 20 add_watcher() i=6 2024-05-15T14:33:18.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.489+0000 7f3ac230c800 20 add_watcher() i=7 2024-05-15T14:33:18.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.489+0000 7f3ac230c800 2 all 8 watchers are set, enabling cache 2024-05-15T14:33:18.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.490+0000 7f3975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:33:18.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.491+0000 7f3ac230c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:33:18.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.491+0000 7f3ac230c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:33:18.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.491+0000 7f3ac230c800 5 note: GC not initialized 2024-05-15T14:33:18.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.491+0000 7f3974fe1640 20 reqs_thread_entry: start 2024-05-15T14:33:18.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.491+0000 7f3ac230c800 20 init_complete bucket index max shards: 11 2024-05-15T14:33:18.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.491+0000 7f3ac230c800 20 Filter name: none 2024-05-15T14:33:18.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.491+0000 7f38ee7fc640 20 reqs_thread_entry: start 2024-05-15T14:33:18.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.492+0000 7f3ac230c800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.492+0000 7f3ac230c800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:33:18.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.494+0000 7f3975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:33:18.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.496+0000 7f3ac230c800 20 remove_watcher() i=0 2024-05-15T14:33:18.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.496+0000 7f3ac230c800 2 removed watcher, disabling cache 2024-05-15T14:33:18.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.497+0000 7f3ac230c800 20 remove_watcher() i=1 2024-05-15T14:33:18.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.498+0000 7f3ac230c800 20 remove_watcher() i=2 2024-05-15T14:33:18.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.500+0000 7f3ac230c800 20 remove_watcher() i=3 2024-05-15T14:33:18.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.501+0000 7f3ac230c800 20 remove_watcher() i=4 2024-05-15T14:33:18.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.502+0000 7f3ac230c800 20 remove_watcher() i=5 2024-05-15T14:33:18.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.503+0000 7f3ac230c800 20 remove_watcher() i=6 2024-05-15T14:33:18.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.504+0000 7f3ac230c800 20 remove_watcher() i=7 2024-05-15T14:33:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:33:18.573 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:33:18.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.616+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.618+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:18.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.618+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.619+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.619+0000 7f7378136800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:33:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.619+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.620+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.620+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.621+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:33:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.621+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.621+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:33:18.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.621+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.621+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.621+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.622+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:18.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.622+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.623+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:18.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.623+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:33:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 zone MyZone found 2024-05-15T14:33:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:33:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:33:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:33:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:33:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 period zonegroup name MyZoneGroup 2024-05-15T14:33:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:33:18.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:33:18.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:33:18.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.624+0000 7f7378136800 20 started sync module instance, tier type = 2024-05-15T14:33:18.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.625+0000 7f7378136800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:33:18.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.635+0000 7f7378136800 20 add_watcher() i=0 2024-05-15T14:33:18.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.635+0000 7f7378136800 20 add_watcher() i=1 2024-05-15T14:33:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.635+0000 7f7378136800 20 add_watcher() i=2 2024-05-15T14:33:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.635+0000 7f7378136800 20 add_watcher() i=3 2024-05-15T14:33:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.635+0000 7f7378136800 20 add_watcher() i=4 2024-05-15T14:33:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.635+0000 7f7378136800 20 add_watcher() i=5 2024-05-15T14:33:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.635+0000 7f7378136800 20 add_watcher() i=6 2024-05-15T14:33:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.636+0000 7f7378136800 20 add_watcher() i=7 2024-05-15T14:33:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.636+0000 7f7378136800 2 all 8 watchers are set, enabling cache 2024-05-15T14:33:18.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.637+0000 7f7229fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:33:18.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.638+0000 7f7378136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:33:18.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.638+0000 7f7378136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:33:18.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.638+0000 7f7378136800 5 note: GC not initialized 2024-05-15T14:33:18.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.638+0000 7f7228fe1640 20 reqs_thread_entry: start 2024-05-15T14:33:18.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.638+0000 7f7378136800 20 init_complete bucket index max shards: 11 2024-05-15T14:33:18.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.638+0000 7f7378136800 20 Filter name: none 2024-05-15T14:33:18.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.638+0000 7f71a27fc640 20 reqs_thread_entry: start 2024-05-15T14:33:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.639+0000 7f7378136800 20 rados->read ofs=0 len=0 2024-05-15T14:33:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.639+0000 7f7378136800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:33:18.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.641+0000 7f7229fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:33:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.643+0000 7f7378136800 20 remove_watcher() i=0 2024-05-15T14:33:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.643+0000 7f7378136800 2 removed watcher, disabling cache 2024-05-15T14:33:18.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.644+0000 7f7378136800 20 remove_watcher() i=1 2024-05-15T14:33:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.645+0000 7f7378136800 20 remove_watcher() i=2 2024-05-15T14:33:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.646+0000 7f7378136800 20 remove_watcher() i=3 2024-05-15T14:33:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.647+0000 7f7378136800 20 remove_watcher() i=4 2024-05-15T14:33:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.648+0000 7f7378136800 20 remove_watcher() i=5 2024-05-15T14:33:18.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.649+0000 7f7378136800 20 remove_watcher() i=6 2024-05-15T14:33:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:18.650+0000 7f7378136800 20 remove_watcher() i=7 2024-05-15T14:33:58.752 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:33:58.753 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:33:58.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.797+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.799+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:58.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.799+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.800+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:58.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.800+0000 7f1bc8698800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:33:58.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.800+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.800+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:58.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.800+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.801+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:33:58.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.801+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.801+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:33:58.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.801+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.802+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:58.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.802+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.802+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:33:58.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.802+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.803+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:33:58.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.803+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 20 zone MyZone found 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 20 period zonegroup name MyZoneGroup 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:33:58.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.804+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.805+0000 7f1bc8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:33:58.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.805+0000 7f1bc8698800 20 started sync module instance, tier type = 2024-05-15T14:33:58.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.805+0000 7f1bc8698800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:33:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.816+0000 7f1bc8698800 20 add_watcher() i=0 2024-05-15T14:33:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.816+0000 7f1bc8698800 20 add_watcher() i=1 2024-05-15T14:33:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.816+0000 7f1bc8698800 20 add_watcher() i=2 2024-05-15T14:33:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.816+0000 7f1bc8698800 20 add_watcher() i=3 2024-05-15T14:33:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.816+0000 7f1bc8698800 20 add_watcher() i=4 2024-05-15T14:33:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.816+0000 7f1bc8698800 20 add_watcher() i=5 2024-05-15T14:33:58.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.816+0000 7f1bc8698800 20 add_watcher() i=6 2024-05-15T14:33:58.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.817+0000 7f1bc8698800 20 add_watcher() i=7 2024-05-15T14:33:58.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.817+0000 7f1bc8698800 2 all 8 watchers are set, enabling cache 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.819+0000 7f1a7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.819+0000 7f1bc8698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.819+0000 7f1bc8698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.819+0000 7f1bc8698800 5 note: GC not initialized 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.820+0000 7f19f77fe640 20 reqs_thread_entry: start 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.820+0000 7f1bc8698800 20 init_complete bucket index max shards: 11 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.820+0000 7f1bc8698800 20 Filter name: none 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.820+0000 7f19f57fa640 20 reqs_thread_entry: start 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.820+0000 7f1bc8698800 20 rados->read ofs=0 len=0 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.821+0000 7f1bc8698800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:33:58.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.822+0000 7f1a7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:33:58.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.825+0000 7f1bc8698800 20 remove_watcher() i=0 2024-05-15T14:33:58.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.825+0000 7f1bc8698800 2 removed watcher, disabling cache 2024-05-15T14:33:58.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.826+0000 7f1bc8698800 20 remove_watcher() i=1 2024-05-15T14:33:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.827+0000 7f1bc8698800 20 remove_watcher() i=2 2024-05-15T14:33:58.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.828+0000 7f1bc8698800 20 remove_watcher() i=3 2024-05-15T14:33:58.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.829+0000 7f1bc8698800 20 remove_watcher() i=4 2024-05-15T14:33:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.830+0000 7f1bc8698800 20 remove_watcher() i=5 2024-05-15T14:33:58.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.831+0000 7f1bc8698800 20 remove_watcher() i=6 2024-05-15T14:33:58.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:33:58.832+0000 7f1bc8698800 20 remove_watcher() i=7 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:"topic not found" error is expected 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'GET /vwwrqh-4?notification=vwwrqh-4_notif_1 HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:cnF75z5LssW/Jo+zbZWuji/8A3g=\r\nDate: Wed, 15 May 2024 14:30:06 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000cc275533a3fb5d48-006644c6ee-4586-MyZone 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Type: application/xml 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 208 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:30:06 GMT 2024-05-15T14:33:58.846 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-4?notification=vwwrqh-4_notif_1 HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:LDsU6pDUIAEOoXr/xXknaBGvfxE=\r\nDate: Wed, 15 May 2024 14:30:06 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000007aa2342f73992a43-006644c6ee-4586-MyZone 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:30:06 GMT 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-4?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:RLeh6/VbS/SUel5ByJnrQHRwhaM=\r\nDate: Wed, 15 May 2024 14:30:06 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx0000059a31abbdfd550e2-006644c6ee-4586-MyZone 2024-05-15T14:33:58.847 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:30:06 GMT 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'GET /vwwrqh-5?notification=vwwrqh-5_notif_1 HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:ebfwRtwakWwELfPUcweGpScaHsU=\r\nDate: Wed, 15 May 2024 14:30:06 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000004a85f07994c702a8-006644c6ee-4586-MyZone 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Type: application/xml 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 241 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:30:06 GMT 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.848 INFO:teuthology.orchestra.run.smithi018.stdout:An error occurred (InvalidArgument) when calling the PutBucketNotificationConfiguration operation: Unknown Event type: vwwrqh-6_notif - is expected 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:An error occurred (InvalidArgument) when calling the PutBucketNotificationConfiguration operation: Missing required element Id - is expected 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:An error occurred (InvalidArgument) when calling the PutBucketNotificationConfiguration operation: Invalid Topic ARN - is expected 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:An error occurred (NoSuchKey) when calling the PutBucketNotificationConfiguration operation: None - is expected 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:An error occurred (NoSuchBucket) when calling the PutBucketNotificationConfiguration operation: None - is expected 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:average time for deletion + http notification is: 6.896448135375977 milliseconds 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 5sec for the messages... 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-7?notification=vwwrqh-7_notif HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:6IcL5ITNy4fTvSfGipCa2wDppKI=\r\nDate: Wed, 15 May 2024 14:30:12 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000933417a6b52badcf-006644c6f4-4586-MyZone 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.849 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + http notification is: 22.649707794189453 milliseconds 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 5sec for the messages... 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout:average time for deletion + http notification is: 12.279844284057617 milliseconds 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 5sec for the messages... 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + http notification is: 2.6908159255981445 milliseconds 2024-05-15T14:33:58.850 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 5sec for the messages... 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:average time for deletion + http notification is: 2.9915332794189453 milliseconds 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 5sec for the messages... 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-9?notification=vwwrqh-9_notif HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:tXgrGBJ09rPTa6ymkuVQ3O9c1o0=\r\nDate: Wed, 15 May 2024 14:30:36 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000af26948edf2edf2f-006644c70c-4586-MyZone 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:30:36 GMT 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + http notification is: 4.27706241607666 milliseconds 2024-05-15T14:33:58.851 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 5sec for the messages... 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:total number of objects: 10 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-10?notification=vwwrqh-10_notif HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:quUkEC2eLqgKUwm7RiGTQZt3Gm0=\r\nDate: Wed, 15 May 2024 14:30:41 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000ca630f76318f3a31-006644c711-4586-MyZone 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:30:41 GMT 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + http notification is: 4.251575469970703 milliseconds 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 20s for the lifecycle... 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-11?notification=vwwrqh-11_notif HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:UaWBczNaJCb680U+UDlrRqJjM/Q=\r\nDate: Wed, 15 May 2024 14:31:15 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.852 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000008aceb535e67d5d88-006644c733-4586-MyZone 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:31:15 GMT 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 20s for the lifecycle... 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-12?notification=vwwrqh-12_notif HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:r9wTnnbWB6hGFv/V6Vj2ONYafvE=\r\nDate: Wed, 15 May 2024 14:31:43 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.853 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000a39a70315210362a-006644c74f-4586-MyZone 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:31:43 GMT 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:wait for 5sec for the messages... 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:total number of objects: 1 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-13?notification=vwwrqh-13_notif HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:9lEmlO6qwyxZsNv/ajBiINX28jM=\r\nDate: Wed, 15 May 2024 14:31:49 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000001e4b6275552cf730-006644c755-4586-MyZone 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.854 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:31:49 GMT 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + async http notification is: 23.845207691192627 milliseconds 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:average time for deletion + async http notification is: 1.985025405883789 milliseconds 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-14?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:YOlY+7IghWC9Vic2d1KnqPZkG5E=\r\nDate: Wed, 15 May 2024 14:32:16 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000559a279b20d52234-006644c770-4586-MyZone 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:33:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:32:16 GMT 2024-05-15T14:33:58.856 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:33:58.856 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:33:58.856 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + async http notification is: 24.274778366088867 milliseconds 2024-05-15T14:34:18.898 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:34:18.902 INFO:teuthology.orchestra.run.smithi018.stderr:test persistent topic configurations with max_retries and retry_sleep_duration ... 127.0.0.1 - - [15/May/2024 14:34:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:34:39.473 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:34:39.474 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:34:39.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.518+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.519+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.519+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.520+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:39.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.520+0000 7f382243a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:34:39.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.520+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.521+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:39.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.521+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.521+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:34:39.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.521+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.522+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:34:39.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.522+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.522+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:39.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.522+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.522+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:39.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.522+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.523+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:39.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.523+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 20 zone MyZone found 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:34:39.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.524+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.525+0000 7f382243a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:34:39.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.525+0000 7f382243a800 20 started sync module instance, tier type = 2024-05-15T14:34:39.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.525+0000 7f382243a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:34:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.535+0000 7f382243a800 20 add_watcher() i=0 2024-05-15T14:34:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.535+0000 7f382243a800 20 add_watcher() i=1 2024-05-15T14:34:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.535+0000 7f382243a800 20 add_watcher() i=2 2024-05-15T14:34:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.535+0000 7f382243a800 20 add_watcher() i=3 2024-05-15T14:34:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.535+0000 7f382243a800 20 add_watcher() i=4 2024-05-15T14:34:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.535+0000 7f382243a800 20 add_watcher() i=5 2024-05-15T14:34:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.535+0000 7f382243a800 20 add_watcher() i=6 2024-05-15T14:34:39.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.536+0000 7f382243a800 20 add_watcher() i=7 2024-05-15T14:34:39.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.536+0000 7f382243a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:34:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.538+0000 7f36d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:34:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.538+0000 7f382243a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:34:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.538+0000 7f382243a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:34:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.538+0000 7f382243a800 5 note: GC not initialized 2024-05-15T14:34:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.539+0000 7f36d27e4640 20 reqs_thread_entry: start 2024-05-15T14:34:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.539+0000 7f382243a800 20 init_complete bucket index max shards: 11 2024-05-15T14:34:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.539+0000 7f382243a800 20 Filter name: none 2024-05-15T14:34:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.539+0000 7f3643fff640 20 reqs_thread_entry: start 2024-05-15T14:34:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.540+0000 7f382243a800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.540+0000 7f382243a800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:34:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.542+0000 7f36d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:34:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.544+0000 7f382243a800 20 remove_watcher() i=0 2024-05-15T14:34:39.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.544+0000 7f382243a800 2 removed watcher, disabling cache 2024-05-15T14:34:39.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.545+0000 7f382243a800 20 remove_watcher() i=1 2024-05-15T14:34:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.546+0000 7f382243a800 20 remove_watcher() i=2 2024-05-15T14:34:39.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.547+0000 7f382243a800 20 remove_watcher() i=3 2024-05-15T14:34:39.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.549+0000 7f382243a800 20 remove_watcher() i=4 2024-05-15T14:34:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.550+0000 7f382243a800 20 remove_watcher() i=5 2024-05-15T14:34:39.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.551+0000 7f382243a800 20 remove_watcher() i=6 2024-05-15T14:34:39.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.552+0000 7f382243a800 20 remove_watcher() i=7 2024-05-15T14:34:39.604 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:34:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:34:39.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.643+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.645+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:39.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.645+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.646+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.646+0000 7fa632daf800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:34:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.646+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.646+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:39.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.646+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.647+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:34:39.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.647+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.647+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:34:39.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.647+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.647+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:39.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.647+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.648+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:39.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.648+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.648+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.648+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:34:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 20 zone MyZone found 2024-05-15T14:34:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:34:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:34:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:34:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:34:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 20 period zonegroup name MyZoneGroup 2024-05-15T14:34:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:34:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:34:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.649+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.650+0000 7fa632daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:34:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.650+0000 7fa632daf800 20 started sync module instance, tier type = 2024-05-15T14:34:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.650+0000 7fa632daf800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:34:39.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.660+0000 7fa632daf800 20 add_watcher() i=0 2024-05-15T14:34:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.660+0000 7fa632daf800 20 add_watcher() i=1 2024-05-15T14:34:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.660+0000 7fa632daf800 20 add_watcher() i=2 2024-05-15T14:34:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.660+0000 7fa632daf800 20 add_watcher() i=3 2024-05-15T14:34:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.660+0000 7fa632daf800 20 add_watcher() i=4 2024-05-15T14:34:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.660+0000 7fa632daf800 20 add_watcher() i=5 2024-05-15T14:34:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.660+0000 7fa632daf800 20 add_watcher() i=6 2024-05-15T14:34:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.661+0000 7fa632daf800 20 add_watcher() i=7 2024-05-15T14:34:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.661+0000 7fa632daf800 2 all 8 watchers are set, enabling cache 2024-05-15T14:34:39.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.662+0000 7fa4e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:34:39.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.663+0000 7fa632daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:34:39.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.663+0000 7fa632daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:34:39.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.663+0000 7fa632daf800 5 note: GC not initialized 2024-05-15T14:34:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.663+0000 7fa4e5fe3640 20 reqs_thread_entry: start 2024-05-15T14:34:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.663+0000 7fa632daf800 20 init_complete bucket index max shards: 11 2024-05-15T14:34:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.663+0000 7fa632daf800 20 Filter name: none 2024-05-15T14:34:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.663+0000 7fa4577fe640 20 reqs_thread_entry: start 2024-05-15T14:34:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.663+0000 7fa632daf800 20 rados->read ofs=0 len=0 2024-05-15T14:34:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.664+0000 7fa632daf800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:34:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.665+0000 7fa4e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:34:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.667+0000 7fa632daf800 20 remove_watcher() i=0 2024-05-15T14:34:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.667+0000 7fa632daf800 2 removed watcher, disabling cache 2024-05-15T14:34:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.669+0000 7fa632daf800 20 remove_watcher() i=1 2024-05-15T14:34:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.670+0000 7fa632daf800 20 remove_watcher() i=2 2024-05-15T14:34:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.671+0000 7fa632daf800 20 remove_watcher() i=3 2024-05-15T14:34:39.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.672+0000 7fa632daf800 20 remove_watcher() i=4 2024-05-15T14:34:39.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.673+0000 7fa632daf800 20 remove_watcher() i=5 2024-05-15T14:34:39.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.674+0000 7fa632daf800 20 remove_watcher() i=6 2024-05-15T14:34:39.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:39.675+0000 7fa632daf800 20 remove_watcher() i=7 2024-05-15T14:34:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:34:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:34:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.035+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.038+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:40.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.038+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.039+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:40.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.039+0000 7f5594151800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:34:40.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.039+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.039+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:40.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.039+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.040+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:34:40.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.040+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.040+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:34:40.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.040+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.040+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:40.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.040+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.041+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:34:40.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.041+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.041+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:34:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.041+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.042+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:34:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 zone MyZone found 2024-05-15T14:34:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 period zonegroup name MyZoneGroup 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:34:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 started sync module instance, tier type = 2024-05-15T14:34:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.043+0000 7f5594151800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:34:40.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.054+0000 7f5594151800 20 add_watcher() i=0 2024-05-15T14:34:40.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.054+0000 7f5594151800 20 add_watcher() i=1 2024-05-15T14:34:40.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.054+0000 7f5594151800 20 add_watcher() i=2 2024-05-15T14:34:40.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.054+0000 7f5594151800 20 add_watcher() i=3 2024-05-15T14:34:40.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.054+0000 7f5594151800 20 add_watcher() i=4 2024-05-15T14:34:40.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.054+0000 7f5594151800 20 add_watcher() i=5 2024-05-15T14:34:40.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.054+0000 7f5594151800 20 add_watcher() i=6 2024-05-15T14:34:40.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.055+0000 7f5594151800 20 add_watcher() i=7 2024-05-15T14:34:40.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.055+0000 7f5594151800 2 all 8 watchers are set, enabling cache 2024-05-15T14:34:40.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.057+0000 7f54437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:34:40.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.057+0000 7f5594151800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:34:40.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.057+0000 7f5594151800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:34:40.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.057+0000 7f5594151800 5 note: GC not initialized 2024-05-15T14:34:40.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.058+0000 7f54427fc640 20 reqs_thread_entry: start 2024-05-15T14:34:40.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.058+0000 7f5594151800 20 init_complete bucket index max shards: 11 2024-05-15T14:34:40.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.058+0000 7f5594151800 20 Filter name: none 2024-05-15T14:34:40.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.058+0000 7f53b3fff640 20 reqs_thread_entry: start 2024-05-15T14:34:40.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.058+0000 7f5594151800 20 rados->read ofs=0 len=0 2024-05-15T14:34:40.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.059+0000 7f5594151800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:34:40.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.060+0000 7f54437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:34:40.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.062+0000 7f5594151800 20 remove_watcher() i=0 2024-05-15T14:34:40.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.062+0000 7f5594151800 2 removed watcher, disabling cache 2024-05-15T14:34:40.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.063+0000 7f5594151800 20 remove_watcher() i=1 2024-05-15T14:34:40.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.064+0000 7f5594151800 20 remove_watcher() i=2 2024-05-15T14:34:40.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.065+0000 7f5594151800 20 remove_watcher() i=3 2024-05-15T14:34:40.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.066+0000 7f5594151800 20 remove_watcher() i=4 2024-05-15T14:34:40.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.067+0000 7f5594151800 20 remove_watcher() i=5 2024-05-15T14:34:40.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.068+0000 7f5594151800 20 remove_watcher() i=6 2024-05-15T14:34:40.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:34:40.070+0000 7f5594151800 20 remove_watcher() i=7 2024-05-15T14:35:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:35:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:35:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.211+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.213+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:35:20.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.213+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.214+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:35:20.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.214+0000 7f982a32e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:35:20.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.214+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.214+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:35:20.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.214+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.215+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:35:20.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.215+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.215+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:35:20.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.215+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.215+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:35:20.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.215+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.216+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:35:20.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.216+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.216+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:35:20.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.216+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:35:20.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 20 zone MyZone found 2024-05-15T14:35:20.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:35:20.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:35:20.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:35:20.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:35:20.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:35:20.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:35:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.217+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.218+0000 7f982a32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:35:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.218+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.218+0000 7f982a32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:35:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.218+0000 7f982a32e800 20 started sync module instance, tier type = 2024-05-15T14:35:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.218+0000 7f982a32e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:35:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.229+0000 7f982a32e800 20 add_watcher() i=0 2024-05-15T14:35:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.229+0000 7f982a32e800 20 add_watcher() i=1 2024-05-15T14:35:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.229+0000 7f982a32e800 20 add_watcher() i=2 2024-05-15T14:35:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.229+0000 7f982a32e800 20 add_watcher() i=3 2024-05-15T14:35:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.229+0000 7f982a32e800 20 add_watcher() i=4 2024-05-15T14:35:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.229+0000 7f982a32e800 20 add_watcher() i=5 2024-05-15T14:35:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.229+0000 7f982a32e800 20 add_watcher() i=6 2024-05-15T14:35:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.230+0000 7f982a32e800 20 add_watcher() i=7 2024-05-15T14:35:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.230+0000 7f982a32e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:35:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.232+0000 7f96dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:35:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.232+0000 7f982a32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:35:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.232+0000 7f982a32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:35:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.232+0000 7f982a32e800 5 note: GC not initialized 2024-05-15T14:35:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.232+0000 7f96577fe640 20 reqs_thread_entry: start 2024-05-15T14:35:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.232+0000 7f982a32e800 20 init_complete bucket index max shards: 11 2024-05-15T14:35:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.232+0000 7f982a32e800 20 Filter name: none 2024-05-15T14:35:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.232+0000 7f96557fa640 20 reqs_thread_entry: start 2024-05-15T14:35:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.233+0000 7f982a32e800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.233+0000 7f982a32e800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:35:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.235+0000 7f96dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:35:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.237+0000 7f982a32e800 20 remove_watcher() i=0 2024-05-15T14:35:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.237+0000 7f982a32e800 2 removed watcher, disabling cache 2024-05-15T14:35:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.238+0000 7f982a32e800 20 remove_watcher() i=1 2024-05-15T14:35:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.240+0000 7f982a32e800 20 remove_watcher() i=2 2024-05-15T14:35:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.241+0000 7f982a32e800 20 remove_watcher() i=3 2024-05-15T14:35:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.242+0000 7f982a32e800 20 remove_watcher() i=4 2024-05-15T14:35:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.243+0000 7f982a32e800 20 remove_watcher() i=5 2024-05-15T14:35:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.244+0000 7f982a32e800 20 remove_watcher() i=6 2024-05-15T14:35:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.245+0000 7f982a32e800 20 remove_watcher() i=7 2024-05-15T14:35:20.319 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:35:20.319 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:35:20.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.358+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.360+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:35:20.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.360+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.361+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:35:20.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.361+0000 7ffbb3c85800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:35:20.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.361+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.361+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:35:20.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.361+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.362+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:35:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.362+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.362+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:35:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.362+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.363+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:35:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.363+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.363+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:35:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.363+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.364+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:35:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.364+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 zone MyZone found 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 period zonegroup name MyZoneGroup 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:35:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:35:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:35:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 started sync module instance, tier type = 2024-05-15T14:35:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.365+0000 7ffbb3c85800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:35:20.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.377+0000 7ffbb3c85800 20 add_watcher() i=0 2024-05-15T14:35:20.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.377+0000 7ffbb3c85800 20 add_watcher() i=1 2024-05-15T14:35:20.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.377+0000 7ffbb3c85800 20 add_watcher() i=2 2024-05-15T14:35:20.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.377+0000 7ffbb3c85800 20 add_watcher() i=3 2024-05-15T14:35:20.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.377+0000 7ffbb3c85800 20 add_watcher() i=4 2024-05-15T14:35:20.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.377+0000 7ffbb3c85800 20 add_watcher() i=5 2024-05-15T14:35:20.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.377+0000 7ffbb3c85800 20 add_watcher() i=6 2024-05-15T14:35:20.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.378+0000 7ffbb3c85800 20 add_watcher() i=7 2024-05-15T14:35:20.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.378+0000 7ffbb3c85800 2 all 8 watchers are set, enabling cache 2024-05-15T14:35:20.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.380+0000 7ffa677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:35:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.380+0000 7ffbb3c85800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:35:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.380+0000 7ffbb3c85800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:35:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.380+0000 7ffbb3c85800 5 note: GC not initialized 2024-05-15T14:35:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.380+0000 7ffa667e4640 20 reqs_thread_entry: start 2024-05-15T14:35:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.381+0000 7ffbb3c85800 20 init_complete bucket index max shards: 11 2024-05-15T14:35:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.381+0000 7ffbb3c85800 20 Filter name: none 2024-05-15T14:35:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.381+0000 7ff9d7fff640 20 reqs_thread_entry: start 2024-05-15T14:35:20.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.381+0000 7ffbb3c85800 20 rados->read ofs=0 len=0 2024-05-15T14:35:20.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.382+0000 7ffbb3c85800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:35:20.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.383+0000 7ffa677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:35:20.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.386+0000 7ffbb3c85800 20 remove_watcher() i=0 2024-05-15T14:35:20.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.386+0000 7ffbb3c85800 2 removed watcher, disabling cache 2024-05-15T14:35:20.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.387+0000 7ffbb3c85800 20 remove_watcher() i=1 2024-05-15T14:35:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.388+0000 7ffbb3c85800 20 remove_watcher() i=2 2024-05-15T14:35:20.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.389+0000 7ffbb3c85800 20 remove_watcher() i=3 2024-05-15T14:35:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.390+0000 7ffbb3c85800 20 remove_watcher() i=4 2024-05-15T14:35:20.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.391+0000 7ffbb3c85800 20 remove_watcher() i=5 2024-05-15T14:35:20.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.392+0000 7ffbb3c85800 20 remove_watcher() i=6 2024-05-15T14:35:20.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:35:20.393+0000 7ffbb3c85800 20 remove_watcher() i=7 2024-05-15T14:36:00.488 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:00.488 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:00.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.532+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.534+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:00.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.534+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.535+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.535+0000 7f4fe0525800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:00.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.535+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.535+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.535+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.536+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:00.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.536+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.536+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:00.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.536+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.537+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:00.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.537+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.537+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:00.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.537+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.538+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:00.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.538+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 zone MyZone found 2024-05-15T14:36:00.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:00.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:00.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:00.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:00.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:00.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:00.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:00.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:00.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 started sync module instance, tier type = 2024-05-15T14:36:00.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.539+0000 7f4fe0525800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:00.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.551+0000 7f4fe0525800 20 add_watcher() i=0 2024-05-15T14:36:00.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.551+0000 7f4fe0525800 20 add_watcher() i=1 2024-05-15T14:36:00.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.551+0000 7f4fe0525800 20 add_watcher() i=2 2024-05-15T14:36:00.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.551+0000 7f4fe0525800 20 add_watcher() i=3 2024-05-15T14:36:00.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.551+0000 7f4fe0525800 20 add_watcher() i=4 2024-05-15T14:36:00.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.551+0000 7f4fe0525800 20 add_watcher() i=5 2024-05-15T14:36:00.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.551+0000 7f4fe0525800 20 add_watcher() i=6 2024-05-15T14:36:00.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.552+0000 7f4fe0525800 20 add_watcher() i=7 2024-05-15T14:36:00.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.552+0000 7f4fe0525800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:00.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.553+0000 7f4e92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:00.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.554+0000 7f4fe0525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:00.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.554+0000 7f4fe0525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:00.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.554+0000 7f4fe0525800 5 note: GC not initialized 2024-05-15T14:36:00.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.554+0000 7f4e91fdb640 20 reqs_thread_entry: start 2024-05-15T14:36:00.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.554+0000 7f4fe0525800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:00.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.554+0000 7f4fe0525800 20 Filter name: none 2024-05-15T14:36:00.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.554+0000 7f4e037fe640 20 reqs_thread_entry: start 2024-05-15T14:36:00.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.555+0000 7f4fe0525800 20 rados->read ofs=0 len=0 2024-05-15T14:36:00.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.555+0000 7f4fe0525800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:36:00.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.557+0000 7f4e92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:00.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.559+0000 7f4fe0525800 20 remove_watcher() i=0 2024-05-15T14:36:00.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.559+0000 7f4fe0525800 2 removed watcher, disabling cache 2024-05-15T14:36:00.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.560+0000 7f4fe0525800 20 remove_watcher() i=1 2024-05-15T14:36:00.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.561+0000 7f4fe0525800 20 remove_watcher() i=2 2024-05-15T14:36:00.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.563+0000 7f4fe0525800 20 remove_watcher() i=3 2024-05-15T14:36:00.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.564+0000 7f4fe0525800 20 remove_watcher() i=4 2024-05-15T14:36:00.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.565+0000 7f4fe0525800 20 remove_watcher() i=5 2024-05-15T14:36:00.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.566+0000 7f4fe0525800 20 remove_watcher() i=6 2024-05-15T14:36:00.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:00.567+0000 7f4fe0525800 20 remove_watcher() i=7 2024-05-15T14:36:20.638 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:36:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:test pushing persistent notification when one of the endpoints has error ... 127.0.0.1 - - [15/May/2024 14:36:20] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:21.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.035+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.037+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.037+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.038+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.038+0000 7f9872736800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.038+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.038+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.038+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.039+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.039+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.039+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.039+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.039+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.039+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.040+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.040+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.041+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.041+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 zone MyZone found 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:21.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 started sync module instance, tier type = 2024-05-15T14:36:21.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.042+0000 7f9872736800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:21.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.052+0000 7f9872736800 20 add_watcher() i=0 2024-05-15T14:36:21.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.052+0000 7f9872736800 20 add_watcher() i=1 2024-05-15T14:36:21.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.052+0000 7f9872736800 20 add_watcher() i=2 2024-05-15T14:36:21.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.052+0000 7f9872736800 20 add_watcher() i=3 2024-05-15T14:36:21.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.052+0000 7f9872736800 20 add_watcher() i=4 2024-05-15T14:36:21.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.052+0000 7f9872736800 20 add_watcher() i=5 2024-05-15T14:36:21.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.052+0000 7f9872736800 20 add_watcher() i=6 2024-05-15T14:36:21.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.053+0000 7f9872736800 20 add_watcher() i=7 2024-05-15T14:36:21.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.053+0000 7f9872736800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:21.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.055+0000 7f9724fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:21.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.055+0000 7f9872736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:21.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.055+0000 7f9872736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:21.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.055+0000 7f9872736800 5 note: GC not initialized 2024-05-15T14:36:21.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.055+0000 7f969f7fe640 20 reqs_thread_entry: start 2024-05-15T14:36:21.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.055+0000 7f9872736800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:21.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.055+0000 7f9872736800 20 Filter name: none 2024-05-15T14:36:21.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.055+0000 7f969d7fa640 20 reqs_thread_entry: start 2024-05-15T14:36:21.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.056+0000 7f9872736800 20 rados->read ofs=0 len=0 2024-05-15T14:36:21.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.057+0000 7f9872736800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:36:21.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.059+0000 7f9724fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:21.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.061+0000 7f9872736800 20 remove_watcher() i=0 2024-05-15T14:36:21.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.061+0000 7f9872736800 2 removed watcher, disabling cache 2024-05-15T14:36:21.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.061+0000 7f9872736800 20 remove_watcher() i=1 2024-05-15T14:36:21.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.062+0000 7f9872736800 20 remove_watcher() i=2 2024-05-15T14:36:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.063+0000 7f9872736800 20 remove_watcher() i=3 2024-05-15T14:36:21.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.064+0000 7f9872736800 20 remove_watcher() i=4 2024-05-15T14:36:21.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.065+0000 7f9872736800 20 remove_watcher() i=5 2024-05-15T14:36:21.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.066+0000 7f9872736800 20 remove_watcher() i=6 2024-05-15T14:36:21.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:21.067+0000 7f9872736800 20 remove_watcher() i=7 2024-05-15T14:36:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.176+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.178+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.178+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.179+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:26.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.179+0000 7f1e91533800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:26.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.179+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.179+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:26.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.179+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.180+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:26.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.180+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.180+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.180+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.181+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.181+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.181+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:26.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.181+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.182+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:26.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.182+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 20 zone MyZone found 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.183+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.184+0000 7f1e91533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.184+0000 7f1e91533800 20 started sync module instance, tier type = 2024-05-15T14:36:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.184+0000 7f1e91533800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.195+0000 7f1e91533800 20 add_watcher() i=0 2024-05-15T14:36:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.195+0000 7f1e91533800 20 add_watcher() i=1 2024-05-15T14:36:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.195+0000 7f1e91533800 20 add_watcher() i=2 2024-05-15T14:36:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.195+0000 7f1e91533800 20 add_watcher() i=3 2024-05-15T14:36:26.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.195+0000 7f1e91533800 20 add_watcher() i=4 2024-05-15T14:36:26.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.195+0000 7f1e91533800 20 add_watcher() i=5 2024-05-15T14:36:26.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.195+0000 7f1e91533800 20 add_watcher() i=6 2024-05-15T14:36:26.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.196+0000 7f1e91533800 20 add_watcher() i=7 2024-05-15T14:36:26.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.196+0000 7f1e91533800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:26.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.198+0000 7f1d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.198+0000 7f1e91533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.198+0000 7f1e91533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.198+0000 7f1e91533800 5 note: GC not initialized 2024-05-15T14:36:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.198+0000 7f1d427e4640 20 reqs_thread_entry: start 2024-05-15T14:36:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.198+0000 7f1e91533800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.199+0000 7f1e91533800 20 Filter name: none 2024-05-15T14:36:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.199+0000 7f1cb3fff640 20 reqs_thread_entry: start 2024-05-15T14:36:26.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.199+0000 7f1e91533800 20 rados->read ofs=0 len=0 2024-05-15T14:36:26.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.199+0000 7f1e91533800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:36:26.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.201+0000 7f1d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.204+0000 7f1e91533800 20 remove_watcher() i=0 2024-05-15T14:36:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.204+0000 7f1e91533800 2 removed watcher, disabling cache 2024-05-15T14:36:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.205+0000 7f1e91533800 20 remove_watcher() i=1 2024-05-15T14:36:26.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.206+0000 7f1e91533800 20 remove_watcher() i=2 2024-05-15T14:36:26.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.207+0000 7f1e91533800 20 remove_watcher() i=3 2024-05-15T14:36:26.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.208+0000 7f1e91533800 20 remove_watcher() i=4 2024-05-15T14:36:26.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.209+0000 7f1e91533800 20 remove_watcher() i=5 2024-05-15T14:36:26.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.210+0000 7f1e91533800 20 remove_watcher() i=6 2024-05-15T14:36:26.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:26.211+0000 7f1e91533800 20 remove_watcher() i=7 2024-05-15T14:36:31.275 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:31.275 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:31.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.317+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.319+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.319+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.320+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.320+0000 7fc687e62800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.320+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.320+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.320+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.321+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.321+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.321+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.321+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.322+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.322+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.322+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:31.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.322+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.323+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:31.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.323+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 zone MyZone found 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 started sync module instance, tier type = 2024-05-15T14:36:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.324+0000 7fc687e62800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.335+0000 7fc687e62800 20 add_watcher() i=0 2024-05-15T14:36:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.335+0000 7fc687e62800 20 add_watcher() i=1 2024-05-15T14:36:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.335+0000 7fc687e62800 20 add_watcher() i=2 2024-05-15T14:36:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.335+0000 7fc687e62800 20 add_watcher() i=3 2024-05-15T14:36:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.335+0000 7fc687e62800 20 add_watcher() i=4 2024-05-15T14:36:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.335+0000 7fc687e62800 20 add_watcher() i=5 2024-05-15T14:36:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.335+0000 7fc687e62800 20 add_watcher() i=6 2024-05-15T14:36:31.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.336+0000 7fc687e62800 20 add_watcher() i=7 2024-05-15T14:36:31.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.336+0000 7fc687e62800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.338+0000 7fc5377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.338+0000 7fc687e62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.338+0000 7fc687e62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.338+0000 7fc687e62800 5 note: GC not initialized 2024-05-15T14:36:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.338+0000 7fc5367fc640 20 reqs_thread_entry: start 2024-05-15T14:36:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.338+0000 7fc687e62800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.339+0000 7fc687e62800 20 Filter name: none 2024-05-15T14:36:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.339+0000 7fc4abfff640 20 reqs_thread_entry: start 2024-05-15T14:36:31.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.339+0000 7fc687e62800 20 rados->read ofs=0 len=0 2024-05-15T14:36:31.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.340+0000 7fc687e62800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:36:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.342+0000 7fc5377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.344+0000 7fc687e62800 20 remove_watcher() i=0 2024-05-15T14:36:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.344+0000 7fc687e62800 2 removed watcher, disabling cache 2024-05-15T14:36:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.345+0000 7fc687e62800 20 remove_watcher() i=1 2024-05-15T14:36:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.346+0000 7fc687e62800 20 remove_watcher() i=2 2024-05-15T14:36:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.347+0000 7fc687e62800 20 remove_watcher() i=3 2024-05-15T14:36:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.349+0000 7fc687e62800 20 remove_watcher() i=4 2024-05-15T14:36:31.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.349+0000 7fc687e62800 20 remove_watcher() i=5 2024-05-15T14:36:31.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.350+0000 7fc687e62800 20 remove_watcher() i=6 2024-05-15T14:36:31.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:31.352+0000 7fc687e62800 20 remove_watcher() i=7 2024-05-15T14:36:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.461+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.463+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.463+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.464+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.464+0000 7f9b52d1f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.464+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.464+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.464+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.465+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.465+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.465+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.465+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.466+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.466+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.466+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.466+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.467+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.467+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 zone MyZone found 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:36.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.468+0000 7f9b52d1f800 20 started sync module instance, tier type = 2024-05-15T14:36:36.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.469+0000 7f9b52d1f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.479+0000 7f9b52d1f800 20 add_watcher() i=0 2024-05-15T14:36:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.479+0000 7f9b52d1f800 20 add_watcher() i=1 2024-05-15T14:36:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.479+0000 7f9b52d1f800 20 add_watcher() i=2 2024-05-15T14:36:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.479+0000 7f9b52d1f800 20 add_watcher() i=3 2024-05-15T14:36:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.479+0000 7f9b52d1f800 20 add_watcher() i=4 2024-05-15T14:36:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.479+0000 7f9b52d1f800 20 add_watcher() i=5 2024-05-15T14:36:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.479+0000 7f9b52d1f800 20 add_watcher() i=6 2024-05-15T14:36:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.480+0000 7f9b52d1f800 20 add_watcher() i=7 2024-05-15T14:36:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.480+0000 7f9b52d1f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:36.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.482+0000 7f9a057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.483+0000 7f9b52d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.483+0000 7f9b52d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.483+0000 7f9b52d1f800 5 note: GC not initialized 2024-05-15T14:36:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.483+0000 7f997ffff640 20 reqs_thread_entry: start 2024-05-15T14:36:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.483+0000 7f9b52d1f800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.483+0000 7f9b52d1f800 20 Filter name: none 2024-05-15T14:36:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.483+0000 7f997dffb640 20 reqs_thread_entry: start 2024-05-15T14:36:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.484+0000 7f9b52d1f800 20 rados->read ofs=0 len=0 2024-05-15T14:36:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.484+0000 7f9b52d1f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:36:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.486+0000 7f9a057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.488+0000 7f9b52d1f800 20 remove_watcher() i=0 2024-05-15T14:36:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.488+0000 7f9b52d1f800 2 removed watcher, disabling cache 2024-05-15T14:36:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.489+0000 7f9b52d1f800 20 remove_watcher() i=1 2024-05-15T14:36:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.490+0000 7f9b52d1f800 20 remove_watcher() i=2 2024-05-15T14:36:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.492+0000 7f9b52d1f800 20 remove_watcher() i=3 2024-05-15T14:36:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.493+0000 7f9b52d1f800 20 remove_watcher() i=4 2024-05-15T14:36:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.494+0000 7f9b52d1f800 20 remove_watcher() i=5 2024-05-15T14:36:36.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.495+0000 7f9b52d1f800 20 remove_watcher() i=6 2024-05-15T14:36:36.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:36.496+0000 7f9b52d1f800 20 remove_watcher() i=7 2024-05-15T14:36:40.100 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.102 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.102 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.103 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.103 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.104 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.104 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.105 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:40.105 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:40] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:41.551 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:41.552 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:41.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.591+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.593+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:41.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.593+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.594+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:41.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.594+0000 7efdfb12b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:41.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.594+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.594+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:41.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.594+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.595+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.595+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.595+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:41.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.595+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.596+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.596+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.596+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.596+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:41.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 20 zone MyZone found 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.597+0000 7efdfb12b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.598+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.598+0000 7efdfb12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:41.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.598+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.598+0000 7efdfb12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:41.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.598+0000 7efdfb12b800 20 started sync module instance, tier type = 2024-05-15T14:36:41.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.598+0000 7efdfb12b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.608+0000 7efdfb12b800 20 add_watcher() i=0 2024-05-15T14:36:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.608+0000 7efdfb12b800 20 add_watcher() i=1 2024-05-15T14:36:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.608+0000 7efdfb12b800 20 add_watcher() i=2 2024-05-15T14:36:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.608+0000 7efdfb12b800 20 add_watcher() i=3 2024-05-15T14:36:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.608+0000 7efdfb12b800 20 add_watcher() i=4 2024-05-15T14:36:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.608+0000 7efdfb12b800 20 add_watcher() i=5 2024-05-15T14:36:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.608+0000 7efdfb12b800 20 add_watcher() i=6 2024-05-15T14:36:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.609+0000 7efdfb12b800 20 add_watcher() i=7 2024-05-15T14:36:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.609+0000 7efdfb12b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:41.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.611+0000 7efcad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:41.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.611+0000 7efdfb12b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:41.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.611+0000 7efdfb12b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:41.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.611+0000 7efdfb12b800 5 note: GC not initialized 2024-05-15T14:36:41.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.612+0000 7efc27fff640 20 reqs_thread_entry: start 2024-05-15T14:36:41.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.612+0000 7efdfb12b800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:41.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.612+0000 7efdfb12b800 20 Filter name: none 2024-05-15T14:36:41.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.612+0000 7efc25ffb640 20 reqs_thread_entry: start 2024-05-15T14:36:41.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.612+0000 7efdfb12b800 20 rados->read ofs=0 len=0 2024-05-15T14:36:41.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.613+0000 7efdfb12b800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:36:41.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.614+0000 7efcad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:41.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.616+0000 7efdfb12b800 20 remove_watcher() i=0 2024-05-15T14:36:41.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.616+0000 7efdfb12b800 2 removed watcher, disabling cache 2024-05-15T14:36:41.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.617+0000 7efdfb12b800 20 remove_watcher() i=1 2024-05-15T14:36:41.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.618+0000 7efdfb12b800 20 remove_watcher() i=2 2024-05-15T14:36:41.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.619+0000 7efdfb12b800 20 remove_watcher() i=3 2024-05-15T14:36:41.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.620+0000 7efdfb12b800 20 remove_watcher() i=4 2024-05-15T14:36:41.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.621+0000 7efdfb12b800 20 remove_watcher() i=5 2024-05-15T14:36:41.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.622+0000 7efdfb12b800 20 remove_watcher() i=6 2024-05-15T14:36:41.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:41.623+0000 7efdfb12b800 20 remove_watcher() i=7 2024-05-15T14:36:46.700 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.700 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.702 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.702 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.702 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.703 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.703 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.703 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:36:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:46.713 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:46.713 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.753+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.756+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.756+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.756+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.756+0000 7f64c6f0c800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.756+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.757+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.757+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.758+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.758+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.758+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.758+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.758+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.758+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.759+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.759+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.759+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:46.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.759+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 20 zone MyZone found 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:46.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.760+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.761+0000 7f64c6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:46.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.761+0000 7f64c6f0c800 20 started sync module instance, tier type = 2024-05-15T14:36:46.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.761+0000 7f64c6f0c800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:46.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.771+0000 7f64c6f0c800 20 add_watcher() i=0 2024-05-15T14:36:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.771+0000 7f64c6f0c800 20 add_watcher() i=1 2024-05-15T14:36:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.771+0000 7f64c6f0c800 20 add_watcher() i=2 2024-05-15T14:36:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.771+0000 7f64c6f0c800 20 add_watcher() i=3 2024-05-15T14:36:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.771+0000 7f64c6f0c800 20 add_watcher() i=4 2024-05-15T14:36:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.771+0000 7f64c6f0c800 20 add_watcher() i=5 2024-05-15T14:36:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.771+0000 7f64c6f0c800 20 add_watcher() i=6 2024-05-15T14:36:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.772+0000 7f64c6f0c800 20 add_watcher() i=7 2024-05-15T14:36:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.772+0000 7f64c6f0c800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:46.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.774+0000 7f637afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:46.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.774+0000 7f64c6f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:46.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.774+0000 7f64c6f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:46.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.774+0000 7f64c6f0c800 5 note: GC not initialized 2024-05-15T14:36:46.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.774+0000 7f6379fe3640 20 reqs_thread_entry: start 2024-05-15T14:36:46.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.774+0000 7f64c6f0c800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:46.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.774+0000 7f64c6f0c800 20 Filter name: none 2024-05-15T14:36:46.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.774+0000 7f62eb7fe640 20 reqs_thread_entry: start 2024-05-15T14:36:46.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.775+0000 7f64c6f0c800 20 rados->read ofs=0 len=0 2024-05-15T14:36:46.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.775+0000 7f64c6f0c800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:36:46.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.776+0000 7f637afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:46.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.779+0000 7f64c6f0c800 20 remove_watcher() i=0 2024-05-15T14:36:46.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.779+0000 7f64c6f0c800 2 removed watcher, disabling cache 2024-05-15T14:36:46.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.779+0000 7f64c6f0c800 20 remove_watcher() i=1 2024-05-15T14:36:46.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.780+0000 7f64c6f0c800 20 remove_watcher() i=2 2024-05-15T14:36:46.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.781+0000 7f64c6f0c800 20 remove_watcher() i=3 2024-05-15T14:36:46.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.782+0000 7f64c6f0c800 20 remove_watcher() i=4 2024-05-15T14:36:46.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.784+0000 7f64c6f0c800 20 remove_watcher() i=5 2024-05-15T14:36:46.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.785+0000 7f64c6f0c800 20 remove_watcher() i=6 2024-05-15T14:36:46.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:46.786+0000 7f64c6f0c800 20 remove_watcher() i=7 2024-05-15T14:36:52.212 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:36:52.226 INFO:teuthology.orchestra.run.smithi018.stderr:test pushing persistent notification http ... 172.21.15.18 - - [15/May/2024 14:36:52] "POST / HTTP/1.1" 200 - 2024-05-15T14:36:54.657 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:54.657 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:54.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.696+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.698+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:54.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.698+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.698+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.698+0000 7f31caf25800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.698+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.699+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.699+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.699+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.699+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.700+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.700+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.700+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.700+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.700+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.700+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.701+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.701+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 zone MyZone found 2024-05-15T14:36:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 started sync module instance, tier type = 2024-05-15T14:36:54.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.702+0000 7f31caf25800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:54.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.712+0000 7f31caf25800 20 add_watcher() i=0 2024-05-15T14:36:54.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.712+0000 7f31caf25800 20 add_watcher() i=1 2024-05-15T14:36:54.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.712+0000 7f31caf25800 20 add_watcher() i=2 2024-05-15T14:36:54.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.712+0000 7f31caf25800 20 add_watcher() i=3 2024-05-15T14:36:54.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.712+0000 7f31caf25800 20 add_watcher() i=4 2024-05-15T14:36:54.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.712+0000 7f31caf25800 20 add_watcher() i=5 2024-05-15T14:36:54.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.712+0000 7f31caf25800 20 add_watcher() i=6 2024-05-15T14:36:54.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.713+0000 7f31caf25800 20 add_watcher() i=7 2024-05-15T14:36:54.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.713+0000 7f31caf25800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:54.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.715+0000 7f307d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:54.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.715+0000 7f31caf25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:54.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.715+0000 7f31caf25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:54.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.715+0000 7f31caf25800 5 note: GC not initialized 2024-05-15T14:36:54.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.715+0000 7f2ff7fff640 20 reqs_thread_entry: start 2024-05-15T14:36:54.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.715+0000 7f31caf25800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:54.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.715+0000 7f31caf25800 20 Filter name: none 2024-05-15T14:36:54.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.715+0000 7f2ff5ffb640 20 reqs_thread_entry: start 2024-05-15T14:36:54.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.716+0000 7f31caf25800 20 rados->read ofs=0 len=0 2024-05-15T14:36:54.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.716+0000 7f31caf25800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:36:54.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.718+0000 7f307d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:54.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.720+0000 7f31caf25800 20 remove_watcher() i=0 2024-05-15T14:36:54.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.720+0000 7f31caf25800 2 removed watcher, disabling cache 2024-05-15T14:36:54.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.721+0000 7f31caf25800 20 remove_watcher() i=1 2024-05-15T14:36:54.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.722+0000 7f31caf25800 20 remove_watcher() i=2 2024-05-15T14:36:54.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.723+0000 7f31caf25800 20 remove_watcher() i=3 2024-05-15T14:36:54.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.724+0000 7f31caf25800 20 remove_watcher() i=4 2024-05-15T14:36:54.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.725+0000 7f31caf25800 20 remove_watcher() i=5 2024-05-15T14:36:54.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.726+0000 7f31caf25800 20 remove_watcher() i=6 2024-05-15T14:36:54.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:54.727+0000 7f31caf25800 20 remove_watcher() i=7 2024-05-15T14:36:59.795 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:36:59.795 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:36:59.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.837+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.839+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:59.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.839+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.840+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.840+0000 7ff3e6cbb800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:36:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.840+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.841+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:59.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.841+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.841+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:36:59.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.841+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.842+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:36:59.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.842+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.842+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:59.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.842+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.842+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:36:59.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.842+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.843+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:36:59.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.843+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:36:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 20 zone MyZone found 2024-05-15T14:36:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:36:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:36:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:36:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:36:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 20 period zonegroup name MyZoneGroup 2024-05-15T14:36:59.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:36:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.844+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.845+0000 7ff3e6cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:36:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.845+0000 7ff3e6cbb800 20 started sync module instance, tier type = 2024-05-15T14:36:59.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.845+0000 7ff3e6cbb800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:36:59.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.856+0000 7ff3e6cbb800 20 add_watcher() i=0 2024-05-15T14:36:59.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.856+0000 7ff3e6cbb800 20 add_watcher() i=1 2024-05-15T14:36:59.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.856+0000 7ff3e6cbb800 20 add_watcher() i=2 2024-05-15T14:36:59.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.856+0000 7ff3e6cbb800 20 add_watcher() i=3 2024-05-15T14:36:59.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.856+0000 7ff3e6cbb800 20 add_watcher() i=4 2024-05-15T14:36:59.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.856+0000 7ff3e6cbb800 20 add_watcher() i=5 2024-05-15T14:36:59.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.856+0000 7ff3e6cbb800 20 add_watcher() i=6 2024-05-15T14:36:59.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.857+0000 7ff3e6cbb800 20 add_watcher() i=7 2024-05-15T14:36:59.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.857+0000 7ff3e6cbb800 2 all 8 watchers are set, enabling cache 2024-05-15T14:36:59.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.859+0000 7ff29afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:59.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.859+0000 7ff3e6cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:36:59.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.859+0000 7ff3e6cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:36:59.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.859+0000 7ff3e6cbb800 5 note: GC not initialized 2024-05-15T14:36:59.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.859+0000 7ff299fdb640 20 reqs_thread_entry: start 2024-05-15T14:36:59.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.859+0000 7ff3e6cbb800 20 init_complete bucket index max shards: 11 2024-05-15T14:36:59.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.860+0000 7ff3e6cbb800 20 Filter name: none 2024-05-15T14:36:59.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.860+0000 7ff20b7fe640 20 reqs_thread_entry: start 2024-05-15T14:36:59.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.860+0000 7ff3e6cbb800 20 rados->read ofs=0 len=0 2024-05-15T14:36:59.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.861+0000 7ff3e6cbb800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:36:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.863+0000 7ff29afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:36:59.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.865+0000 7ff3e6cbb800 20 remove_watcher() i=0 2024-05-15T14:36:59.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.865+0000 7ff3e6cbb800 2 removed watcher, disabling cache 2024-05-15T14:36:59.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.866+0000 7ff3e6cbb800 20 remove_watcher() i=1 2024-05-15T14:36:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.867+0000 7ff3e6cbb800 20 remove_watcher() i=2 2024-05-15T14:36:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.868+0000 7ff3e6cbb800 20 remove_watcher() i=3 2024-05-15T14:36:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.869+0000 7ff3e6cbb800 20 remove_watcher() i=4 2024-05-15T14:36:59.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.870+0000 7ff3e6cbb800 20 remove_watcher() i=5 2024-05-15T14:36:59.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.871+0000 7ff3e6cbb800 20 remove_watcher() i=6 2024-05-15T14:36:59.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:36:59.872+0000 7ff3e6cbb800 20 remove_watcher() i=7 2024-05-15T14:37:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:04.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.982+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.984+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:04.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.984+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.985+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:04.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.985+0000 7f2fabb75800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:04.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.985+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.985+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:04.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.985+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.986+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:04.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.986+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.986+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.986+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.986+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.986+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.987+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.987+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.987+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:04.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.987+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 20 zone MyZone found 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:04.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.988+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:04.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.989+0000 7f2fabb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:04.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.989+0000 7f2fabb75800 20 started sync module instance, tier type = 2024-05-15T14:37:04.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.989+0000 7f2fabb75800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:05.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.999+0000 7f2fabb75800 20 add_watcher() i=0 2024-05-15T14:37:05.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.999+0000 7f2fabb75800 20 add_watcher() i=1 2024-05-15T14:37:05.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.999+0000 7f2fabb75800 20 add_watcher() i=2 2024-05-15T14:37:05.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.999+0000 7f2fabb75800 20 add_watcher() i=3 2024-05-15T14:37:05.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.999+0000 7f2fabb75800 20 add_watcher() i=4 2024-05-15T14:37:05.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.999+0000 7f2fabb75800 20 add_watcher() i=5 2024-05-15T14:37:05.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:04.999+0000 7f2fabb75800 20 add_watcher() i=6 2024-05-15T14:37:05.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.000+0000 7f2fabb75800 20 add_watcher() i=7 2024-05-15T14:37:05.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.000+0000 7f2fabb75800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:05.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.002+0000 7f2e5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:05.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.002+0000 7f2fabb75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:05.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.002+0000 7f2fabb75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:05.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.003+0000 7f2fabb75800 5 note: GC not initialized 2024-05-15T14:37:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.003+0000 7f2e5efe5640 20 reqs_thread_entry: start 2024-05-15T14:37:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.003+0000 7f2fabb75800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.003+0000 7f2fabb75800 20 Filter name: none 2024-05-15T14:37:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.003+0000 7f2e5cfe1640 20 reqs_thread_entry: start 2024-05-15T14:37:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.004+0000 7f2fabb75800 20 rados->read ofs=0 len=0 2024-05-15T14:37:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.004+0000 7f2fabb75800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:37:05.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.006+0000 7f2e5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.008+0000 7f2fabb75800 20 remove_watcher() i=0 2024-05-15T14:37:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.008+0000 7f2fabb75800 2 removed watcher, disabling cache 2024-05-15T14:37:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.010+0000 7f2fabb75800 20 remove_watcher() i=1 2024-05-15T14:37:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.011+0000 7f2fabb75800 20 remove_watcher() i=2 2024-05-15T14:37:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.012+0000 7f2fabb75800 20 remove_watcher() i=3 2024-05-15T14:37:05.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.013+0000 7f2fabb75800 20 remove_watcher() i=4 2024-05-15T14:37:05.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.013+0000 7f2fabb75800 20 remove_watcher() i=5 2024-05-15T14:37:05.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.015+0000 7f2fabb75800 20 remove_watcher() i=6 2024-05-15T14:37:05.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:05.015+0000 7f2fabb75800 20 remove_watcher() i=7 2024-05-15T14:37:10.083 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:10.083 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:10.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.125+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.127+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:10.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.127+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.128+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:10.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.128+0000 7f13f541f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:10.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.128+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.128+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:10.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.128+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.129+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:10.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.129+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.129+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:10.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.130+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.130+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:10.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.130+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.130+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:10.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.130+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.131+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:10.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.131+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 20 zone MyZone found 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:10.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:10.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.132+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.133+0000 7f13f541f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:10.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.133+0000 7f13f541f800 20 started sync module instance, tier type = 2024-05-15T14:37:10.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.133+0000 7f13f541f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.144+0000 7f13f541f800 20 add_watcher() i=0 2024-05-15T14:37:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.144+0000 7f13f541f800 20 add_watcher() i=1 2024-05-15T14:37:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.144+0000 7f13f541f800 20 add_watcher() i=2 2024-05-15T14:37:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.144+0000 7f13f541f800 20 add_watcher() i=3 2024-05-15T14:37:10.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.144+0000 7f13f541f800 20 add_watcher() i=4 2024-05-15T14:37:10.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.144+0000 7f13f541f800 20 add_watcher() i=5 2024-05-15T14:37:10.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.144+0000 7f13f541f800 20 add_watcher() i=6 2024-05-15T14:37:10.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.145+0000 7f13f541f800 20 add_watcher() i=7 2024-05-15T14:37:10.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.145+0000 7f13f541f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:10.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.146+0000 7f12a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.147+0000 7f13f541f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.147+0000 7f13f541f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.147+0000 7f13f541f800 5 note: GC not initialized 2024-05-15T14:37:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.147+0000 7f1223fff640 20 reqs_thread_entry: start 2024-05-15T14:37:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.147+0000 7f13f541f800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.147+0000 7f13f541f800 20 Filter name: none 2024-05-15T14:37:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.147+0000 7f1221ffb640 20 reqs_thread_entry: start 2024-05-15T14:37:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.148+0000 7f13f541f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.148+0000 7f13f541f800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:37:10.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.150+0000 7f12a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:10.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.152+0000 7f13f541f800 20 remove_watcher() i=0 2024-05-15T14:37:10.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.152+0000 7f13f541f800 2 removed watcher, disabling cache 2024-05-15T14:37:10.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.153+0000 7f13f541f800 20 remove_watcher() i=1 2024-05-15T14:37:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.154+0000 7f13f541f800 20 remove_watcher() i=2 2024-05-15T14:37:10.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.156+0000 7f13f541f800 20 remove_watcher() i=3 2024-05-15T14:37:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.157+0000 7f13f541f800 20 remove_watcher() i=4 2024-05-15T14:37:10.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.158+0000 7f13f541f800 20 remove_watcher() i=5 2024-05-15T14:37:10.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.159+0000 7f13f541f800 20 remove_watcher() i=6 2024-05-15T14:37:10.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:10.160+0000 7f13f541f800 20 remove_watcher() i=7 2024-05-15T14:37:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.408 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.408 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.408 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.414 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.414 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.416 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.416 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.416 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.417 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.417 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:10] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.445 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.493 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.493 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.494 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.494 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.495 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.495 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.708 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.708 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.709 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.709 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.710 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.710 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.711 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.711 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.713 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.714 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.714 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.715 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.715 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.716 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.716 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.717 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.717 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.719 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.720 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.720 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.721 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.722 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.722 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.722 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.724 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.724 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.725 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.725 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.726 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.726 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.730 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:13.730 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:13] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.773 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.773 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.774 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.774 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.982 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.982 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.982 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.982 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.988 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.988 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.989 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.989 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.990 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.990 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.991 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.991 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.992 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.992 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.993 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.993 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.994 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.994 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.995 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.995 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.996 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.996 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.997 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.997 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.999 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:14] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:14.999 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.000 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.000 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.001 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.001 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.003 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.003 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.003 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.004 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.004 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.009 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.009 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:15] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:15.228 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:15.228 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:15.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.271+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.272+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:15.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.272+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.273+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:15.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.273+0000 7fdb46a16800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:15.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.273+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.273+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:15.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.273+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.274+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:15.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.274+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.275+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:15.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.275+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.275+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:15.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.275+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.275+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:15.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.275+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.276+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.276+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:15.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 20 zone MyZone found 2024-05-15T14:37:15.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:15.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:15.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.277+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.278+0000 7fdb46a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.278+0000 7fdb46a16800 20 started sync module instance, tier type = 2024-05-15T14:37:15.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.278+0000 7fdb46a16800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.289+0000 7fdb46a16800 20 add_watcher() i=0 2024-05-15T14:37:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.289+0000 7fdb46a16800 20 add_watcher() i=1 2024-05-15T14:37:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.289+0000 7fdb46a16800 20 add_watcher() i=2 2024-05-15T14:37:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.289+0000 7fdb46a16800 20 add_watcher() i=3 2024-05-15T14:37:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.289+0000 7fdb46a16800 20 add_watcher() i=4 2024-05-15T14:37:15.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.289+0000 7fdb46a16800 20 add_watcher() i=5 2024-05-15T14:37:15.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.289+0000 7fdb46a16800 20 add_watcher() i=6 2024-05-15T14:37:15.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.290+0000 7fdb46a16800 20 add_watcher() i=7 2024-05-15T14:37:15.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.290+0000 7fdb46a16800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.291+0000 7fd9f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.292+0000 7fdb46a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.292+0000 7fdb46a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.292+0000 7fdb46a16800 5 note: GC not initialized 2024-05-15T14:37:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.292+0000 7fd9737fe640 20 reqs_thread_entry: start 2024-05-15T14:37:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.292+0000 7fdb46a16800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.292+0000 7fdb46a16800 20 Filter name: none 2024-05-15T14:37:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.292+0000 7fd9717fa640 20 reqs_thread_entry: start 2024-05-15T14:37:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.293+0000 7fdb46a16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.293+0000 7fdb46a16800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:37:15.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.295+0000 7fd9f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:15.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.297+0000 7fdb46a16800 20 remove_watcher() i=0 2024-05-15T14:37:15.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.297+0000 7fdb46a16800 2 removed watcher, disabling cache 2024-05-15T14:37:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.299+0000 7fdb46a16800 20 remove_watcher() i=1 2024-05-15T14:37:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.300+0000 7fdb46a16800 20 remove_watcher() i=2 2024-05-15T14:37:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.301+0000 7fdb46a16800 20 remove_watcher() i=3 2024-05-15T14:37:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.302+0000 7fdb46a16800 20 remove_watcher() i=4 2024-05-15T14:37:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.303+0000 7fdb46a16800 20 remove_watcher() i=5 2024-05-15T14:37:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.304+0000 7fdb46a16800 20 remove_watcher() i=6 2024-05-15T14:37:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:15.305+0000 7fdb46a16800 20 remove_watcher() i=7 2024-05-15T14:37:16.054 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.054 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.054 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.055 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.055 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.056 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.057 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.061 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.062 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.062 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.063 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.064 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.064 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.066 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.068 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.068 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.071 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.071 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.072 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.072 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:16.073 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:16] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.076 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.077 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.077 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.078 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.078 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.078 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.079 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.084 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.084 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.085 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.085 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.090 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.091 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.093 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.093 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.094 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:17.094 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:17] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:18.100 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:18.102 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:18.102 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:20.377 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:20.377 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:20.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.420+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.422+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:20.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.422+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.422+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:20.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.422+0000 7f9785e16800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:20.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.422+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.423+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:20.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.423+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.423+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:20.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.423+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.424+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.424+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.424+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.424+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.425+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:20.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.425+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.425+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:20.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.425+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:20.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 20 zone MyZone found 2024-05-15T14:37:20.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:20.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:20.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:20.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:20.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:20.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:20.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.426+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.427+0000 7f9785e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:20.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.427+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.427+0000 7f9785e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:20.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.427+0000 7f9785e16800 20 started sync module instance, tier type = 2024-05-15T14:37:20.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.427+0000 7f9785e16800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:20.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.438+0000 7f9785e16800 20 add_watcher() i=0 2024-05-15T14:37:20.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.438+0000 7f9785e16800 20 add_watcher() i=1 2024-05-15T14:37:20.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.438+0000 7f9785e16800 20 add_watcher() i=2 2024-05-15T14:37:20.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.438+0000 7f9785e16800 20 add_watcher() i=3 2024-05-15T14:37:20.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.438+0000 7f9785e16800 20 add_watcher() i=4 2024-05-15T14:37:20.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.438+0000 7f9785e16800 20 add_watcher() i=5 2024-05-15T14:37:20.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.438+0000 7f9785e16800 20 add_watcher() i=6 2024-05-15T14:37:20.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.440+0000 7f9785e16800 20 add_watcher() i=7 2024-05-15T14:37:20.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.440+0000 7f9785e16800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:20.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.442+0000 7f96377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.442+0000 7f9785e16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.442+0000 7f9785e16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.442+0000 7f9785e16800 5 note: GC not initialized 2024-05-15T14:37:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.442+0000 7f96367e4640 20 reqs_thread_entry: start 2024-05-15T14:37:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.442+0000 7f9785e16800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.442+0000 7f9785e16800 20 Filter name: none 2024-05-15T14:37:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.443+0000 7f95a7fff640 20 reqs_thread_entry: start 2024-05-15T14:37:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.443+0000 7f9785e16800 20 rados->read ofs=0 len=0 2024-05-15T14:37:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.444+0000 7f9785e16800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:37:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.445+0000 7f96377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.448+0000 7f9785e16800 20 remove_watcher() i=0 2024-05-15T14:37:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.448+0000 7f9785e16800 2 removed watcher, disabling cache 2024-05-15T14:37:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.449+0000 7f9785e16800 20 remove_watcher() i=1 2024-05-15T14:37:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.450+0000 7f9785e16800 20 remove_watcher() i=2 2024-05-15T14:37:20.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.451+0000 7f9785e16800 20 remove_watcher() i=3 2024-05-15T14:37:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.452+0000 7f9785e16800 20 remove_watcher() i=4 2024-05-15T14:37:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.453+0000 7f9785e16800 20 remove_watcher() i=5 2024-05-15T14:37:20.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.454+0000 7f9785e16800 20 remove_watcher() i=6 2024-05-15T14:37:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:20.455+0000 7f9785e16800 20 remove_watcher() i=7 2024-05-15T14:37:25.598 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.600 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.606 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.606 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.612 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.613 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.615 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.620 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.626 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.626 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.631 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.631 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:25] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:25.732 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:25.733 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:25.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.771+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.773+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:25.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.773+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.774+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:25.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.774+0000 7f517ef2f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:25.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.774+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.774+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:25.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.774+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.774+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:25.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.774+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.775+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:25.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.775+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.775+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:25.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.775+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.775+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:25.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.775+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.776+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:25.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.776+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:25.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 zone MyZone found 2024-05-15T14:37:25.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:25.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.777+0000 7f517ef2f800 20 started sync module instance, tier type = 2024-05-15T14:37:25.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.778+0000 7f517ef2f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:25.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.787+0000 7f517ef2f800 20 add_watcher() i=0 2024-05-15T14:37:25.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.787+0000 7f517ef2f800 20 add_watcher() i=1 2024-05-15T14:37:25.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.787+0000 7f517ef2f800 20 add_watcher() i=2 2024-05-15T14:37:25.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.787+0000 7f517ef2f800 20 add_watcher() i=3 2024-05-15T14:37:25.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.787+0000 7f517ef2f800 20 add_watcher() i=4 2024-05-15T14:37:25.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.787+0000 7f517ef2f800 20 add_watcher() i=5 2024-05-15T14:37:25.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.787+0000 7f517ef2f800 20 add_watcher() i=6 2024-05-15T14:37:25.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.788+0000 7f517ef2f800 20 add_watcher() i=7 2024-05-15T14:37:25.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.788+0000 7f517ef2f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:25.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.790+0000 7f50317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:25.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.790+0000 7f517ef2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:25.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.790+0000 7f517ef2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:25.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.790+0000 7f517ef2f800 5 note: GC not initialized 2024-05-15T14:37:25.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.791+0000 7f4fabfff640 20 reqs_thread_entry: start 2024-05-15T14:37:25.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.791+0000 7f517ef2f800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:25.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.791+0000 7f517ef2f800 20 Filter name: none 2024-05-15T14:37:25.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.791+0000 7f4fa9ffb640 20 reqs_thread_entry: start 2024-05-15T14:37:25.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.791+0000 7f517ef2f800 20 rados->read ofs=0 len=0 2024-05-15T14:37:25.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.792+0000 7f517ef2f800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:37:25.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.793+0000 7f50317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:25.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.795+0000 7f517ef2f800 20 remove_watcher() i=0 2024-05-15T14:37:25.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.795+0000 7f517ef2f800 2 removed watcher, disabling cache 2024-05-15T14:37:25.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.796+0000 7f517ef2f800 20 remove_watcher() i=1 2024-05-15T14:37:25.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.797+0000 7f517ef2f800 20 remove_watcher() i=2 2024-05-15T14:37:25.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.798+0000 7f517ef2f800 20 remove_watcher() i=3 2024-05-15T14:37:25.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.799+0000 7f517ef2f800 20 remove_watcher() i=4 2024-05-15T14:37:25.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.800+0000 7f517ef2f800 20 remove_watcher() i=5 2024-05-15T14:37:25.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.801+0000 7f517ef2f800 20 remove_watcher() i=6 2024-05-15T14:37:25.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:25.802+0000 7f517ef2f800 20 remove_watcher() i=7 2024-05-15T14:37:26.613 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.613 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.614 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.614 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.615 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.615 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.616 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.616 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.676 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.676 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.677 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.827 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.828 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.833 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.833 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.836 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.836 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.836 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.837 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.841 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.841 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.842 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.842 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.856 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.856 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.857 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.858 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.860 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.862 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:26.863 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:26] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.894 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.895 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.895 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.895 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.895 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.896 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.896 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:27.897 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:27] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.100 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.100 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.106 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.107 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.107 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.108 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.108 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.109 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.109 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.110 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.111 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.111 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.112 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.112 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.113 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.113 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.114 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.114 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.115 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.115 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.116 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.116 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.118 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.119 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.119 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.119 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.120 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.121 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.121 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.121 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.122 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.123 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.123 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.124 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.124 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.125 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.125 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.126 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.126 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.127 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.127 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.129 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.129 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.129 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.130 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.130 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:28.131 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:28] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.172 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.175 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.175 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.176 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.380 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:29.380 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:29] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:30.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.912+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.914+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.914+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.915+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.915+0000 7fec7d746800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.915+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.915+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.915+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.916+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.916+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.916+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.916+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.917+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.917+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.917+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.917+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.918+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.918+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:30.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 20 zone MyZone found 2024-05-15T14:37:30.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:30.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:30.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:30.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.919+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.920+0000 7fec7d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:30.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.920+0000 7fec7d746800 20 started sync module instance, tier type = 2024-05-15T14:37:30.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.920+0000 7fec7d746800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:30.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.930+0000 7fec7d746800 20 add_watcher() i=0 2024-05-15T14:37:30.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.930+0000 7fec7d746800 20 add_watcher() i=1 2024-05-15T14:37:30.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.930+0000 7fec7d746800 20 add_watcher() i=2 2024-05-15T14:37:30.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.930+0000 7fec7d746800 20 add_watcher() i=3 2024-05-15T14:37:30.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.930+0000 7fec7d746800 20 add_watcher() i=4 2024-05-15T14:37:30.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.930+0000 7fec7d746800 20 add_watcher() i=5 2024-05-15T14:37:30.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.930+0000 7fec7d746800 20 add_watcher() i=6 2024-05-15T14:37:30.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.931+0000 7fec7d746800 20 add_watcher() i=7 2024-05-15T14:37:30.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.931+0000 7fec7d746800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:30.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.934+0000 7feb31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:30.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.934+0000 7fec7d746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:30.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.934+0000 7fec7d746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:30.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.934+0000 7fec7d746800 5 note: GC not initialized 2024-05-15T14:37:30.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.934+0000 7feb30fe1640 20 reqs_thread_entry: start 2024-05-15T14:37:30.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.934+0000 7fec7d746800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:30.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.934+0000 7fec7d746800 20 Filter name: none 2024-05-15T14:37:30.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.934+0000 7feaaa7fc640 20 reqs_thread_entry: start 2024-05-15T14:37:30.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.935+0000 7fec7d746800 20 rados->read ofs=0 len=0 2024-05-15T14:37:30.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.935+0000 7fec7d746800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:37:30.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.937+0000 7feb31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:30.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.939+0000 7fec7d746800 20 remove_watcher() i=0 2024-05-15T14:37:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.939+0000 7fec7d746800 2 removed watcher, disabling cache 2024-05-15T14:37:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.940+0000 7fec7d746800 20 remove_watcher() i=1 2024-05-15T14:37:30.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.941+0000 7fec7d746800 20 remove_watcher() i=2 2024-05-15T14:37:30.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.943+0000 7fec7d746800 20 remove_watcher() i=3 2024-05-15T14:37:30.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.944+0000 7fec7d746800 20 remove_watcher() i=4 2024-05-15T14:37:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.945+0000 7fec7d746800 20 remove_watcher() i=5 2024-05-15T14:37:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.946+0000 7fec7d746800 20 remove_watcher() i=6 2024-05-15T14:37:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:30.947+0000 7fec7d746800 20 remove_watcher() i=7 2024-05-15T14:37:31.220 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.221 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.221 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.221 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.222 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.222 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.223 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.434 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.434 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.434 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.435 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.436 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.436 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.437 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.438 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.438 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.439 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.440 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.440 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.441 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.441 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.442 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.442 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.443 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.443 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.444 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.444 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.445 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.445 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.446 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.446 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.447 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.448 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.449 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.449 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:31.449 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:31] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.501 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.503 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.503 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.504 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.708 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.708 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.713 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.713 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.714 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.714 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.715 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.717 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.717 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.718 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.721 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.722 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.722 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.723 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.724 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.724 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.725 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:32.726 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:32] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:33.780 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:33] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:33.781 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:33] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:33.781 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:33] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:33.781 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:33] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:36.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.060+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.062+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.062+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.063+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.063+0000 7f36dbb33800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.063+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.063+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.063+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.064+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.064+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.064+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.064+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.065+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.065+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.065+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.065+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.066+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.066+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 zone MyZone found 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 started sync module instance, tier type = 2024-05-15T14:37:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.067+0000 7f36dbb33800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:36.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.079+0000 7f36dbb33800 20 add_watcher() i=0 2024-05-15T14:37:36.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.079+0000 7f36dbb33800 20 add_watcher() i=1 2024-05-15T14:37:36.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.079+0000 7f36dbb33800 20 add_watcher() i=2 2024-05-15T14:37:36.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.079+0000 7f36dbb33800 20 add_watcher() i=3 2024-05-15T14:37:36.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.079+0000 7f36dbb33800 20 add_watcher() i=4 2024-05-15T14:37:36.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.079+0000 7f36dbb33800 20 add_watcher() i=5 2024-05-15T14:37:36.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.079+0000 7f36dbb33800 20 add_watcher() i=6 2024-05-15T14:37:36.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.080+0000 7f36dbb33800 20 add_watcher() i=7 2024-05-15T14:37:36.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.080+0000 7f36dbb33800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:36.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.082+0000 7f358dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.083+0000 7f36dbb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.083+0000 7f36dbb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.083+0000 7f36dbb33800 5 note: GC not initialized 2024-05-15T14:37:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.083+0000 7f358cfe1640 20 reqs_thread_entry: start 2024-05-15T14:37:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.083+0000 7f36dbb33800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.083+0000 7f36dbb33800 20 Filter name: none 2024-05-15T14:37:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.083+0000 7f35067fc640 20 reqs_thread_entry: start 2024-05-15T14:37:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.084+0000 7f36dbb33800 20 rados->read ofs=0 len=0 2024-05-15T14:37:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.084+0000 7f36dbb33800 20 rados_obj.operate() r=0 bl.length=225 2024-05-15T14:37:36.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.086+0000 7f358dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:36.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.088+0000 7f36dbb33800 20 remove_watcher() i=0 2024-05-15T14:37:36.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.088+0000 7f36dbb33800 2 removed watcher, disabling cache 2024-05-15T14:37:36.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.089+0000 7f36dbb33800 20 remove_watcher() i=1 2024-05-15T14:37:36.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.090+0000 7f36dbb33800 20 remove_watcher() i=2 2024-05-15T14:37:36.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.091+0000 7f36dbb33800 20 remove_watcher() i=3 2024-05-15T14:37:36.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.093+0000 7f36dbb33800 20 remove_watcher() i=4 2024-05-15T14:37:36.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.094+0000 7f36dbb33800 20 remove_watcher() i=5 2024-05-15T14:37:36.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.095+0000 7f36dbb33800 20 remove_watcher() i=6 2024-05-15T14:37:36.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:36.096+0000 7f36dbb33800 20 remove_watcher() i=7 2024-05-15T14:37:41.301 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:test pushing persistent notification via http for account user ... ignoring --setuser ceph since I am not root 2024-05-15T14:37:41.351 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:41.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.394+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.396+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.396+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.397+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.397+0000 7f336d862800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.397+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.397+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.397+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.398+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.398+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.398+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.398+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.398+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.398+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.399+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.399+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.400+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.400+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.400+0000 7f336d862800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 zone MyZone found 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 started sync module instance, tier type = 2024-05-15T14:37:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.401+0000 7f336d862800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.412+0000 7f336d862800 20 add_watcher() i=0 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.412+0000 7f336d862800 20 add_watcher() i=1 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.412+0000 7f336d862800 20 add_watcher() i=2 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.412+0000 7f336d862800 20 add_watcher() i=3 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.412+0000 7f336d862800 20 add_watcher() i=4 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.412+0000 7f336d862800 20 add_watcher() i=5 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.412+0000 7f336d862800 20 add_watcher() i=6 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.413+0000 7f336d862800 20 add_watcher() i=7 2024-05-15T14:37:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.413+0000 7f336d862800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.415+0000 7f3221fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.415+0000 7f336d862800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.415+0000 7f336d862800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.415+0000 7f336d862800 5 note: GC not initialized 2024-05-15T14:37:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.415+0000 7f3220fe1640 20 reqs_thread_entry: start 2024-05-15T14:37:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f336d862800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f336d862800 20 Filter name: none 2024-05-15T14:37:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f319a7fc640 20 reqs_thread_entry: start 2024-05-15T14:37:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f336d862800 10 cache get: name=MyZone.rgw.meta+accounts+name.$testacct : miss 2024-05-15T14:37:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f336d862800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f336d862800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f336d862800 10 cache put: name=MyZone.rgw.meta+accounts+name.$testacct info.flags=0x0 2024-05-15T14:37:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f336d862800 10 adding MyZone.rgw.meta+accounts+name.$testacct to cache LRU end 2024-05-15T14:37:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.416+0000 7f336d862800 20 failed to read name.$testacct with: (2) No such file or directory 2024-05-15T14:37:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.418+0000 7f336d862800 10 cache put: name=MyZone.rgw.meta+accounts+account.RGW77777777777777777 info.flags=0x17 2024-05-15T14:37:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.418+0000 7f336d862800 10 adding MyZone.rgw.meta+accounts+account.RGW77777777777777777 to cache LRU end 2024-05-15T14:37:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.418+0000 7f336d862800 10 distributing notification oid=MyZone.rgw.control:notify.1 cni=[op: 0, obj: MyZone.rgw.meta:accounts:account.RGW77777777777777777, ofs0, ns] 2024-05-15T14:37:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.418+0000 7f324effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724546 cookie 93830883484064 notifier 5808 bl.length()=333 2024-05-15T14:37:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.418+0000 7f324effd640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+accounts+account.RGW77777777777777777 info.flags=0x17 2024-05-15T14:37:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.418+0000 7f324effd640 10 rgw watcher librados: moving MyZone.rgw.meta+accounts+account.RGW77777777777777777 to cache LRU end 2024-05-15T14:37:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.420+0000 7f336d862800 10 cache put: name=MyZone.rgw.meta+accounts+name.$testacct info.flags=0x17 2024-05-15T14:37:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.420+0000 7f336d862800 10 moving MyZone.rgw.meta+accounts+name.$testacct to cache LRU end 2024-05-15T14:37:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.420+0000 7f336d862800 10 distributing notification oid=MyZone.rgw.control:notify.4 cni=[op: 0, obj: MyZone.rgw.meta:accounts:name.$testacct, ofs0, ns] 2024-05-15T14:37:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.420+0000 7f324e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724585 cookie 93830883508000 notifier 5808 bl.length()=209 2024-05-15T14:37:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.420+0000 7f324e7fc640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+accounts+name.$testacct info.flags=0x17 2024-05-15T14:37:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.420+0000 7f324e7fc640 10 rgw watcher librados: moving MyZone.rgw.meta+accounts+name.$testacct to cache LRU end 2024-05-15T14:37:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.422+0000 7f3221fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:41.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.424+0000 7f336d862800 20 remove_watcher() i=0 2024-05-15T14:37:41.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.424+0000 7f336d862800 2 removed watcher, disabling cache 2024-05-15T14:37:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.425+0000 7f336d862800 20 remove_watcher() i=1 2024-05-15T14:37:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.426+0000 7f336d862800 20 remove_watcher() i=2 2024-05-15T14:37:41.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.427+0000 7f336d862800 20 remove_watcher() i=3 2024-05-15T14:37:41.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.428+0000 7f336d862800 20 remove_watcher() i=4 2024-05-15T14:37:41.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.430+0000 7f336d862800 20 remove_watcher() i=5 2024-05-15T14:37:41.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.430+0000 7f336d862800 20 remove_watcher() i=6 2024-05-15T14:37:41.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.431+0000 7f336d862800 20 remove_watcher() i=7 2024-05-15T14:37:41.496 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:41.497 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:41.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.536+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.537+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:41.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.537+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.538+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.538+0000 7fa95c3a2800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.538+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.538+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:41.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.538+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.539+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.539+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.539+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.539+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.539+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.539+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.540+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:41.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.540+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.541+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:41.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.541+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 zone MyZone found 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:41.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 started sync module instance, tier type = 2024-05-15T14:37:41.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.542+0000 7fa95c3a2800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:41.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.553+0000 7fa95c3a2800 20 add_watcher() i=0 2024-05-15T14:37:41.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.553+0000 7fa95c3a2800 20 add_watcher() i=1 2024-05-15T14:37:41.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.553+0000 7fa95c3a2800 20 add_watcher() i=2 2024-05-15T14:37:41.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.553+0000 7fa95c3a2800 20 add_watcher() i=3 2024-05-15T14:37:41.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.553+0000 7fa95c3a2800 20 add_watcher() i=4 2024-05-15T14:37:41.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.553+0000 7fa95c3a2800 20 add_watcher() i=5 2024-05-15T14:37:41.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.553+0000 7fa95c3a2800 20 add_watcher() i=6 2024-05-15T14:37:41.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.554+0000 7fa95c3a2800 20 add_watcher() i=7 2024-05-15T14:37:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.554+0000 7fa95c3a2800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:41.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.556+0000 7fa80b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:41.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.556+0000 7fa95c3a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:41.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.556+0000 7fa95c3a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:41.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.556+0000 7fa95c3a2800 5 note: GC not initialized 2024-05-15T14:37:41.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.556+0000 7fa80a7fc640 20 reqs_thread_entry: start 2024-05-15T14:37:41.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.556+0000 7fa95c3a2800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:41.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.556+0000 7fa95c3a2800 20 Filter name: none 2024-05-15T14:37:41.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.557+0000 7fa77bfff640 20 reqs_thread_entry: start 2024-05-15T14:37:41.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.557+0000 7fa95c3a2800 10 cache get: name=MyZone.rgw.meta+users.uid+supermantest : miss 2024-05-15T14:37:41.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.557+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.557+0000 7fa95c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:41.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.557+0000 7fa95c3a2800 10 cache put: name=MyZone.rgw.meta+users.uid+supermantest info.flags=0x0 2024-05-15T14:37:41.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.557+0000 7fa95c3a2800 10 adding MyZone.rgw.meta+users.uid+supermantest to cache LRU end 2024-05-15T14:37:41.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.557+0000 7fa95c3a2800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783861.4446368 : miss 2024-05-15T14:37:41.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.557+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783861.4446368 info.flags=0x0 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 10 adding MyZone.rgw.meta+users.keys+1715783861.4446368 to cache LRU end 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 10 cache get: name=MyZone.rgw.meta+accounts+account.RGW77777777777777777 : miss 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 20 rados->read ofs=0 len=0 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 20 rados_obj.operate() r=0 bl.length=134 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 10 cache put: name=MyZone.rgw.meta+accounts+account.RGW77777777777777777 info.flags=0x17 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 10 adding MyZone.rgw.meta+accounts+account.RGW77777777777777777 to cache LRU end 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783861.4446368 : hit (negative entry) 2024-05-15T14:37:41.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.558+0000 7fa95c3a2800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783861.4446368 : hit (negative entry) 2024-05-15T14:37:41.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.560+0000 7fa95c3a2800 10 cache put: name=MyZone.rgw.meta+users.uid+supermantest info.flags=0x17 2024-05-15T14:37:41.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.560+0000 7fa95c3a2800 10 moving MyZone.rgw.meta+users.uid+supermantest to cache LRU end 2024-05-15T14:37:41.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.560+0000 7fa95c3a2800 10 distributing notification oid=MyZone.rgw.control:notify.1 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:supermantest, ofs0, ns] 2024-05-15T14:37:41.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.560+0000 7fa83d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724547 cookie 93995221982480 notifier 5642 bl.length()=557 2024-05-15T14:37:41.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.560+0000 7fa83d7fa640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+supermantest info.flags=0x17 2024-05-15T14:37:41.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.560+0000 7fa83d7fa640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+supermantest to cache LRU end 2024-05-15T14:37:41.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.562+0000 7fa95c3a2800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783861.4446368 info.flags=0x7 2024-05-15T14:37:41.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.562+0000 7fa95c3a2800 10 moving MyZone.rgw.meta+users.keys+1715783861.4446368 to cache LRU end 2024-05-15T14:37:41.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.562+0000 7fa95c3a2800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715783861.4446368, ofs0, ns] 2024-05-15T14:37:41.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.563+0000 7fa83d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724586 cookie 93995221962336 notifier 5642 bl.length()=183 2024-05-15T14:37:41.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.563+0000 7fa83d7fa640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715783861.4446368 info.flags=0x7 2024-05-15T14:37:41.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.563+0000 7fa83d7fa640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715783861.4446368 to cache LRU end 2024-05-15T14:37:41.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.565+0000 7fa95c3a2800 20 linked user supermantest to account RGW77777777777777777 2024-05-15T14:37:41.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.565+0000 7fa80b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:41.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.568+0000 7fa95c3a2800 20 remove_watcher() i=0 2024-05-15T14:37:41.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.568+0000 7fa95c3a2800 2 removed watcher, disabling cache 2024-05-15T14:37:41.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.569+0000 7fa95c3a2800 20 remove_watcher() i=1 2024-05-15T14:37:41.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.570+0000 7fa95c3a2800 20 remove_watcher() i=2 2024-05-15T14:37:41.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.571+0000 7fa95c3a2800 20 remove_watcher() i=3 2024-05-15T14:37:41.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.572+0000 7fa95c3a2800 20 remove_watcher() i=4 2024-05-15T14:37:41.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.573+0000 7fa95c3a2800 20 remove_watcher() i=5 2024-05-15T14:37:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.574+0000 7fa95c3a2800 20 remove_watcher() i=6 2024-05-15T14:37:41.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:41.575+0000 7fa95c3a2800 20 remove_watcher() i=7 2024-05-15T14:37:41.601 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.18 - - [15/May/2024 14:37:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:41.884 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:41] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.211 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.446 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.563 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.677 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.693 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.710 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.823 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.824 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:42.942 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:42] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.092 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.111 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.224 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.239 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.364 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.379 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.385 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.403 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.414 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.418 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.430 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.542 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.556 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.561 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.564 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.569 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.578 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.586 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.598 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.717 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.719 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.721 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.726 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.728 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.730 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:43.738 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:43] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.066 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:44.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.106+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.108+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:44.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.108+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.109+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.109+0000 7fb222016800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.109+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.109+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:44.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.109+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.110+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.110+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.110+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.110+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.110+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.110+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.111+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:44.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.111+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.111+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:44.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.111+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 20 zone MyZone found 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.112+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.113+0000 7fb222016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.113+0000 7fb222016800 20 started sync module instance, tier type = 2024-05-15T14:37:44.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.113+0000 7fb222016800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:44.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.123+0000 7fb222016800 20 add_watcher() i=0 2024-05-15T14:37:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.123+0000 7fb222016800 20 add_watcher() i=1 2024-05-15T14:37:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.123+0000 7fb222016800 20 add_watcher() i=2 2024-05-15T14:37:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.123+0000 7fb222016800 20 add_watcher() i=3 2024-05-15T14:37:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.123+0000 7fb222016800 20 add_watcher() i=4 2024-05-15T14:37:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.123+0000 7fb222016800 20 add_watcher() i=5 2024-05-15T14:37:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.123+0000 7fb222016800 20 add_watcher() i=6 2024-05-15T14:37:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.124+0000 7fb222016800 20 add_watcher() i=7 2024-05-15T14:37:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.124+0000 7fb222016800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:44.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.125+0000 7fb0d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.126+0000 7fb222016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.126+0000 7fb222016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.126+0000 7fb222016800 5 note: GC not initialized 2024-05-15T14:37:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.126+0000 7fb0d27e4640 20 reqs_thread_entry: start 2024-05-15T14:37:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.126+0000 7fb222016800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.126+0000 7fb222016800 20 Filter name: none 2024-05-15T14:37:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.126+0000 7fb043fff640 20 reqs_thread_entry: start 2024-05-15T14:37:44.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.127+0000 7fb222016800 20 rados->read ofs=0 len=0 2024-05-15T14:37:44.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.127+0000 7fb222016800 20 rados_obj.operate() r=0 bl.length=265 2024-05-15T14:37:44.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.128+0000 7fb0d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.130+0000 7fb222016800 20 remove_watcher() i=0 2024-05-15T14:37:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.130+0000 7fb222016800 2 removed watcher, disabling cache 2024-05-15T14:37:44.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.131+0000 7fb222016800 20 remove_watcher() i=1 2024-05-15T14:37:44.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.132+0000 7fb222016800 20 remove_watcher() i=2 2024-05-15T14:37:44.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.133+0000 7fb222016800 20 remove_watcher() i=3 2024-05-15T14:37:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.134+0000 7fb222016800 20 remove_watcher() i=4 2024-05-15T14:37:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.135+0000 7fb222016800 20 remove_watcher() i=5 2024-05-15T14:37:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.136+0000 7fb222016800 20 remove_watcher() i=6 2024-05-15T14:37:44.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:44.137+0000 7fb222016800 20 remove_watcher() i=7 2024-05-15T14:37:44.735 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.736 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.741 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.741 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.742 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.742 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.743 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.744 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.744 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.745 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.745 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.746 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.748 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.748 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.749 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.750 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.750 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.750 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.751 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.751 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.752 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.752 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.752 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.753 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.754 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.754 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.755 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:44.755 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:44] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.759 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.760 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.760 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.760 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.761 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.762 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.769 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.769 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.780 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.780 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.783 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.783 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.785 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:45.786 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:45] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.783 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.784 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.784 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.785 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.785 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.786 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.787 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.847 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.853 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.854 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.854 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.854 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.855 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.856 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.856 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.858 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.858 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.859 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.859 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.860 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:46.860 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:47.871 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:47.872 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:47.873 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:47.873 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:47.874 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.078 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.086 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.086 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.087 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.087 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.089 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:48.089 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:48] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:49.087 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:49] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:49.088 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:49] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:49.151 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:49] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:49.205 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:49.206 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:49.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.248+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.250+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:49.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.250+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.251+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:49.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.251+0000 7fac2a525800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:49.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.251+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.251+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:49.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.251+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.252+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.252+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.252+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.252+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.253+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.253+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.253+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.253+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.254+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:49.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.254+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.254+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:49.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.254+0000 7fac2a525800 20 zone MyZone found 2024-05-15T14:37:49.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.254+0000 7fac2a525800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:49.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:49.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 20 started sync module instance, tier type = 2024-05-15T14:37:49.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.255+0000 7fac2a525800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:49.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.266+0000 7fac2a525800 20 add_watcher() i=0 2024-05-15T14:37:49.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.266+0000 7fac2a525800 20 add_watcher() i=1 2024-05-15T14:37:49.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.266+0000 7fac2a525800 20 add_watcher() i=2 2024-05-15T14:37:49.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.266+0000 7fac2a525800 20 add_watcher() i=3 2024-05-15T14:37:49.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.266+0000 7fac2a525800 20 add_watcher() i=4 2024-05-15T14:37:49.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.266+0000 7fac2a525800 20 add_watcher() i=5 2024-05-15T14:37:49.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.266+0000 7fac2a525800 20 add_watcher() i=6 2024-05-15T14:37:49.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.267+0000 7fac2a525800 20 add_watcher() i=7 2024-05-15T14:37:49.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.267+0000 7fac2a525800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:49.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.269+0000 7faadcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:49.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.270+0000 7fac2a525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:49.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.270+0000 7fac2a525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:49.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.270+0000 7fac2a525800 5 note: GC not initialized 2024-05-15T14:37:49.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.270+0000 7faa577fe640 20 reqs_thread_entry: start 2024-05-15T14:37:49.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.270+0000 7fac2a525800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:49.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.270+0000 7fac2a525800 20 Filter name: none 2024-05-15T14:37:49.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.270+0000 7faa557fa640 20 reqs_thread_entry: start 2024-05-15T14:37:49.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.271+0000 7fac2a525800 20 rados->read ofs=0 len=0 2024-05-15T14:37:49.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.271+0000 7fac2a525800 20 rados_obj.operate() r=0 bl.length=265 2024-05-15T14:37:49.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.273+0000 7faadcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:49.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.275+0000 7fac2a525800 20 remove_watcher() i=0 2024-05-15T14:37:49.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.275+0000 7fac2a525800 2 removed watcher, disabling cache 2024-05-15T14:37:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.276+0000 7fac2a525800 20 remove_watcher() i=1 2024-05-15T14:37:49.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.277+0000 7fac2a525800 20 remove_watcher() i=2 2024-05-15T14:37:49.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.278+0000 7fac2a525800 20 remove_watcher() i=3 2024-05-15T14:37:49.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.280+0000 7fac2a525800 20 remove_watcher() i=4 2024-05-15T14:37:49.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.280+0000 7fac2a525800 20 remove_watcher() i=5 2024-05-15T14:37:49.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.282+0000 7fac2a525800 20 remove_watcher() i=6 2024-05-15T14:37:49.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:49.283+0000 7fac2a525800 20 remove_watcher() i=7 2024-05-15T14:37:54.438 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.443 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.453 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.454 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.454 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.457 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.459 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.465 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.465 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:54] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:54.581 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:54.581 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.618+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.620+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:54.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.620+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.620+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:54.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.620+0000 7f8ce9440800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:54.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.620+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.620+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:54.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.620+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.621+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.621+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.621+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.621+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.622+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.622+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.622+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.622+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 20 zone MyZone found 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.623+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.624+0000 7f8ce9440800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.624+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.624+0000 7f8ce9440800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.624+0000 7f8ce9440800 20 started sync module instance, tier type = 2024-05-15T14:37:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.624+0000 7f8ce9440800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:54.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.634+0000 7f8ce9440800 20 add_watcher() i=0 2024-05-15T14:37:54.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.634+0000 7f8ce9440800 20 add_watcher() i=1 2024-05-15T14:37:54.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.634+0000 7f8ce9440800 20 add_watcher() i=2 2024-05-15T14:37:54.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.634+0000 7f8ce9440800 20 add_watcher() i=3 2024-05-15T14:37:54.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.634+0000 7f8ce9440800 20 add_watcher() i=4 2024-05-15T14:37:54.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.634+0000 7f8ce9440800 20 add_watcher() i=5 2024-05-15T14:37:54.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.634+0000 7f8ce9440800 20 add_watcher() i=6 2024-05-15T14:37:54.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.635+0000 7f8ce9440800 20 add_watcher() i=7 2024-05-15T14:37:54.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.635+0000 7f8ce9440800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:54.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.637+0000 7f8b9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.637+0000 7f8ce9440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.637+0000 7f8ce9440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.637+0000 7f8ce9440800 5 note: GC not initialized 2024-05-15T14:37:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.637+0000 7f8b99fdb640 20 reqs_thread_entry: start 2024-05-15T14:37:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.638+0000 7f8ce9440800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.638+0000 7f8ce9440800 20 Filter name: none 2024-05-15T14:37:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.638+0000 7f8b0b7fe640 20 reqs_thread_entry: start 2024-05-15T14:37:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.638+0000 7f8ce9440800 20 rados->read ofs=0 len=0 2024-05-15T14:37:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.638+0000 7f8ce9440800 20 rados_obj.operate() r=0 bl.length=265 2024-05-15T14:37:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.640+0000 7f8b9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:54.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.642+0000 7f8ce9440800 20 remove_watcher() i=0 2024-05-15T14:37:54.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.642+0000 7f8ce9440800 2 removed watcher, disabling cache 2024-05-15T14:37:54.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.643+0000 7f8ce9440800 20 remove_watcher() i=1 2024-05-15T14:37:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.644+0000 7f8ce9440800 20 remove_watcher() i=2 2024-05-15T14:37:54.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.645+0000 7f8ce9440800 20 remove_watcher() i=3 2024-05-15T14:37:54.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.646+0000 7f8ce9440800 20 remove_watcher() i=4 2024-05-15T14:37:54.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.647+0000 7f8ce9440800 20 remove_watcher() i=5 2024-05-15T14:37:54.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.648+0000 7f8ce9440800 20 remove_watcher() i=6 2024-05-15T14:37:54.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:54.649+0000 7f8ce9440800 20 remove_watcher() i=7 2024-05-15T14:37:55.487 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.488 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.488 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.489 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.489 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.490 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.491 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.703 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.703 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.708 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.709 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.709 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.710 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.710 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.711 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.711 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.712 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.713 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.713 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.714 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.714 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.714 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.715 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.716 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.716 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.717 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.717 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.718 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.718 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.719 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.719 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.720 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.720 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.721 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.722 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.722 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.722 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.723 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.723 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.724 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.724 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.725 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.725 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.726 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.727 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.729 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.729 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.730 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.730 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.731 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.731 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.733 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.733 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.734 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.734 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.736 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.736 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.737 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:55.738 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:55] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.767 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.768 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.768 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.768 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.769 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.769 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.770 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.770 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.778 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.779 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.779 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.780 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.780 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.781 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.782 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.782 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.783 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.783 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.784 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.784 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.785 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.785 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.786 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.787 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.787 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.788 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.788 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.788 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.789 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.790 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.790 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.791 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.791 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.791 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.793 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.793 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.794 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.794 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.795 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.796 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.796 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.796 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.797 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.797 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.798 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.798 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.799 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.799 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.800 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.801 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.801 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.801 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.802 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.802 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.803 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.803 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.804 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.804 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.805 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.805 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:56.805 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:56] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.791 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.791 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.856 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.857 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.857 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.858 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.863 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.863 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.864 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.864 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.865 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.865 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.866 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.867 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.867 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.868 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.868 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.869 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.869 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.872 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.872 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.880 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.881 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.881 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.881 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.882 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.882 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:57] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.879 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.880 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.880 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.880 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.882 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.943 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.943 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.944 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.944 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:58.945 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:58] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.087 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.096 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.096 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.097 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.097 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.098 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.098 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.102 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.102 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.103 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.103 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.104 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.104 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.104 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.105 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.106 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.106 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.107 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.107 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.108 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:37:59] "POST / HTTP/1.1" 200 - 2024-05-15T14:37:59.724 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:37:59.724 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:37:59.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.766+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.768+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.768+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.769+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.769+0000 7f6ae9728800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:37:59.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.769+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.769+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.769+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.770+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:37:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.770+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.770+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:37:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.771+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.771+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:59.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.771+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.771+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:37:59.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.772+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.772+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:37:59.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.772+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:37:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 20 zone MyZone found 2024-05-15T14:37:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:37:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:37:59.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 20 period zonegroup name MyZoneGroup 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.773+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.774+0000 7f6ae9728800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.774+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.774+0000 7f6ae9728800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.774+0000 7f6ae9728800 20 started sync module instance, tier type = 2024-05-15T14:37:59.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.774+0000 7f6ae9728800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:37:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.785+0000 7f6ae9728800 20 add_watcher() i=0 2024-05-15T14:37:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.785+0000 7f6ae9728800 20 add_watcher() i=1 2024-05-15T14:37:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.785+0000 7f6ae9728800 20 add_watcher() i=2 2024-05-15T14:37:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.785+0000 7f6ae9728800 20 add_watcher() i=3 2024-05-15T14:37:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.785+0000 7f6ae9728800 20 add_watcher() i=4 2024-05-15T14:37:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.785+0000 7f6ae9728800 20 add_watcher() i=5 2024-05-15T14:37:59.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.785+0000 7f6ae9728800 20 add_watcher() i=6 2024-05-15T14:37:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.786+0000 7f6ae9728800 20 add_watcher() i=7 2024-05-15T14:37:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.786+0000 7f6ae9728800 2 all 8 watchers are set, enabling cache 2024-05-15T14:37:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.788+0000 7f699b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.788+0000 7f6ae9728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:37:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.788+0000 7f6ae9728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:37:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.788+0000 7f6ae9728800 5 note: GC not initialized 2024-05-15T14:37:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.788+0000 7f699a7e4640 20 reqs_thread_entry: start 2024-05-15T14:37:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.789+0000 7f6ae9728800 20 init_complete bucket index max shards: 11 2024-05-15T14:37:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.789+0000 7f6ae9728800 20 Filter name: none 2024-05-15T14:37:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.789+0000 7f690bfff640 20 reqs_thread_entry: start 2024-05-15T14:37:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.789+0000 7f6ae9728800 20 rados->read ofs=0 len=0 2024-05-15T14:37:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.790+0000 7f6ae9728800 20 rados_obj.operate() r=0 bl.length=265 2024-05-15T14:37:59.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.792+0000 7f699b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:37:59.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.794+0000 7f6ae9728800 20 remove_watcher() i=0 2024-05-15T14:37:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.794+0000 7f6ae9728800 2 removed watcher, disabling cache 2024-05-15T14:37:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.795+0000 7f6ae9728800 20 remove_watcher() i=1 2024-05-15T14:37:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.796+0000 7f6ae9728800 20 remove_watcher() i=2 2024-05-15T14:37:59.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.798+0000 7f6ae9728800 20 remove_watcher() i=3 2024-05-15T14:37:59.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.799+0000 7f6ae9728800 20 remove_watcher() i=4 2024-05-15T14:37:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.800+0000 7f6ae9728800 20 remove_watcher() i=5 2024-05-15T14:37:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.801+0000 7f6ae9728800 20 remove_watcher() i=6 2024-05-15T14:37:59.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:37:59.802+0000 7f6ae9728800 20 remove_watcher() i=7 2024-05-15T14:38:00.160 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.160 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.160 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.161 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.161 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.162 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.167 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.167 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.167 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.168 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.168 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.169 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.169 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.169 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.170 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.170 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.171 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.171 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.172 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.173 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.174 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.175 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.176 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.176 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.177 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.177 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:00.178 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:00] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:01.183 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:01] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:01.184 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:01] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:01.184 INFO:teuthology.orchestra.run.smithi018.stderr:172.21.15.70 - - [15/May/2024 14:38:01] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:04.873 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:04.874 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:04.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.918+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.920+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:04.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.920+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.921+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:04.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.921+0000 7fe1bb533800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:04.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.921+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.921+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:04.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.921+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.922+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:04.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.922+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.922+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:04.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.922+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.922+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:04.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.922+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.923+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:04.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.923+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.924+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:04.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.924+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:04.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 zone MyZone found 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:04.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 started sync module instance, tier type = 2024-05-15T14:38:04.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.925+0000 7fe1bb533800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:04.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.937+0000 7fe1bb533800 20 add_watcher() i=0 2024-05-15T14:38:04.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.937+0000 7fe1bb533800 20 add_watcher() i=1 2024-05-15T14:38:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.937+0000 7fe1bb533800 20 add_watcher() i=2 2024-05-15T14:38:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.937+0000 7fe1bb533800 20 add_watcher() i=3 2024-05-15T14:38:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.937+0000 7fe1bb533800 20 add_watcher() i=4 2024-05-15T14:38:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.937+0000 7fe1bb533800 20 add_watcher() i=5 2024-05-15T14:38:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.937+0000 7fe1bb533800 20 add_watcher() i=6 2024-05-15T14:38:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.938+0000 7fe1bb533800 20 add_watcher() i=7 2024-05-15T14:38:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.938+0000 7fe1bb533800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.940+0000 7fe06dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.940+0000 7fe1bb533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.940+0000 7fe1bb533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.940+0000 7fe1bb533800 5 note: GC not initialized 2024-05-15T14:38:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.940+0000 7fe06cfe1640 20 reqs_thread_entry: start 2024-05-15T14:38:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.940+0000 7fe1bb533800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.940+0000 7fe1bb533800 20 Filter name: none 2024-05-15T14:38:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.941+0000 7fdfe67fc640 20 reqs_thread_entry: start 2024-05-15T14:38:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.941+0000 7fe1bb533800 20 rados->read ofs=0 len=0 2024-05-15T14:38:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.941+0000 7fe1bb533800 20 rados_obj.operate() r=0 bl.length=265 2024-05-15T14:38:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.943+0000 7fe06dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.945+0000 7fe1bb533800 20 remove_watcher() i=0 2024-05-15T14:38:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.945+0000 7fe1bb533800 2 removed watcher, disabling cache 2024-05-15T14:38:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.947+0000 7fe1bb533800 20 remove_watcher() i=1 2024-05-15T14:38:04.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.948+0000 7fe1bb533800 20 remove_watcher() i=2 2024-05-15T14:38:04.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.949+0000 7fe1bb533800 20 remove_watcher() i=3 2024-05-15T14:38:04.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.950+0000 7fe1bb533800 20 remove_watcher() i=4 2024-05-15T14:38:04.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.951+0000 7fe1bb533800 20 remove_watcher() i=5 2024-05-15T14:38:04.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.952+0000 7fe1bb533800 20 remove_watcher() i=6 2024-05-15T14:38:04.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:04.953+0000 7fe1bb533800 20 remove_watcher() i=7 2024-05-15T14:38:10.248 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:10.249 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.292+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.293+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.293+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.294+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.294+0000 7f1e4ff2d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.294+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.294+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.294+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.295+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:10.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.295+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.295+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:10.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.295+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.296+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.296+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.296+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.296+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.297+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.297+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:10.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 20 zone MyZone found 2024-05-15T14:38:10.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:10.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:10.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.298+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.299+0000 7f1e4ff2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.299+0000 7f1e4ff2d800 20 started sync module instance, tier type = 2024-05-15T14:38:10.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.299+0000 7f1e4ff2d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:10.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.310+0000 7f1e4ff2d800 20 add_watcher() i=0 2024-05-15T14:38:10.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.310+0000 7f1e4ff2d800 20 add_watcher() i=1 2024-05-15T14:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.310+0000 7f1e4ff2d800 20 add_watcher() i=2 2024-05-15T14:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.310+0000 7f1e4ff2d800 20 add_watcher() i=3 2024-05-15T14:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.310+0000 7f1e4ff2d800 20 add_watcher() i=4 2024-05-15T14:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.310+0000 7f1e4ff2d800 20 add_watcher() i=5 2024-05-15T14:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.310+0000 7f1e4ff2d800 20 add_watcher() i=6 2024-05-15T14:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.311+0000 7f1e4ff2d800 20 add_watcher() i=7 2024-05-15T14:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.311+0000 7f1e4ff2d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:10.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.312+0000 7f1d01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:10.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.313+0000 7f1e4ff2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:10.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.313+0000 7f1e4ff2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:10.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.349+0000 7f1d00fe1640 20 reqs_thread_entry: start 2024-05-15T14:38:10.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.350+0000 7f1e4ff2d800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:10.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.350+0000 7f1e4ff2d800 20 Filter name: none 2024-05-15T14:38:10.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.350+0000 7f1c7a7fc640 20 reqs_thread_entry: start 2024-05-15T14:38:10.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.350+0000 7f1e4ff2d800 10 cache get: name=MyZone.rgw.meta+users.uid+supermantest : miss 2024-05-15T14:38:10.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.350+0000 7f1e4ff2d800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.351+0000 7f1e4ff2d800 20 rados_obj.operate() r=0 bl.length=373 2024-05-15T14:38:10.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.351+0000 7f1e4ff2d800 10 cache put: name=MyZone.rgw.meta+users.uid+supermantest info.flags=0x13 2024-05-15T14:38:10.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.351+0000 7f1e4ff2d800 10 adding MyZone.rgw.meta+users.uid+supermantest to cache LRU end 2024-05-15T14:38:10.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.351+0000 7f1e4ff2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:38:10.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.351+0000 7f1e4ff2d800 10 removing key index: 1715783861.4446368 2024-05-15T14:38:10.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.352+0000 7f1e4ff2d800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 1, obj: MyZone.rgw.meta:users.keys:1715783861.4446368, ofs0, ns] 2024-05-15T14:38:10.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.353+0000 7f1d2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724589 cookie 93912401294592 notifier 5943 bl.length()=167 2024-05-15T14:38:10.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.353+0000 7f1e4ff2d800 10 removing email index: 2024-05-15T14:38:10.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.353+0000 7f1e4ff2d800 10 removing user index: supermantest 2024-05-15T14:38:10.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.355+0000 7f1e4ff2d800 10 removing MyZone.rgw.meta+users.uid+supermantest from cache 2024-05-15T14:38:10.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.355+0000 7f1e4ff2d800 10 distributing notification oid=MyZone.rgw.control:notify.1 cni=[op: 1, obj: MyZone.rgw.meta:users.uid:supermantest, ofs0, ns] 2024-05-15T14:38:10.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.355+0000 7f1d2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724548 cookie 93912401295648 notifier 5943 bl.length()=160 2024-05-15T14:38:10.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.356+0000 7f1d01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:10.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.359+0000 7f1e4ff2d800 20 remove_watcher() i=0 2024-05-15T14:38:10.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.359+0000 7f1e4ff2d800 2 removed watcher, disabling cache 2024-05-15T14:38:10.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.360+0000 7f1e4ff2d800 20 remove_watcher() i=1 2024-05-15T14:38:10.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.361+0000 7f1e4ff2d800 20 remove_watcher() i=2 2024-05-15T14:38:10.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.363+0000 7f1e4ff2d800 20 remove_watcher() i=3 2024-05-15T14:38:10.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.364+0000 7f1e4ff2d800 20 remove_watcher() i=4 2024-05-15T14:38:10.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.365+0000 7f1e4ff2d800 20 remove_watcher() i=5 2024-05-15T14:38:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.366+0000 7f1e4ff2d800 20 remove_watcher() i=6 2024-05-15T14:38:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.367+0000 7f1e4ff2d800 20 remove_watcher() i=7 2024-05-15T14:38:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:10.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.463+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.465+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.465+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.466+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.466+0000 7f48d5e11800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:10.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.466+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.466+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.466+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.466+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:10.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.466+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.467+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:10.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.467+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.467+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.467+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.467+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.467+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.468+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.468+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:10.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 20 zone MyZone found 2024-05-15T14:38:10.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:10.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:10.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:10.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:10.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:10.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:10.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.469+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.470+0000 7f48d5e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.470+0000 7f48d5e11800 20 started sync module instance, tier type = 2024-05-15T14:38:10.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.470+0000 7f48d5e11800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:10.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.480+0000 7f48d5e11800 20 add_watcher() i=0 2024-05-15T14:38:10.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.480+0000 7f48d5e11800 20 add_watcher() i=1 2024-05-15T14:38:10.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.480+0000 7f48d5e11800 20 add_watcher() i=2 2024-05-15T14:38:10.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.480+0000 7f48d5e11800 20 add_watcher() i=3 2024-05-15T14:38:10.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.480+0000 7f48d5e11800 20 add_watcher() i=4 2024-05-15T14:38:10.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.480+0000 7f48d5e11800 20 add_watcher() i=5 2024-05-15T14:38:10.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.480+0000 7f48d5e11800 20 add_watcher() i=6 2024-05-15T14:38:10.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.481+0000 7f48d5e11800 20 add_watcher() i=7 2024-05-15T14:38:10.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.481+0000 7f48d5e11800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:10.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.482+0000 7f47877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f48d5e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f48d5e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f48d5e11800 5 note: GC not initialized 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f47867e4640 20 reqs_thread_entry: start 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f48d5e11800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f48d5e11800 20 Filter name: none 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f46f7fff640 20 reqs_thread_entry: start 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f48d5e11800 10 cache get: name=MyZone.rgw.meta+accounts+account.RGW77777777777777777 : miss 2024-05-15T14:38:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.483+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 20 rados_obj.operate() r=0 bl.length=134 2024-05-15T14:38:10.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 10 cache put: name=MyZone.rgw.meta+accounts+account.RGW77777777777777777 info.flags=0x17 2024-05-15T14:38:10.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 10 adding MyZone.rgw.meta+accounts+account.RGW77777777777777777 to cache LRU end 2024-05-15T14:38:10.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:38:10.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 10 cache get: name=MyZone.rgw.meta+users.uid+supermantest : miss 2024-05-15T14:38:10.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 10 cache put: name=MyZone.rgw.meta+users.uid+supermantest info.flags=0x0 2024-05-15T14:38:10.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.484+0000 7f48d5e11800 10 adding MyZone.rgw.meta+users.uid+supermantest to cache LRU end 2024-05-15T14:38:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.496+0000 7f48d5e11800 10 removing MyZone.rgw.meta+accounts+account.RGW77777777777777777 from cache 2024-05-15T14:38:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.496+0000 7f48d5e11800 10 distributing notification oid=MyZone.rgw.control:notify.1 cni=[op: 1, obj: MyZone.rgw.meta:accounts:account.RGW77777777777777777, ofs0, ns] 2024-05-15T14:38:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.496+0000 7f47b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724549 cookie 94613945909040 notifier 5759 bl.length()=175 2024-05-15T14:38:10.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.497+0000 7f48d5e11800 10 distributing notification oid=MyZone.rgw.control:notify.4 cni=[op: 1, obj: MyZone.rgw.meta:accounts:name.$testacct, ofs0, ns] 2024-05-15T14:38:10.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.498+0000 7f47b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724590 cookie 94613945932000 notifier 5759 bl.length()=161 2024-05-15T14:38:10.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.499+0000 7f48d5e11800 10 distributing notification oid=MyZone.rgw.control:notify.7 cni=[op: 1, obj: MyZone.rgw.meta:accounts:users.RGW77777777777777777, ofs0, ns] 2024-05-15T14:38:10.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.500+0000 7f47b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724573 cookie 94613945938336 notifier 5759 bl.length()=173 2024-05-15T14:38:10.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.501+0000 7f47877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:10.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.504+0000 7f48d5e11800 20 remove_watcher() i=0 2024-05-15T14:38:10.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.504+0000 7f48d5e11800 2 removed watcher, disabling cache 2024-05-15T14:38:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.506+0000 7f48d5e11800 20 remove_watcher() i=1 2024-05-15T14:38:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.508+0000 7f48d5e11800 20 remove_watcher() i=2 2024-05-15T14:38:10.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.510+0000 7f48d5e11800 20 remove_watcher() i=3 2024-05-15T14:38:10.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.512+0000 7f48d5e11800 20 remove_watcher() i=4 2024-05-15T14:38:10.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.514+0000 7f48d5e11800 20 remove_watcher() i=5 2024-05-15T14:38:10.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.516+0000 7f48d5e11800 20 remove_watcher() i=6 2024-05-15T14:38:10.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.518+0000 7f48d5e11800 20 remove_watcher() i=7 2024-05-15T14:38:10.533 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:38:10.585 INFO:teuthology.orchestra.run.smithi018.stderr:test s3 topic set/get/delete permissions ... ignoring --setuser ceph since I am not root 2024-05-15T14:38:10.585 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:10.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.624+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.625+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.625+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.626+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.626+0000 7f97b4a87800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.626+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.626+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.626+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.627+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.627+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.627+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.627+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.628+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.628+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.628+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.628+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:10.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 20 zone MyZone found 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.629+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.630+0000 7f97b4a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.630+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.630+0000 7f97b4a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.630+0000 7f97b4a87800 20 started sync module instance, tier type = 2024-05-15T14:38:10.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.630+0000 7f97b4a87800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.640+0000 7f97b4a87800 20 add_watcher() i=0 2024-05-15T14:38:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.640+0000 7f97b4a87800 20 add_watcher() i=1 2024-05-15T14:38:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.640+0000 7f97b4a87800 20 add_watcher() i=2 2024-05-15T14:38:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.640+0000 7f97b4a87800 20 add_watcher() i=3 2024-05-15T14:38:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.640+0000 7f97b4a87800 20 add_watcher() i=4 2024-05-15T14:38:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.640+0000 7f97b4a87800 20 add_watcher() i=5 2024-05-15T14:38:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.640+0000 7f97b4a87800 20 add_watcher() i=6 2024-05-15T14:38:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.641+0000 7f97b4a87800 20 add_watcher() i=7 2024-05-15T14:38:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.641+0000 7f97b4a87800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:10.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.643+0000 7f9668fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.643+0000 7f97b4a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.643+0000 7f97b4a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.643+0000 7f97b4a87800 5 note: GC not initialized 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f95e37fe640 20 reqs_thread_entry: start 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 20 Filter name: none 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f95e17fa640 20 reqs_thread_entry: start 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 10 cache get: name=MyZone.rgw.meta+users.uid+superman1715783890.5353925 : miss 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 10 cache put: name=MyZone.rgw.meta+users.uid+superman1715783890.5353925 info.flags=0x0 2024-05-15T14:38:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 10 adding MyZone.rgw.meta+users.uid+superman1715783890.5353925 to cache LRU end 2024-05-15T14:38:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783890.5353844 : miss 2024-05-15T14:38:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.644+0000 7f97b4a87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.645+0000 7f97b4a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.645+0000 7f97b4a87800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783890.5353844 info.flags=0x0 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.645+0000 7f97b4a87800 10 adding MyZone.rgw.meta+users.keys+1715783890.5353844 to cache LRU end 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.645+0000 7f97b4a87800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783890.5353844 : hit (negative entry) 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.645+0000 7f97b4a87800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783890.5353844 : hit (negative entry) 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.646+0000 7f97b4a87800 10 cache put: name=MyZone.rgw.meta+users.uid+superman1715783890.5353925 info.flags=0x17 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.646+0000 7f97b4a87800 10 moving MyZone.rgw.meta+users.uid+superman1715783890.5353925 to cache LRU end 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.646+0000 7f97b4a87800 10 distributing notification oid=MyZone.rgw.control:notify.7 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:superman1715783890.5353925, ofs0, ns] 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.646+0000 7f9695ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724574 cookie 94441073092128 notifier 5777 bl.length()=579 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.646+0000 7f9695ffb640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+superman1715783890.5353925 info.flags=0x17 2024-05-15T14:38:10.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.646+0000 7f9695ffb640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+superman1715783890.5353925 to cache LRU end 2024-05-15T14:38:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.648+0000 7f97b4a87800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783890.5353844 info.flags=0x7 2024-05-15T14:38:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.648+0000 7f97b4a87800 10 moving MyZone.rgw.meta+users.keys+1715783890.5353844 to cache LRU end 2024-05-15T14:38:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.648+0000 7f97b4a87800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715783890.5353844, ofs0, ns] 2024-05-15T14:38:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.648+0000 7f96957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724591 cookie 94441073039504 notifier 5777 bl.length()=197 2024-05-15T14:38:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.648+0000 7f96957fa640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715783890.5353844 info.flags=0x7 2024-05-15T14:38:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.648+0000 7f96957fa640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715783890.5353844 to cache LRU end 2024-05-15T14:38:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.650+0000 7f9668fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.652+0000 7f97b4a87800 20 remove_watcher() i=0 2024-05-15T14:38:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.652+0000 7f97b4a87800 2 removed watcher, disabling cache 2024-05-15T14:38:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.653+0000 7f97b4a87800 20 remove_watcher() i=1 2024-05-15T14:38:10.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.654+0000 7f97b4a87800 20 remove_watcher() i=2 2024-05-15T14:38:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.655+0000 7f97b4a87800 20 remove_watcher() i=3 2024-05-15T14:38:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.656+0000 7f97b4a87800 20 remove_watcher() i=4 2024-05-15T14:38:10.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.657+0000 7f97b4a87800 20 remove_watcher() i=5 2024-05-15T14:38:10.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.658+0000 7f97b4a87800 20 remove_watcher() i=6 2024-05-15T14:38:10.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:10.659+0000 7f97b4a87800 20 remove_watcher() i=7 2024-05-15T14:38:10.936 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:38:10.988 INFO:teuthology.orchestra.run.smithi018.stderr:test s3 topic set/get/delete permissions ... ignoring --setuser ceph since I am not root 2024-05-15T14:38:10.988 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:11.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.027+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.029+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.029+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.030+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.030+0000 7fd905e06800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:11.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.030+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.030+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.030+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.031+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:11.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.031+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.031+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:11.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.031+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.032+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.032+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.032+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.032+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.033+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.033+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 20 zone MyZone found 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:11.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.034+0000 7fd905e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.035+0000 7fd905e06800 20 started sync module instance, tier type = 2024-05-15T14:38:11.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.035+0000 7fd905e06800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.044+0000 7fd905e06800 20 add_watcher() i=0 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.044+0000 7fd905e06800 20 add_watcher() i=1 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.044+0000 7fd905e06800 20 add_watcher() i=2 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.044+0000 7fd905e06800 20 add_watcher() i=3 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.044+0000 7fd905e06800 20 add_watcher() i=4 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.044+0000 7fd905e06800 20 add_watcher() i=5 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.044+0000 7fd905e06800 20 add_watcher() i=6 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.045+0000 7fd905e06800 20 add_watcher() i=7 2024-05-15T14:38:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.045+0000 7fd905e06800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:11.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.047+0000 7fd7b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.047+0000 7fd905e06800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:11.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.047+0000 7fd905e06800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:11.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.047+0000 7fd905e06800 5 note: GC not initialized 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.047+0000 7fd7b8fe1640 20 reqs_thread_entry: start 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.047+0000 7fd905e06800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.047+0000 7fd905e06800 20 Filter name: none 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd7327fc640 20 reqs_thread_entry: start 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 10 cache get: name=MyZone.rgw.meta+users.uid+superman1715783890.9371383 : miss 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 10 cache put: name=MyZone.rgw.meta+users.uid+superman1715783890.9371383 info.flags=0x0 2024-05-15T14:38:11.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 10 adding MyZone.rgw.meta+users.uid+superman1715783890.9371383 to cache LRU end 2024-05-15T14:38:11.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783890.9371297 : miss 2024-05-15T14:38:11.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783890.9371297 info.flags=0x0 2024-05-15T14:38:11.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 10 adding MyZone.rgw.meta+users.keys+1715783890.9371297 to cache LRU end 2024-05-15T14:38:11.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783890.9371297 : hit (negative entry) 2024-05-15T14:38:11.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.048+0000 7fd905e06800 10 cache get: name=MyZone.rgw.meta+users.keys+1715783890.9371297 : hit (negative entry) 2024-05-15T14:38:11.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.049+0000 7fd905e06800 10 cache put: name=MyZone.rgw.meta+users.uid+superman1715783890.9371383 info.flags=0x17 2024-05-15T14:38:11.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.049+0000 7fd905e06800 10 moving MyZone.rgw.meta+users.uid+superman1715783890.9371383 to cache LRU end 2024-05-15T14:38:11.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.049+0000 7fd905e06800 10 distributing notification oid=MyZone.rgw.control:notify.7 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:superman1715783890.9371383, ofs0, ns] 2024-05-15T14:38:11.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.050+0000 7fd7e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724579 cookie 94271202163872 notifier 5795 bl.length()=579 2024-05-15T14:38:11.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.050+0000 7fd7e2ffd640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+superman1715783890.9371383 info.flags=0x17 2024-05-15T14:38:11.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.050+0000 7fd7e2ffd640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+superman1715783890.9371383 to cache LRU end 2024-05-15T14:38:11.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.052+0000 7fd905e06800 10 cache put: name=MyZone.rgw.meta+users.keys+1715783890.9371297 info.flags=0x7 2024-05-15T14:38:11.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.052+0000 7fd905e06800 10 moving MyZone.rgw.meta+users.keys+1715783890.9371297 to cache LRU end 2024-05-15T14:38:11.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.052+0000 7fd905e06800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715783890.9371297, ofs0, ns] 2024-05-15T14:38:11.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.052+0000 7fd7e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724595 cookie 94271202112176 notifier 5795 bl.length()=197 2024-05-15T14:38:11.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.052+0000 7fd7e27fc640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715783890.9371297 info.flags=0x7 2024-05-15T14:38:11.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.052+0000 7fd7e27fc640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715783890.9371297 to cache LRU end 2024-05-15T14:38:11.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.053+0000 7fd7b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.055+0000 7fd905e06800 20 remove_watcher() i=0 2024-05-15T14:38:11.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.055+0000 7fd905e06800 2 removed watcher, disabling cache 2024-05-15T14:38:11.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.056+0000 7fd905e06800 20 remove_watcher() i=1 2024-05-15T14:38:11.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.057+0000 7fd905e06800 20 remove_watcher() i=2 2024-05-15T14:38:11.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.058+0000 7fd905e06800 20 remove_watcher() i=3 2024-05-15T14:38:11.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.059+0000 7fd905e06800 20 remove_watcher() i=4 2024-05-15T14:38:11.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.060+0000 7fd905e06800 20 remove_watcher() i=5 2024-05-15T14:38:11.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.061+0000 7fd905e06800 20 remove_watcher() i=6 2024-05-15T14:38:11.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.062+0000 7fd905e06800 20 remove_watcher() i=7 2024-05-15T14:38:11.241 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:38:11.283 INFO:teuthology.orchestra.run.smithi018.stderr:do a realm reload while we send notifications ... ignoring --setuser ceph since I am not root 2024-05-15T14:38:11.283 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:11.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.322+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.324+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.324+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.325+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.325+0000 7fb5e5fa2800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.325+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.325+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.325+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.326+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.326+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.326+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.326+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.326+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.326+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.327+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.327+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.327+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.327+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 20 zone MyZone found 2024-05-15T14:38:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.328+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.329+0000 7fb5e5fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.329+0000 7fb5e5fa2800 20 started sync module instance, tier type = 2024-05-15T14:38:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.329+0000 7fb5e5fa2800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.338+0000 7fb5e5fa2800 20 add_watcher() i=0 2024-05-15T14:38:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.338+0000 7fb5e5fa2800 20 add_watcher() i=1 2024-05-15T14:38:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.338+0000 7fb5e5fa2800 20 add_watcher() i=2 2024-05-15T14:38:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.338+0000 7fb5e5fa2800 20 add_watcher() i=3 2024-05-15T14:38:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.338+0000 7fb5e5fa2800 20 add_watcher() i=4 2024-05-15T14:38:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.338+0000 7fb5e5fa2800 20 add_watcher() i=5 2024-05-15T14:38:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.338+0000 7fb5e5fa2800 20 add_watcher() i=6 2024-05-15T14:38:11.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.339+0000 7fb5e5fa2800 20 add_watcher() i=7 2024-05-15T14:38:11.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.339+0000 7fb5e5fa2800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:11.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.341+0000 7fb499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.341+0000 7fb5e5fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:11.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.341+0000 7fb5e5fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:11.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.341+0000 7fb5e5fa2800 5 note: GC not initialized 2024-05-15T14:38:11.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.341+0000 7fb498fe1640 20 reqs_thread_entry: start 2024-05-15T14:38:11.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.342+0000 7fb5e5fa2800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.342+0000 7fb5e5fa2800 20 Filter name: none 2024-05-15T14:38:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.342+0000 7fb4127fc640 20 reqs_thread_entry: start 2024-05-15T14:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.351+0000 7fb5e5fa2800 20 RGWRados::pool_iterate: got topic.:vwwrqh-8_topic 2024-05-15T14:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.351+0000 7fb5e5fa2800 20 RGWRados::pool_iterate: got buckets.:vwwrqh-8_topic 2024-05-15T14:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.351+0000 7fb5e5fa2800 20 RGWRados::pool_iterate: got buckets.:vwwrqh-3_topic_1 2024-05-15T14:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.351+0000 7fb5e5fa2800 20 RGWRados::pool_iterate: got topic.:vwwrqh-3_topic_1 2024-05-15T14:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.351+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.352+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=206 2024-05-15T14:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.352+0000 7fb5e5fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.353+0000 7fb5e5fa2800 20 rados_obj.operate() r=0 bl.length=262 2024-05-15T14:38:11.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.354+0000 7fb499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.356+0000 7fb5e5fa2800 20 remove_watcher() i=0 2024-05-15T14:38:11.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.356+0000 7fb5e5fa2800 2 removed watcher, disabling cache 2024-05-15T14:38:11.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.357+0000 7fb5e5fa2800 20 remove_watcher() i=1 2024-05-15T14:38:11.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.358+0000 7fb5e5fa2800 20 remove_watcher() i=2 2024-05-15T14:38:11.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.359+0000 7fb5e5fa2800 20 remove_watcher() i=3 2024-05-15T14:38:11.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.360+0000 7fb5e5fa2800 20 remove_watcher() i=4 2024-05-15T14:38:11.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.361+0000 7fb5e5fa2800 20 remove_watcher() i=5 2024-05-15T14:38:11.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.362+0000 7fb5e5fa2800 20 remove_watcher() i=6 2024-05-15T14:38:11.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.363+0000 7fb5e5fa2800 20 remove_watcher() i=7 2024-05-15T14:38:11.419 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:11.419 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:11.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.458+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.460+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.460+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.461+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.461+0000 7fe5bd898800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:11.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.461+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.461+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.461+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.462+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:11.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.462+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.462+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:11.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.462+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.462+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.462+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.463+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.463+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.463+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.463+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:11.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 20 zone MyZone found 2024-05-15T14:38:11.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:11.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:11.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:11.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.464+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.465+0000 7fe5bd898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.465+0000 7fe5bd898800 20 started sync module instance, tier type = 2024-05-15T14:38:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.465+0000 7fe5bd898800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:11.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.474+0000 7fe5bd898800 20 add_watcher() i=0 2024-05-15T14:38:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.474+0000 7fe5bd898800 20 add_watcher() i=1 2024-05-15T14:38:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.474+0000 7fe5bd898800 20 add_watcher() i=2 2024-05-15T14:38:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.474+0000 7fe5bd898800 20 add_watcher() i=3 2024-05-15T14:38:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.474+0000 7fe5bd898800 20 add_watcher() i=4 2024-05-15T14:38:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.474+0000 7fe5bd898800 20 add_watcher() i=5 2024-05-15T14:38:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.474+0000 7fe5bd898800 20 add_watcher() i=6 2024-05-15T14:38:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.475+0000 7fe5bd898800 20 add_watcher() i=7 2024-05-15T14:38:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.475+0000 7fe5bd898800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:11.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.477+0000 7fe471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.477+0000 7fe5bd898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.477+0000 7fe5bd898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.477+0000 7fe5bd898800 5 note: GC not initialized 2024-05-15T14:38:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.477+0000 7fe470fe1640 20 reqs_thread_entry: start 2024-05-15T14:38:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.477+0000 7fe5bd898800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.477+0000 7fe5bd898800 20 Filter name: none 2024-05-15T14:38:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.477+0000 7fe3ea7fc640 20 reqs_thread_entry: start 2024-05-15T14:38:11.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.478+0000 7fe5bd898800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:38:11.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.478+0000 7fe5bd898800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:38:11.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.478+0000 7fe5bd898800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:38:11.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.478+0000 7fe5bd898800 10 cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:38:11.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.478+0000 7fe5bd898800 10 cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-3_topic_1 : miss 2024-05-15T14:38:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.478+0000 7fe5bd898800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.479+0000 7fe5bd898800 20 rados_obj.operate() r=0 bl.length=262 2024-05-15T14:38:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.479+0000 7fe5bd898800 10 cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-3_topic_1 info.flags=0x15 2024-05-15T14:38:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.479+0000 7fe5bd898800 10 adding MyZone.rgw.meta+topics+topic.:vwwrqh-3_topic_1 to cache LRU end 2024-05-15T14:38:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.479+0000 7fe5bd898800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.:vwwrqh-3_topic_1 2024-05-15T14:38:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.480+0000 7fe5bd898800 10 removing MyZone.rgw.meta+topics+topic.:vwwrqh-3_topic_1 from cache 2024-05-15T14:38:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.480+0000 7fe5bd898800 10 distributing notification oid=MyZone.rgw.control:notify.6 cni=[op: 1, obj: MyZone.rgw.meta:topics:topic.:vwwrqh-3_topic_1, ofs0, ns] 2024-05-15T14:38:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.480+0000 7fe49effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724617 cookie 94179131314704 notifier 5825 bl.length()=168 2024-05-15T14:38:11.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.482+0000 7fe5bd898800 10 distributing notification oid=MyZone.rgw.control:notify.5 cni=[op: 1, obj: MyZone.rgw.meta:topics:buckets.:vwwrqh-3_topic_1, ofs0, ns] 2024-05-15T14:38:11.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.482+0000 7fe49e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724618 cookie 94179131311040 notifier 5825 bl.length()=170 2024-05-15T14:38:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.483+0000 7fe471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.486+0000 7fe5bd898800 20 remove_watcher() i=0 2024-05-15T14:38:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.486+0000 7fe5bd898800 2 removed watcher, disabling cache 2024-05-15T14:38:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.487+0000 7fe5bd898800 20 remove_watcher() i=1 2024-05-15T14:38:11.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.487+0000 7fe5bd898800 20 remove_watcher() i=2 2024-05-15T14:38:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.488+0000 7fe5bd898800 20 remove_watcher() i=3 2024-05-15T14:38:11.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.489+0000 7fe5bd898800 20 remove_watcher() i=4 2024-05-15T14:38:11.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.490+0000 7fe5bd898800 20 remove_watcher() i=5 2024-05-15T14:38:11.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.491+0000 7fe5bd898800 20 remove_watcher() i=6 2024-05-15T14:38:11.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.492+0000 7fe5bd898800 20 remove_watcher() i=7 2024-05-15T14:38:11.548 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:11.548 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:11.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.587+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.589+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.589+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.590+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.590+0000 7efdc3f35800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:11.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.590+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.590+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.590+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.591+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.591+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.591+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.591+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.591+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.591+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.591+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.591+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.592+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.592+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 zone MyZone found 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:11.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 started sync module instance, tier type = 2024-05-15T14:38:11.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.593+0000 7efdc3f35800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:11.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.603+0000 7efdc3f35800 20 add_watcher() i=0 2024-05-15T14:38:11.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.603+0000 7efdc3f35800 20 add_watcher() i=1 2024-05-15T14:38:11.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.603+0000 7efdc3f35800 20 add_watcher() i=2 2024-05-15T14:38:11.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.603+0000 7efdc3f35800 20 add_watcher() i=3 2024-05-15T14:38:11.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.603+0000 7efdc3f35800 20 add_watcher() i=4 2024-05-15T14:38:11.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.603+0000 7efdc3f35800 20 add_watcher() i=5 2024-05-15T14:38:11.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.603+0000 7efdc3f35800 20 add_watcher() i=6 2024-05-15T14:38:11.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.604+0000 7efdc3f35800 20 add_watcher() i=7 2024-05-15T14:38:11.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.604+0000 7efdc3f35800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:11.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.606+0000 7efc75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.606+0000 7efdc3f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:11.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.606+0000 7efdc3f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:11.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.606+0000 7efdc3f35800 5 note: GC not initialized 2024-05-15T14:38:11.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.606+0000 7efc74fe1640 20 reqs_thread_entry: start 2024-05-15T14:38:11.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:11.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 20 Filter name: none 2024-05-15T14:38:11.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efbee7fc640 20 reqs_thread_entry: start 2024-05-15T14:38:11.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:38:11.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:38:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:38:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 10 cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:38:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 10 cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-8_topic : miss 2024-05-15T14:38:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 20 rados_obj.operate() r=0 bl.length=206 2024-05-15T14:38:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 10 cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-8_topic info.flags=0x15 2024-05-15T14:38:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 10 adding MyZone.rgw.meta+topics+topic.:vwwrqh-8_topic to cache LRU end 2024-05-15T14:38:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.607+0000 7efdc3f35800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.:vwwrqh-8_topic 2024-05-15T14:38:11.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.608+0000 7efdc3f35800 10 removing MyZone.rgw.meta+topics+topic.:vwwrqh-8_topic from cache 2024-05-15T14:38:11.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.608+0000 7efdc3f35800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 1, obj: MyZone.rgw.meta:topics:topic.:vwwrqh-8_topic, ofs0, ns] 2024-05-15T14:38:11.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.609+0000 7efc9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724599 cookie 94710422943600 notifier 6051 bl.length()=166 2024-05-15T14:38:11.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.610+0000 7efdc3f35800 10 distributing notification oid=MyZone.rgw.control:notify.7 cni=[op: 1, obj: MyZone.rgw.meta:topics:buckets.:vwwrqh-8_topic, ofs0, ns] 2024-05-15T14:38:11.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.611+0000 7efc9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724582 cookie 94710422996320 notifier 6051 bl.length()=168 2024-05-15T14:38:11.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.612+0000 7efc75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.614+0000 7efdc3f35800 20 remove_watcher() i=0 2024-05-15T14:38:11.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.614+0000 7efdc3f35800 2 removed watcher, disabling cache 2024-05-15T14:38:11.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.615+0000 7efdc3f35800 20 remove_watcher() i=1 2024-05-15T14:38:11.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.616+0000 7efdc3f35800 20 remove_watcher() i=2 2024-05-15T14:38:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.617+0000 7efdc3f35800 20 remove_watcher() i=3 2024-05-15T14:38:11.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.618+0000 7efdc3f35800 20 remove_watcher() i=4 2024-05-15T14:38:11.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.619+0000 7efdc3f35800 20 remove_watcher() i=5 2024-05-15T14:38:11.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.620+0000 7efdc3f35800 20 remove_watcher() i=6 2024-05-15T14:38:11.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.621+0000 7efdc3f35800 20 remove_watcher() i=7 2024-05-15T14:38:11.636 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:38:11] "POST / HTTP/1.1" 200 - 2024-05-15T14:38:11.727 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:11.727 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:11.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.766+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.767+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.767+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.768+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.768+0000 7f397452e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:11.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.768+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.768+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.768+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.769+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:11.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.769+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.769+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.769+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.769+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.769+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.770+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.770+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.770+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:11.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.770+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 20 zone MyZone found 2024-05-15T14:38:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:11.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.771+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.772+0000 7f397452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.772+0000 7f397452e800 20 started sync module instance, tier type = 2024-05-15T14:38:11.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.772+0000 7f397452e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.781+0000 7f397452e800 20 add_watcher() i=0 2024-05-15T14:38:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.781+0000 7f397452e800 20 add_watcher() i=1 2024-05-15T14:38:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.781+0000 7f397452e800 20 add_watcher() i=2 2024-05-15T14:38:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.781+0000 7f397452e800 20 add_watcher() i=3 2024-05-15T14:38:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.781+0000 7f397452e800 20 add_watcher() i=4 2024-05-15T14:38:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.781+0000 7f397452e800 20 add_watcher() i=5 2024-05-15T14:38:11.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.781+0000 7f397452e800 20 add_watcher() i=6 2024-05-15T14:38:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.782+0000 7f397452e800 20 add_watcher() i=7 2024-05-15T14:38:11.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.782+0000 7f397452e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:11.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.784+0000 7f3826fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.784+0000 7f397452e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:11.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.784+0000 7f397452e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:11.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.784+0000 7f397452e800 5 note: GC not initialized 2024-05-15T14:38:11.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.785+0000 7f3825fdb640 20 reqs_thread_entry: start 2024-05-15T14:38:11.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.785+0000 7f397452e800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:11.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.785+0000 7f397452e800 20 Filter name: none 2024-05-15T14:38:11.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.785+0000 7f37977fe640 20 reqs_thread_entry: start 2024-05-15T14:38:11.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.785+0000 7f397452e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:11.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.786+0000 7f397452e800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:11.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.787+0000 7f3826fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:11.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.789+0000 7f397452e800 20 remove_watcher() i=0 2024-05-15T14:38:11.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.789+0000 7f397452e800 2 removed watcher, disabling cache 2024-05-15T14:38:11.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.790+0000 7f397452e800 20 remove_watcher() i=1 2024-05-15T14:38:11.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.791+0000 7f397452e800 20 remove_watcher() i=2 2024-05-15T14:38:11.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.793+0000 7f397452e800 20 remove_watcher() i=3 2024-05-15T14:38:11.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.794+0000 7f397452e800 20 remove_watcher() i=4 2024-05-15T14:38:11.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.795+0000 7f397452e800 20 remove_watcher() i=5 2024-05-15T14:38:11.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.795+0000 7f397452e800 20 remove_watcher() i=6 2024-05-15T14:38:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:11.796+0000 7f397452e800 20 remove_watcher() i=7 2024-05-15T14:38:12.106 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:12.106 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:12.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.152+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.154+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.154+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.154+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:12.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.154+0000 7f329d731800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:12.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.154+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.155+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:12.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.155+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.155+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:12.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.155+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.156+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:12.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.156+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.156+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:12.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.156+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.156+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:12.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.156+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.157+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:12.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.157+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:12.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 20 zone MyZone found 2024-05-15T14:38:12.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:12.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:12.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:12.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.158+0000 7f329d731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.159+0000 7f329d731800 20 started sync module instance, tier type = 2024-05-15T14:38:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.159+0000 7f329d731800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:12.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.169+0000 7f329d731800 20 add_watcher() i=0 2024-05-15T14:38:12.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.169+0000 7f329d731800 20 add_watcher() i=1 2024-05-15T14:38:12.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.169+0000 7f329d731800 20 add_watcher() i=2 2024-05-15T14:38:12.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.169+0000 7f329d731800 20 add_watcher() i=3 2024-05-15T14:38:12.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.169+0000 7f329d731800 20 add_watcher() i=4 2024-05-15T14:38:12.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.169+0000 7f329d731800 20 add_watcher() i=5 2024-05-15T14:38:12.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.169+0000 7f329d731800 20 add_watcher() i=6 2024-05-15T14:38:12.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.170+0000 7f329d731800 20 add_watcher() i=7 2024-05-15T14:38:12.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.170+0000 7f329d731800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:12.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.172+0000 7f314f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.172+0000 7f329d731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.172+0000 7f329d731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.172+0000 7f329d731800 5 note: GC not initialized 2024-05-15T14:38:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.173+0000 7f314e7e4640 20 reqs_thread_entry: start 2024-05-15T14:38:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.173+0000 7f329d731800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.173+0000 7f329d731800 20 Filter name: none 2024-05-15T14:38:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.173+0000 7f30bffff640 20 reqs_thread_entry: start 2024-05-15T14:38:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.173+0000 7f329d731800 20 rados->read ofs=0 len=0 2024-05-15T14:38:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.174+0000 7f329d731800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:12.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.176+0000 7f314f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:12.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.178+0000 7f329d731800 20 remove_watcher() i=0 2024-05-15T14:38:12.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.178+0000 7f329d731800 2 removed watcher, disabling cache 2024-05-15T14:38:12.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.179+0000 7f329d731800 20 remove_watcher() i=1 2024-05-15T14:38:12.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.180+0000 7f329d731800 20 remove_watcher() i=2 2024-05-15T14:38:12.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.181+0000 7f329d731800 20 remove_watcher() i=3 2024-05-15T14:38:12.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.182+0000 7f329d731800 20 remove_watcher() i=4 2024-05-15T14:38:12.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.183+0000 7f329d731800 20 remove_watcher() i=5 2024-05-15T14:38:12.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.184+0000 7f329d731800 20 remove_watcher() i=6 2024-05-15T14:38:12.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:12.185+0000 7f329d731800 20 remove_watcher() i=7 2024-05-15T14:38:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:17.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.291+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.293+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.293+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.294+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.294+0000 7fa55623f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.294+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.294+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.294+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.295+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.295+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.295+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:17.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.295+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.296+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:17.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.296+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.296+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:17.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.296+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.297+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:17.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.297+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 zone MyZone found 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:17.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 started sync module instance, tier type = 2024-05-15T14:38:17.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.298+0000 7fa55623f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:17.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.309+0000 7fa55623f800 20 add_watcher() i=0 2024-05-15T14:38:17.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.309+0000 7fa55623f800 20 add_watcher() i=1 2024-05-15T14:38:17.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.309+0000 7fa55623f800 20 add_watcher() i=2 2024-05-15T14:38:17.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.309+0000 7fa55623f800 20 add_watcher() i=3 2024-05-15T14:38:17.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.309+0000 7fa55623f800 20 add_watcher() i=4 2024-05-15T14:38:17.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.309+0000 7fa55623f800 20 add_watcher() i=5 2024-05-15T14:38:17.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.309+0000 7fa55623f800 20 add_watcher() i=6 2024-05-15T14:38:17.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.310+0000 7fa55623f800 20 add_watcher() i=7 2024-05-15T14:38:17.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.310+0000 7fa55623f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:17.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.312+0000 7fa409fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.312+0000 7fa55623f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.312+0000 7fa55623f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.313+0000 7fa55623f800 5 note: GC not initialized 2024-05-15T14:38:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.313+0000 7fa408fe1640 20 reqs_thread_entry: start 2024-05-15T14:38:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.313+0000 7fa55623f800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.313+0000 7fa55623f800 20 Filter name: none 2024-05-15T14:38:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.313+0000 7fa3827fc640 20 reqs_thread_entry: start 2024-05-15T14:38:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.313+0000 7fa55623f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.314+0000 7fa55623f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:17.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.315+0000 7fa409fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:17.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.317+0000 7fa55623f800 20 remove_watcher() i=0 2024-05-15T14:38:17.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.317+0000 7fa55623f800 2 removed watcher, disabling cache 2024-05-15T14:38:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.318+0000 7fa55623f800 20 remove_watcher() i=1 2024-05-15T14:38:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.319+0000 7fa55623f800 20 remove_watcher() i=2 2024-05-15T14:38:17.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.320+0000 7fa55623f800 20 remove_watcher() i=3 2024-05-15T14:38:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.321+0000 7fa55623f800 20 remove_watcher() i=4 2024-05-15T14:38:17.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.322+0000 7fa55623f800 20 remove_watcher() i=5 2024-05-15T14:38:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.323+0000 7fa55623f800 20 remove_watcher() i=6 2024-05-15T14:38:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:17.325+0000 7fa55623f800 20 remove_watcher() i=7 2024-05-15T14:38:22.390 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:22.391 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:22.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.435+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.437+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:22.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.437+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.438+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:22.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.438+0000 7f3b79e87800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:22.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.438+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.438+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:22.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.438+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.439+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.439+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.440+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.440+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.440+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:22.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.440+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.440+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.440+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.441+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:22.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.441+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 zone MyZone found 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 started sync module instance, tier type = 2024-05-15T14:38:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.442+0000 7f3b79e87800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:22.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.453+0000 7f3b79e87800 20 add_watcher() i=0 2024-05-15T14:38:22.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.453+0000 7f3b79e87800 20 add_watcher() i=1 2024-05-15T14:38:22.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.453+0000 7f3b79e87800 20 add_watcher() i=2 2024-05-15T14:38:22.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.453+0000 7f3b79e87800 20 add_watcher() i=3 2024-05-15T14:38:22.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.453+0000 7f3b79e87800 20 add_watcher() i=4 2024-05-15T14:38:22.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.453+0000 7f3b79e87800 20 add_watcher() i=5 2024-05-15T14:38:22.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.453+0000 7f3b79e87800 20 add_watcher() i=6 2024-05-15T14:38:22.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.454+0000 7f3b79e87800 20 add_watcher() i=7 2024-05-15T14:38:22.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.454+0000 7f3b79e87800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:22.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.455+0000 7f3a2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:22.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.456+0000 7f3b79e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:22.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.456+0000 7f3b79e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:22.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.456+0000 7f3b79e87800 5 note: GC not initialized 2024-05-15T14:38:22.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.456+0000 7f3a2cfe1640 20 reqs_thread_entry: start 2024-05-15T14:38:22.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.456+0000 7f3b79e87800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:22.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.456+0000 7f3b79e87800 20 Filter name: none 2024-05-15T14:38:22.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.456+0000 7f39a67fc640 20 reqs_thread_entry: start 2024-05-15T14:38:22.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.457+0000 7f3b79e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:22.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.457+0000 7f3b79e87800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.459+0000 7f3a2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:22.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.461+0000 7f3b79e87800 20 remove_watcher() i=0 2024-05-15T14:38:22.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.461+0000 7f3b79e87800 2 removed watcher, disabling cache 2024-05-15T14:38:22.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.462+0000 7f3b79e87800 20 remove_watcher() i=1 2024-05-15T14:38:22.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.463+0000 7f3b79e87800 20 remove_watcher() i=2 2024-05-15T14:38:22.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.464+0000 7f3b79e87800 20 remove_watcher() i=3 2024-05-15T14:38:22.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.465+0000 7f3b79e87800 20 remove_watcher() i=4 2024-05-15T14:38:22.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.466+0000 7f3b79e87800 20 remove_watcher() i=5 2024-05-15T14:38:22.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.467+0000 7f3b79e87800 20 remove_watcher() i=6 2024-05-15T14:38:22.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:22.468+0000 7f3b79e87800 20 remove_watcher() i=7 2024-05-15T14:38:27.532 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:27.532 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:27.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.573+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.575+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.575+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.576+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.576+0000 7f620491f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.576+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.577+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.577+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.577+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.577+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.578+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.578+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.578+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.578+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.578+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.578+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.579+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.579+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 20 zone MyZone found 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.580+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.581+0000 7f620491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:27.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.581+0000 7f620491f800 20 started sync module instance, tier type = 2024-05-15T14:38:27.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.581+0000 7f620491f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.591+0000 7f620491f800 20 add_watcher() i=0 2024-05-15T14:38:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.591+0000 7f620491f800 20 add_watcher() i=1 2024-05-15T14:38:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.591+0000 7f620491f800 20 add_watcher() i=2 2024-05-15T14:38:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.591+0000 7f620491f800 20 add_watcher() i=3 2024-05-15T14:38:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.591+0000 7f620491f800 20 add_watcher() i=4 2024-05-15T14:38:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.591+0000 7f620491f800 20 add_watcher() i=5 2024-05-15T14:38:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.591+0000 7f620491f800 20 add_watcher() i=6 2024-05-15T14:38:27.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.592+0000 7f620491f800 20 add_watcher() i=7 2024-05-15T14:38:27.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.592+0000 7f620491f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:27.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.594+0000 7f60b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.594+0000 7f620491f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.594+0000 7f620491f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.594+0000 7f620491f800 5 note: GC not initialized 2024-05-15T14:38:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.594+0000 7f60b5fdb640 20 reqs_thread_entry: start 2024-05-15T14:38:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.594+0000 7f620491f800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.595+0000 7f620491f800 20 Filter name: none 2024-05-15T14:38:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.595+0000 7f60277fe640 20 reqs_thread_entry: start 2024-05-15T14:38:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.595+0000 7f620491f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.595+0000 7f620491f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.597+0000 7f60b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:27.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.599+0000 7f620491f800 20 remove_watcher() i=0 2024-05-15T14:38:27.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.599+0000 7f620491f800 2 removed watcher, disabling cache 2024-05-15T14:38:27.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.600+0000 7f620491f800 20 remove_watcher() i=1 2024-05-15T14:38:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.601+0000 7f620491f800 20 remove_watcher() i=2 2024-05-15T14:38:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.602+0000 7f620491f800 20 remove_watcher() i=3 2024-05-15T14:38:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.603+0000 7f620491f800 20 remove_watcher() i=4 2024-05-15T14:38:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.604+0000 7f620491f800 20 remove_watcher() i=5 2024-05-15T14:38:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.605+0000 7f620491f800 20 remove_watcher() i=6 2024-05-15T14:38:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:27.606+0000 7f620491f800 20 remove_watcher() i=7 2024-05-15T14:38:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:32.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.712+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.714+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:32.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.714+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.715+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.715+0000 7f288553f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.715+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.716+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.716+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.716+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:32.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.716+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.717+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:32.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.717+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.717+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:32.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.717+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.717+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:32.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.717+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.718+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:32.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.718+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 zone MyZone found 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:32.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 started sync module instance, tier type = 2024-05-15T14:38:32.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.719+0000 7f288553f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:32.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.730+0000 7f288553f800 20 add_watcher() i=0 2024-05-15T14:38:32.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.730+0000 7f288553f800 20 add_watcher() i=1 2024-05-15T14:38:32.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.730+0000 7f288553f800 20 add_watcher() i=2 2024-05-15T14:38:32.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.730+0000 7f288553f800 20 add_watcher() i=3 2024-05-15T14:38:32.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.730+0000 7f288553f800 20 add_watcher() i=4 2024-05-15T14:38:32.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.730+0000 7f288553f800 20 add_watcher() i=5 2024-05-15T14:38:32.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.730+0000 7f288553f800 20 add_watcher() i=6 2024-05-15T14:38:32.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.731+0000 7f288553f800 20 add_watcher() i=7 2024-05-15T14:38:32.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.731+0000 7f288553f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:32.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.733+0000 7f27377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:32.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.733+0000 7f288553f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:32.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.733+0000 7f288553f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:32.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.733+0000 7f288553f800 5 note: GC not initialized 2024-05-15T14:38:32.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.733+0000 7f27367e4640 20 reqs_thread_entry: start 2024-05-15T14:38:32.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.733+0000 7f288553f800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:32.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.733+0000 7f288553f800 20 Filter name: none 2024-05-15T14:38:32.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.734+0000 7f26a7fff640 20 reqs_thread_entry: start 2024-05-15T14:38:32.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.734+0000 7f288553f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:32.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.734+0000 7f288553f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:32.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.737+0000 7f27377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:32.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.738+0000 7f288553f800 20 remove_watcher() i=0 2024-05-15T14:38:32.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.738+0000 7f288553f800 2 removed watcher, disabling cache 2024-05-15T14:38:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.739+0000 7f288553f800 20 remove_watcher() i=1 2024-05-15T14:38:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.740+0000 7f288553f800 20 remove_watcher() i=2 2024-05-15T14:38:32.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.741+0000 7f288553f800 20 remove_watcher() i=3 2024-05-15T14:38:32.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.743+0000 7f288553f800 20 remove_watcher() i=4 2024-05-15T14:38:32.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.744+0000 7f288553f800 20 remove_watcher() i=5 2024-05-15T14:38:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.745+0000 7f288553f800 20 remove_watcher() i=6 2024-05-15T14:38:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:32.746+0000 7f288553f800 20 remove_watcher() i=7 2024-05-15T14:38:37.810 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:37.810 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:37.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.852+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.854+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:37.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.854+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.855+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:37.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.855+0000 7f90e5e87800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:37.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.855+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.855+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:37.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.855+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.856+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:37.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.856+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.856+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:37.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.856+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.856+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:37.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.856+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.857+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:37.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.857+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.857+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:37.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.857+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 20 zone MyZone found 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.858+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.859+0000 7f90e5e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:37.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.859+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.859+0000 7f90e5e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:37.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.859+0000 7f90e5e87800 20 started sync module instance, tier type = 2024-05-15T14:38:37.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.859+0000 7f90e5e87800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:37.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.869+0000 7f90e5e87800 20 add_watcher() i=0 2024-05-15T14:38:37.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.869+0000 7f90e5e87800 20 add_watcher() i=1 2024-05-15T14:38:37.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.869+0000 7f90e5e87800 20 add_watcher() i=2 2024-05-15T14:38:37.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.869+0000 7f90e5e87800 20 add_watcher() i=3 2024-05-15T14:38:37.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.869+0000 7f90e5e87800 20 add_watcher() i=4 2024-05-15T14:38:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.869+0000 7f90e5e87800 20 add_watcher() i=5 2024-05-15T14:38:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.869+0000 7f90e5e87800 20 add_watcher() i=6 2024-05-15T14:38:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.870+0000 7f90e5e87800 20 add_watcher() i=7 2024-05-15T14:38:37.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.870+0000 7f90e5e87800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:37.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.872+0000 7f8f99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.872+0000 7f90e5e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.872+0000 7f90e5e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.872+0000 7f90e5e87800 5 note: GC not initialized 2024-05-15T14:38:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.872+0000 7f8f98fe1640 20 reqs_thread_entry: start 2024-05-15T14:38:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.873+0000 7f90e5e87800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.873+0000 7f90e5e87800 20 Filter name: none 2024-05-15T14:38:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.873+0000 7f8f127fc640 20 reqs_thread_entry: start 2024-05-15T14:38:37.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.873+0000 7f90e5e87800 20 rados->read ofs=0 len=0 2024-05-15T14:38:37.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.874+0000 7f90e5e87800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:37.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.875+0000 7f8f99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:37.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.877+0000 7f90e5e87800 20 remove_watcher() i=0 2024-05-15T14:38:37.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.877+0000 7f90e5e87800 2 removed watcher, disabling cache 2024-05-15T14:38:37.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.878+0000 7f90e5e87800 20 remove_watcher() i=1 2024-05-15T14:38:37.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.879+0000 7f90e5e87800 20 remove_watcher() i=2 2024-05-15T14:38:37.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.880+0000 7f90e5e87800 20 remove_watcher() i=3 2024-05-15T14:38:37.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.881+0000 7f90e5e87800 20 remove_watcher() i=4 2024-05-15T14:38:37.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.882+0000 7f90e5e87800 20 remove_watcher() i=5 2024-05-15T14:38:37.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.883+0000 7f90e5e87800 20 remove_watcher() i=6 2024-05-15T14:38:37.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:37.885+0000 7f90e5e87800 20 remove_watcher() i=7 2024-05-15T14:38:42.949 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:42.949 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:42.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.991+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:42.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.994+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:42.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.994+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:42.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.995+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.995+0000 7f359f928800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.995+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.995+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.995+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.996+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.996+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.996+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.996+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:42.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.997+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:42.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.997+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:42.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.997+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:42.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.997+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:42.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.998+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:42.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.998+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:43.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:43.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 zone MyZone found 2024-05-15T14:38:43.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 started sync module instance, tier type = 2024-05-15T14:38:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:42.999+0000 7f359f928800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.010+0000 7f359f928800 20 add_watcher() i=0 2024-05-15T14:38:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.010+0000 7f359f928800 20 add_watcher() i=1 2024-05-15T14:38:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.010+0000 7f359f928800 20 add_watcher() i=2 2024-05-15T14:38:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.010+0000 7f359f928800 20 add_watcher() i=3 2024-05-15T14:38:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.010+0000 7f359f928800 20 add_watcher() i=4 2024-05-15T14:38:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.010+0000 7f359f928800 20 add_watcher() i=5 2024-05-15T14:38:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.010+0000 7f359f928800 20 add_watcher() i=6 2024-05-15T14:38:43.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.011+0000 7f359f928800 20 add_watcher() i=7 2024-05-15T14:38:43.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.011+0000 7f359f928800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:43.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.013+0000 7f3451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:43.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.013+0000 7f359f928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:43.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.013+0000 7f359f928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:43.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.013+0000 7f359f928800 5 note: GC not initialized 2024-05-15T14:38:43.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.013+0000 7f3450fe1640 20 reqs_thread_entry: start 2024-05-15T14:38:43.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.013+0000 7f359f928800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:43.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.014+0000 7f359f928800 20 Filter name: none 2024-05-15T14:38:43.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.014+0000 7f33ca7fc640 20 reqs_thread_entry: start 2024-05-15T14:38:43.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.014+0000 7f359f928800 20 rados->read ofs=0 len=0 2024-05-15T14:38:43.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.014+0000 7f359f928800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:43.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.016+0000 7f3451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.018+0000 7f359f928800 20 remove_watcher() i=0 2024-05-15T14:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.018+0000 7f359f928800 2 removed watcher, disabling cache 2024-05-15T14:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.019+0000 7f359f928800 20 remove_watcher() i=1 2024-05-15T14:38:43.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.020+0000 7f359f928800 20 remove_watcher() i=2 2024-05-15T14:38:43.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.021+0000 7f359f928800 20 remove_watcher() i=3 2024-05-15T14:38:43.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.022+0000 7f359f928800 20 remove_watcher() i=4 2024-05-15T14:38:43.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.023+0000 7f359f928800 20 remove_watcher() i=5 2024-05-15T14:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.024+0000 7f359f928800 20 remove_watcher() i=6 2024-05-15T14:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:43.025+0000 7f359f928800 20 remove_watcher() i=7 2024-05-15T14:38:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.131+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.132+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:48.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.132+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.133+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:48.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.133+0000 7fed2d12e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:48.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.133+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.134+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.134+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.134+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.135+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.135+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.135+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.135+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.135+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.135+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.135+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.136+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:48.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.136+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:48.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 20 zone MyZone found 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.137+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.138+0000 7fed2d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.138+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.138+0000 7fed2d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.138+0000 7fed2d12e800 20 started sync module instance, tier type = 2024-05-15T14:38:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.138+0000 7fed2d12e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:48.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.149+0000 7fed2d12e800 20 add_watcher() i=0 2024-05-15T14:38:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.149+0000 7fed2d12e800 20 add_watcher() i=1 2024-05-15T14:38:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.149+0000 7fed2d12e800 20 add_watcher() i=2 2024-05-15T14:38:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.149+0000 7fed2d12e800 20 add_watcher() i=3 2024-05-15T14:38:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.149+0000 7fed2d12e800 20 add_watcher() i=4 2024-05-15T14:38:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.149+0000 7fed2d12e800 20 add_watcher() i=5 2024-05-15T14:38:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.149+0000 7fed2d12e800 20 add_watcher() i=6 2024-05-15T14:38:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.150+0000 7fed2d12e800 20 add_watcher() i=7 2024-05-15T14:38:48.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.150+0000 7fed2d12e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:48.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.151+0000 7febdefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:48.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.152+0000 7fed2d12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:48.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.152+0000 7fed2d12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:48.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.152+0000 7fed2d12e800 5 note: GC not initialized 2024-05-15T14:38:48.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.152+0000 7febddfe3640 20 reqs_thread_entry: start 2024-05-15T14:38:48.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.152+0000 7fed2d12e800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:48.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.153+0000 7fed2d12e800 20 Filter name: none 2024-05-15T14:38:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.153+0000 7feb4f7fe640 20 reqs_thread_entry: start 2024-05-15T14:38:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.153+0000 7fed2d12e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.153+0000 7fed2d12e800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.155+0000 7febdefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.157+0000 7fed2d12e800 20 remove_watcher() i=0 2024-05-15T14:38:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.157+0000 7fed2d12e800 2 removed watcher, disabling cache 2024-05-15T14:38:48.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.158+0000 7fed2d12e800 20 remove_watcher() i=1 2024-05-15T14:38:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.159+0000 7fed2d12e800 20 remove_watcher() i=2 2024-05-15T14:38:48.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.160+0000 7fed2d12e800 20 remove_watcher() i=3 2024-05-15T14:38:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.161+0000 7fed2d12e800 20 remove_watcher() i=4 2024-05-15T14:38:48.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.162+0000 7fed2d12e800 20 remove_watcher() i=5 2024-05-15T14:38:48.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.163+0000 7fed2d12e800 20 remove_watcher() i=6 2024-05-15T14:38:48.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:48.164+0000 7fed2d12e800 20 remove_watcher() i=7 2024-05-15T14:38:53.228 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:53.228 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:53.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.271+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.273+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:53.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.273+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.274+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:53.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.274+0000 7f7709a3e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:53.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.274+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.274+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:53.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.274+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.275+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:53.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.275+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.275+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:53.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.275+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.276+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:53.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.276+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.276+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:53.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.276+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.276+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:53.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.276+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 20 zone MyZone found 2024-05-15T14:38:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.277+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.278+0000 7f7709a3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.278+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.278+0000 7f7709a3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.278+0000 7f7709a3e800 20 started sync module instance, tier type = 2024-05-15T14:38:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.278+0000 7f7709a3e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:53.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.288+0000 7f7709a3e800 20 add_watcher() i=0 2024-05-15T14:38:53.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.288+0000 7f7709a3e800 20 add_watcher() i=1 2024-05-15T14:38:53.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.288+0000 7f7709a3e800 20 add_watcher() i=2 2024-05-15T14:38:53.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.288+0000 7f7709a3e800 20 add_watcher() i=3 2024-05-15T14:38:53.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.288+0000 7f7709a3e800 20 add_watcher() i=4 2024-05-15T14:38:53.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.288+0000 7f7709a3e800 20 add_watcher() i=5 2024-05-15T14:38:53.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.288+0000 7f7709a3e800 20 add_watcher() i=6 2024-05-15T14:38:53.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.290+0000 7f7709a3e800 20 add_watcher() i=7 2024-05-15T14:38:53.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.290+0000 7f7709a3e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.291+0000 7f75bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.292+0000 7f7709a3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.292+0000 7f7709a3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.292+0000 7f7709a3e800 5 note: GC not initialized 2024-05-15T14:38:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.292+0000 7f75b9fdb640 20 reqs_thread_entry: start 2024-05-15T14:38:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.292+0000 7f7709a3e800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.292+0000 7f7709a3e800 20 Filter name: none 2024-05-15T14:38:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.292+0000 7f752b7fe640 20 reqs_thread_entry: start 2024-05-15T14:38:53.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.293+0000 7f7709a3e800 20 rados->read ofs=0 len=0 2024-05-15T14:38:53.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.293+0000 7f7709a3e800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:53.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.295+0000 7f75bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:53.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.297+0000 7f7709a3e800 20 remove_watcher() i=0 2024-05-15T14:38:53.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.297+0000 7f7709a3e800 2 removed watcher, disabling cache 2024-05-15T14:38:53.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.298+0000 7f7709a3e800 20 remove_watcher() i=1 2024-05-15T14:38:53.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.299+0000 7f7709a3e800 20 remove_watcher() i=2 2024-05-15T14:38:53.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.300+0000 7f7709a3e800 20 remove_watcher() i=3 2024-05-15T14:38:53.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.300+0000 7f7709a3e800 20 remove_watcher() i=4 2024-05-15T14:38:53.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.302+0000 7f7709a3e800 20 remove_watcher() i=5 2024-05-15T14:38:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.303+0000 7f7709a3e800 20 remove_watcher() i=6 2024-05-15T14:38:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:53.304+0000 7f7709a3e800 20 remove_watcher() i=7 2024-05-15T14:38:58.368 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:38:58.369 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:38:58.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.411+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.413+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:58.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.413+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.414+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:58.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.414+0000 7f040981f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:38:58.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.414+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.414+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:58.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.414+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.415+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:38:58.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.415+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.415+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:38:58.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.415+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.415+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:58.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.415+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.416+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:38:58.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.416+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.416+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:38:58.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.416+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 20 zone MyZone found 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:38:58.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.417+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.418+0000 7f040981f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.418+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.418+0000 7f040981f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:38:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.418+0000 7f040981f800 20 started sync module instance, tier type = 2024-05-15T14:38:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.418+0000 7f040981f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:38:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.428+0000 7f040981f800 20 add_watcher() i=0 2024-05-15T14:38:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.428+0000 7f040981f800 20 add_watcher() i=1 2024-05-15T14:38:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.428+0000 7f040981f800 20 add_watcher() i=2 2024-05-15T14:38:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.428+0000 7f040981f800 20 add_watcher() i=3 2024-05-15T14:38:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.428+0000 7f040981f800 20 add_watcher() i=4 2024-05-15T14:38:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.428+0000 7f040981f800 20 add_watcher() i=5 2024-05-15T14:38:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.428+0000 7f040981f800 20 add_watcher() i=6 2024-05-15T14:38:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.429+0000 7f040981f800 20 add_watcher() i=7 2024-05-15T14:38:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.429+0000 7f040981f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:38:58.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.431+0000 7f02bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:58.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.431+0000 7f040981f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:38:58.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.431+0000 7f040981f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:38:58.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.431+0000 7f040981f800 5 note: GC not initialized 2024-05-15T14:38:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.431+0000 7f02bcfe1640 20 reqs_thread_entry: start 2024-05-15T14:38:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.431+0000 7f040981f800 20 init_complete bucket index max shards: 11 2024-05-15T14:38:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.432+0000 7f040981f800 20 Filter name: none 2024-05-15T14:38:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.432+0000 7f02367fc640 20 reqs_thread_entry: start 2024-05-15T14:38:58.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.432+0000 7f040981f800 20 rados->read ofs=0 len=0 2024-05-15T14:38:58.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.432+0000 7f040981f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:38:58.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.435+0000 7f02bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:38:58.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.437+0000 7f040981f800 20 remove_watcher() i=0 2024-05-15T14:38:58.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.437+0000 7f040981f800 2 removed watcher, disabling cache 2024-05-15T14:38:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.438+0000 7f040981f800 20 remove_watcher() i=1 2024-05-15T14:38:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.439+0000 7f040981f800 20 remove_watcher() i=2 2024-05-15T14:38:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.440+0000 7f040981f800 20 remove_watcher() i=3 2024-05-15T14:38:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.441+0000 7f040981f800 20 remove_watcher() i=4 2024-05-15T14:38:58.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.442+0000 7f040981f800 20 remove_watcher() i=5 2024-05-15T14:38:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.443+0000 7f040981f800 20 remove_watcher() i=6 2024-05-15T14:38:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:38:58.444+0000 7f040981f800 20 remove_watcher() i=7 2024-05-15T14:39:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:03.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.550+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.552+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:03.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.552+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.553+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:03.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.553+0000 7fd4f2f1f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:03.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.553+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.553+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:03.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.553+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.554+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:03.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.554+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.554+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:03.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.554+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.554+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:03.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.554+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.555+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:03.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.555+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.555+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:03.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.555+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:03.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 20 zone MyZone found 2024-05-15T14:39:03.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:03.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:03.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:03.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:03.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:03.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:03.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:03.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.556+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.557+0000 7fd4f2f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:03.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.557+0000 7fd4f2f1f800 20 started sync module instance, tier type = 2024-05-15T14:39:03.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.557+0000 7fd4f2f1f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:03.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.567+0000 7fd4f2f1f800 20 add_watcher() i=0 2024-05-15T14:39:03.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.567+0000 7fd4f2f1f800 20 add_watcher() i=1 2024-05-15T14:39:03.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.567+0000 7fd4f2f1f800 20 add_watcher() i=2 2024-05-15T14:39:03.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.567+0000 7fd4f2f1f800 20 add_watcher() i=3 2024-05-15T14:39:03.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.567+0000 7fd4f2f1f800 20 add_watcher() i=4 2024-05-15T14:39:03.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.567+0000 7fd4f2f1f800 20 add_watcher() i=5 2024-05-15T14:39:03.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.567+0000 7fd4f2f1f800 20 add_watcher() i=6 2024-05-15T14:39:03.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.568+0000 7fd4f2f1f800 20 add_watcher() i=7 2024-05-15T14:39:03.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.568+0000 7fd4f2f1f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.570+0000 7fd3a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:03.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.570+0000 7fd4f2f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:03.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.570+0000 7fd4f2f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:03.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.570+0000 7fd4f2f1f800 5 note: GC not initialized 2024-05-15T14:39:03.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.570+0000 7fd31ffff640 20 reqs_thread_entry: start 2024-05-15T14:39:03.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.570+0000 7fd4f2f1f800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:03.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.571+0000 7fd4f2f1f800 20 Filter name: none 2024-05-15T14:39:03.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.571+0000 7fd31dffb640 20 reqs_thread_entry: start 2024-05-15T14:39:03.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.571+0000 7fd4f2f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:03.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.572+0000 7fd4f2f1f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:03.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.573+0000 7fd3a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:03.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.575+0000 7fd4f2f1f800 20 remove_watcher() i=0 2024-05-15T14:39:03.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.575+0000 7fd4f2f1f800 2 removed watcher, disabling cache 2024-05-15T14:39:03.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.576+0000 7fd4f2f1f800 20 remove_watcher() i=1 2024-05-15T14:39:03.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.577+0000 7fd4f2f1f800 20 remove_watcher() i=2 2024-05-15T14:39:03.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.578+0000 7fd4f2f1f800 20 remove_watcher() i=3 2024-05-15T14:39:03.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.579+0000 7fd4f2f1f800 20 remove_watcher() i=4 2024-05-15T14:39:03.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.580+0000 7fd4f2f1f800 20 remove_watcher() i=5 2024-05-15T14:39:03.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.581+0000 7fd4f2f1f800 20 remove_watcher() i=6 2024-05-15T14:39:03.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:03.582+0000 7fd4f2f1f800 20 remove_watcher() i=7 2024-05-15T14:39:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:08.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.688+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.690+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.690+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.691+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.691+0000 7f55aa011800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.691+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.691+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.691+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.692+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:08.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.692+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.692+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.692+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.693+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.693+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.693+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.693+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.694+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.694+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 zone MyZone found 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 started sync module instance, tier type = 2024-05-15T14:39:08.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.695+0000 7f55aa011800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.706+0000 7f55aa011800 20 add_watcher() i=0 2024-05-15T14:39:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.706+0000 7f55aa011800 20 add_watcher() i=1 2024-05-15T14:39:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.706+0000 7f55aa011800 20 add_watcher() i=2 2024-05-15T14:39:08.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.706+0000 7f55aa011800 20 add_watcher() i=3 2024-05-15T14:39:08.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.706+0000 7f55aa011800 20 add_watcher() i=4 2024-05-15T14:39:08.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.706+0000 7f55aa011800 20 add_watcher() i=5 2024-05-15T14:39:08.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.706+0000 7f55aa011800 20 add_watcher() i=6 2024-05-15T14:39:08.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.707+0000 7f55aa011800 20 add_watcher() i=7 2024-05-15T14:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.707+0000 7f55aa011800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.709+0000 7f545bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.709+0000 7f55aa011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.709+0000 7f55aa011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.709+0000 7f55aa011800 5 note: GC not initialized 2024-05-15T14:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.709+0000 7f545afe5640 20 reqs_thread_entry: start 2024-05-15T14:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.710+0000 7f55aa011800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:08.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.710+0000 7f55aa011800 20 Filter name: none 2024-05-15T14:39:08.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.710+0000 7f5458fe1640 20 reqs_thread_entry: start 2024-05-15T14:39:08.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.710+0000 7f55aa011800 20 rados->read ofs=0 len=0 2024-05-15T14:39:08.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.711+0000 7f55aa011800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:08.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.712+0000 7f545bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.714+0000 7f55aa011800 20 remove_watcher() i=0 2024-05-15T14:39:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.714+0000 7f55aa011800 2 removed watcher, disabling cache 2024-05-15T14:39:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.715+0000 7f55aa011800 20 remove_watcher() i=1 2024-05-15T14:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.716+0000 7f55aa011800 20 remove_watcher() i=2 2024-05-15T14:39:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.717+0000 7f55aa011800 20 remove_watcher() i=3 2024-05-15T14:39:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.718+0000 7f55aa011800 20 remove_watcher() i=4 2024-05-15T14:39:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.719+0000 7f55aa011800 20 remove_watcher() i=5 2024-05-15T14:39:08.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.720+0000 7f55aa011800 20 remove_watcher() i=6 2024-05-15T14:39:08.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:08.721+0000 7f55aa011800 20 remove_watcher() i=7 2024-05-15T14:39:13.786 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:13.787 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.829+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.831+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:13.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.831+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.831+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:13.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.831+0000 7f3153344800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:13.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.831+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.832+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:13.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.832+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.833+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:13.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.833+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.833+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:13.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.833+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.833+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:13.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.833+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.834+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:13.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.834+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.834+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:13.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.834+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:13.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 20 zone MyZone found 2024-05-15T14:39:13.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:13.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:13.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.835+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.836+0000 7f3153344800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.836+0000 7f3153344800 20 started sync module instance, tier type = 2024-05-15T14:39:13.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.836+0000 7f3153344800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.846+0000 7f3153344800 20 add_watcher() i=0 2024-05-15T14:39:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.846+0000 7f3153344800 20 add_watcher() i=1 2024-05-15T14:39:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.846+0000 7f3153344800 20 add_watcher() i=2 2024-05-15T14:39:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.846+0000 7f3153344800 20 add_watcher() i=3 2024-05-15T14:39:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.846+0000 7f3153344800 20 add_watcher() i=4 2024-05-15T14:39:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.846+0000 7f3153344800 20 add_watcher() i=5 2024-05-15T14:39:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.846+0000 7f3153344800 20 add_watcher() i=6 2024-05-15T14:39:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.848+0000 7f3153344800 20 add_watcher() i=7 2024-05-15T14:39:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.848+0000 7f3153344800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.849+0000 7f30077de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.849+0000 7f3153344800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.849+0000 7f3153344800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.849+0000 7f3153344800 5 note: GC not initialized 2024-05-15T14:39:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.850+0000 7f30067dc640 20 reqs_thread_entry: start 2024-05-15T14:39:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.850+0000 7f3153344800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.850+0000 7f3153344800 20 Filter name: none 2024-05-15T14:39:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.850+0000 7f2f77fff640 20 reqs_thread_entry: start 2024-05-15T14:39:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.850+0000 7f3153344800 20 rados->read ofs=0 len=0 2024-05-15T14:39:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.851+0000 7f3153344800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.853+0000 7f30077de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:13.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.855+0000 7f3153344800 20 remove_watcher() i=0 2024-05-15T14:39:13.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.855+0000 7f3153344800 2 removed watcher, disabling cache 2024-05-15T14:39:13.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.856+0000 7f3153344800 20 remove_watcher() i=1 2024-05-15T14:39:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.857+0000 7f3153344800 20 remove_watcher() i=2 2024-05-15T14:39:13.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.858+0000 7f3153344800 20 remove_watcher() i=3 2024-05-15T14:39:13.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.859+0000 7f3153344800 20 remove_watcher() i=4 2024-05-15T14:39:13.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.860+0000 7f3153344800 20 remove_watcher() i=5 2024-05-15T14:39:13.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.861+0000 7f3153344800 20 remove_watcher() i=6 2024-05-15T14:39:13.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:13.862+0000 7f3153344800 20 remove_watcher() i=7 2024-05-15T14:39:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:18.934 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.976+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.979+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:18.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.979+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.980+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:18.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.980+0000 7f29bbd36800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:18.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.980+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.980+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:18.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.980+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.981+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:18.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.981+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.981+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:18.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.981+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.982+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:18.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.982+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.982+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:18.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.982+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.983+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.983+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 zone MyZone found 2024-05-15T14:39:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 started sync module instance, tier type = 2024-05-15T14:39:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.984+0000 7f29bbd36800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:18.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.995+0000 7f29bbd36800 20 add_watcher() i=0 2024-05-15T14:39:18.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.995+0000 7f29bbd36800 20 add_watcher() i=1 2024-05-15T14:39:18.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.995+0000 7f29bbd36800 20 add_watcher() i=2 2024-05-15T14:39:18.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.995+0000 7f29bbd36800 20 add_watcher() i=3 2024-05-15T14:39:18.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.995+0000 7f29bbd36800 20 add_watcher() i=4 2024-05-15T14:39:18.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.995+0000 7f29bbd36800 20 add_watcher() i=5 2024-05-15T14:39:18.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.995+0000 7f29bbd36800 20 add_watcher() i=6 2024-05-15T14:39:18.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.996+0000 7f29bbd36800 20 add_watcher() i=7 2024-05-15T14:39:18.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.996+0000 7f29bbd36800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.998+0000 7f286dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:19.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.998+0000 7f29bbd36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:19.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.998+0000 7f29bbd36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.998+0000 7f29bbd36800 5 note: GC not initialized 2024-05-15T14:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.998+0000 7f286cfe1640 20 reqs_thread_entry: start 2024-05-15T14:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.999+0000 7f29bbd36800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.999+0000 7f29bbd36800 20 Filter name: none 2024-05-15T14:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.999+0000 7f27e67fc640 20 reqs_thread_entry: start 2024-05-15T14:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:18.999+0000 7f29bbd36800 20 rados->read ofs=0 len=0 2024-05-15T14:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.000+0000 7f29bbd36800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:19.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.001+0000 7f286dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.004+0000 7f29bbd36800 20 remove_watcher() i=0 2024-05-15T14:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.004+0000 7f29bbd36800 2 removed watcher, disabling cache 2024-05-15T14:39:19.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.005+0000 7f29bbd36800 20 remove_watcher() i=1 2024-05-15T14:39:19.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.006+0000 7f29bbd36800 20 remove_watcher() i=2 2024-05-15T14:39:19.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.006+0000 7f29bbd36800 20 remove_watcher() i=3 2024-05-15T14:39:19.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.007+0000 7f29bbd36800 20 remove_watcher() i=4 2024-05-15T14:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.009+0000 7f29bbd36800 20 remove_watcher() i=5 2024-05-15T14:39:19.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.010+0000 7f29bbd36800 20 remove_watcher() i=6 2024-05-15T14:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:19.011+0000 7f29bbd36800 20 remove_watcher() i=7 2024-05-15T14:39:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:24.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.118+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.120+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:24.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.120+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.121+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:24.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.121+0000 7f547d946800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:24.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.121+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.121+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:24.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.121+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.122+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:24.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.122+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.123+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.123+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.123+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.123+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.123+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.123+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.124+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.124+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 20 zone MyZone found 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:24.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.125+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.126+0000 7f547d946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:24.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.126+0000 7f547d946800 20 started sync module instance, tier type = 2024-05-15T14:39:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.126+0000 7f547d946800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.136+0000 7f547d946800 20 add_watcher() i=0 2024-05-15T14:39:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.136+0000 7f547d946800 20 add_watcher() i=1 2024-05-15T14:39:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.136+0000 7f547d946800 20 add_watcher() i=2 2024-05-15T14:39:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.136+0000 7f547d946800 20 add_watcher() i=3 2024-05-15T14:39:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.136+0000 7f547d946800 20 add_watcher() i=4 2024-05-15T14:39:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.136+0000 7f547d946800 20 add_watcher() i=5 2024-05-15T14:39:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.136+0000 7f547d946800 20 add_watcher() i=6 2024-05-15T14:39:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.137+0000 7f547d946800 20 add_watcher() i=7 2024-05-15T14:39:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.137+0000 7f547d946800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:24.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.139+0000 7f5331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:24.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.139+0000 7f547d946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:24.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.139+0000 7f547d946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:24.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.139+0000 7f547d946800 5 note: GC not initialized 2024-05-15T14:39:24.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.139+0000 7f5330fe1640 20 reqs_thread_entry: start 2024-05-15T14:39:24.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.139+0000 7f547d946800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:24.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.139+0000 7f547d946800 20 Filter name: none 2024-05-15T14:39:24.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.140+0000 7f52aa7fc640 20 reqs_thread_entry: start 2024-05-15T14:39:24.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.140+0000 7f547d946800 20 rados->read ofs=0 len=0 2024-05-15T14:39:24.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.140+0000 7f547d946800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:24.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.142+0000 7f5331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:24.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.144+0000 7f547d946800 20 remove_watcher() i=0 2024-05-15T14:39:24.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.144+0000 7f547d946800 2 removed watcher, disabling cache 2024-05-15T14:39:24.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.145+0000 7f547d946800 20 remove_watcher() i=1 2024-05-15T14:39:24.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.146+0000 7f547d946800 20 remove_watcher() i=2 2024-05-15T14:39:24.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.147+0000 7f547d946800 20 remove_watcher() i=3 2024-05-15T14:39:24.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.148+0000 7f547d946800 20 remove_watcher() i=4 2024-05-15T14:39:24.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.149+0000 7f547d946800 20 remove_watcher() i=5 2024-05-15T14:39:24.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.150+0000 7f547d946800 20 remove_watcher() i=6 2024-05-15T14:39:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:24.151+0000 7f547d946800 20 remove_watcher() i=7 2024-05-15T14:39:29.214 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:29.214 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:29.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.260+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.262+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:29.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.262+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.263+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:29.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.263+0000 7f2703328800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:29.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.263+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.263+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:29.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.263+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.264+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:29.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.264+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.264+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:29.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.264+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.265+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:29.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.265+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.265+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:29.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.265+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:29.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 20 zone MyZone found 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.266+0000 7f2703328800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.267+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.267+0000 7f2703328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.267+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.267+0000 7f2703328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.267+0000 7f2703328800 20 started sync module instance, tier type = 2024-05-15T14:39:29.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.267+0000 7f2703328800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:29.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 20 add_watcher() i=0 2024-05-15T14:39:29.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 20 add_watcher() i=1 2024-05-15T14:39:29.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 20 add_watcher() i=2 2024-05-15T14:39:29.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 20 add_watcher() i=3 2024-05-15T14:39:29.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 20 add_watcher() i=4 2024-05-15T14:39:29.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 20 add_watcher() i=5 2024-05-15T14:39:29.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 20 add_watcher() i=6 2024-05-15T14:39:29.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 20 add_watcher() i=7 2024-05-15T14:39:29.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.279+0000 7f2703328800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:29.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.281+0000 7f25b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:29.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.281+0000 7f2703328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:29.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.281+0000 7f2703328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:29.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.281+0000 7f2703328800 5 note: GC not initialized 2024-05-15T14:39:29.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.282+0000 7f252ffff640 20 reqs_thread_entry: start 2024-05-15T14:39:29.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.282+0000 7f2703328800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:29.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.282+0000 7f2703328800 20 Filter name: none 2024-05-15T14:39:29.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.282+0000 7f252dffb640 20 reqs_thread_entry: start 2024-05-15T14:39:29.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.282+0000 7f2703328800 20 rados->read ofs=0 len=0 2024-05-15T14:39:29.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.283+0000 7f2703328800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:29.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.284+0000 7f25b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:29.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.286+0000 7f2703328800 20 remove_watcher() i=0 2024-05-15T14:39:29.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.286+0000 7f2703328800 2 removed watcher, disabling cache 2024-05-15T14:39:29.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.287+0000 7f2703328800 20 remove_watcher() i=1 2024-05-15T14:39:29.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.288+0000 7f2703328800 20 remove_watcher() i=2 2024-05-15T14:39:29.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.289+0000 7f2703328800 20 remove_watcher() i=3 2024-05-15T14:39:29.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.290+0000 7f2703328800 20 remove_watcher() i=4 2024-05-15T14:39:29.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.291+0000 7f2703328800 20 remove_watcher() i=5 2024-05-15T14:39:29.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.292+0000 7f2703328800 20 remove_watcher() i=6 2024-05-15T14:39:29.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:29.293+0000 7f2703328800 20 remove_watcher() i=7 2024-05-15T14:39:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:34.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.402+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.404+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:34.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.404+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.405+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.405+0000 7fc14ca87800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.405+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.405+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.405+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.406+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.406+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.406+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.406+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.406+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.406+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.407+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.407+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.407+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.407+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 20 zone MyZone found 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.408+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.409+0000 7fc14ca87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.409+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.409+0000 7fc14ca87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:34.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.409+0000 7fc14ca87800 20 started sync module instance, tier type = 2024-05-15T14:39:34.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.409+0000 7fc14ca87800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.420+0000 7fc14ca87800 20 add_watcher() i=0 2024-05-15T14:39:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.420+0000 7fc14ca87800 20 add_watcher() i=1 2024-05-15T14:39:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.420+0000 7fc14ca87800 20 add_watcher() i=2 2024-05-15T14:39:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.420+0000 7fc14ca87800 20 add_watcher() i=3 2024-05-15T14:39:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.420+0000 7fc14ca87800 20 add_watcher() i=4 2024-05-15T14:39:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.420+0000 7fc14ca87800 20 add_watcher() i=5 2024-05-15T14:39:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.420+0000 7fc14ca87800 20 add_watcher() i=6 2024-05-15T14:39:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.421+0000 7fc14ca87800 20 add_watcher() i=7 2024-05-15T14:39:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.421+0000 7fc14ca87800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:34.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.423+0000 7fc000fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.423+0000 7fc14ca87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.423+0000 7fc14ca87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.424+0000 7fc14ca87800 5 note: GC not initialized 2024-05-15T14:39:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.424+0000 7fbf7b7fe640 20 reqs_thread_entry: start 2024-05-15T14:39:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.424+0000 7fc14ca87800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.424+0000 7fc14ca87800 20 Filter name: none 2024-05-15T14:39:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.424+0000 7fbf797fa640 20 reqs_thread_entry: start 2024-05-15T14:39:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.424+0000 7fc14ca87800 20 rados->read ofs=0 len=0 2024-05-15T14:39:34.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.425+0000 7fc14ca87800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:34.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.426+0000 7fc000fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:34.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.429+0000 7fc14ca87800 20 remove_watcher() i=0 2024-05-15T14:39:34.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.429+0000 7fc14ca87800 2 removed watcher, disabling cache 2024-05-15T14:39:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.430+0000 7fc14ca87800 20 remove_watcher() i=1 2024-05-15T14:39:34.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.431+0000 7fc14ca87800 20 remove_watcher() i=2 2024-05-15T14:39:34.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.432+0000 7fc14ca87800 20 remove_watcher() i=3 2024-05-15T14:39:34.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.433+0000 7fc14ca87800 20 remove_watcher() i=4 2024-05-15T14:39:34.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.434+0000 7fc14ca87800 20 remove_watcher() i=5 2024-05-15T14:39:34.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.435+0000 7fc14ca87800 20 remove_watcher() i=6 2024-05-15T14:39:34.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:34.436+0000 7fc14ca87800 20 remove_watcher() i=7 2024-05-15T14:39:39.502 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:39.502 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:39.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.545+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.547+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.547+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.547+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:39.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.547+0000 7f6b01f1f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:39.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.547+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.548+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:39.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.548+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.549+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:39.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.549+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.549+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.549+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.549+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.549+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.550+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.550+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.550+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:39.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.550+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:39.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 20 zone MyZone found 2024-05-15T14:39:39.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:39.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.551+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.552+0000 7f6b01f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.552+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.552+0000 7f6b01f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.552+0000 7f6b01f1f800 20 started sync module instance, tier type = 2024-05-15T14:39:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.552+0000 7f6b01f1f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.563+0000 7f6b01f1f800 20 add_watcher() i=0 2024-05-15T14:39:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.563+0000 7f6b01f1f800 20 add_watcher() i=1 2024-05-15T14:39:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.563+0000 7f6b01f1f800 20 add_watcher() i=2 2024-05-15T14:39:39.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.563+0000 7f6b01f1f800 20 add_watcher() i=3 2024-05-15T14:39:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.563+0000 7f6b01f1f800 20 add_watcher() i=4 2024-05-15T14:39:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.563+0000 7f6b01f1f800 20 add_watcher() i=5 2024-05-15T14:39:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.563+0000 7f6b01f1f800 20 add_watcher() i=6 2024-05-15T14:39:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.564+0000 7f6b01f1f800 20 add_watcher() i=7 2024-05-15T14:39:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.564+0000 7f6b01f1f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.565+0000 7f69af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.566+0000 7f6b01f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.566+0000 7f6b01f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.566+0000 7f6b01f1f800 5 note: GC not initialized 2024-05-15T14:39:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.566+0000 7f69ae7fc640 20 reqs_thread_entry: start 2024-05-15T14:39:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.566+0000 7f6b01f1f800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.566+0000 7f6b01f1f800 20 Filter name: none 2024-05-15T14:39:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.566+0000 7f691ffff640 20 reqs_thread_entry: start 2024-05-15T14:39:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.567+0000 7f6b01f1f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.567+0000 7f6b01f1f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.569+0000 7f69af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.570+0000 7f6b01f1f800 20 remove_watcher() i=0 2024-05-15T14:39:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.570+0000 7f6b01f1f800 2 removed watcher, disabling cache 2024-05-15T14:39:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.571+0000 7f6b01f1f800 20 remove_watcher() i=1 2024-05-15T14:39:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.573+0000 7f6b01f1f800 20 remove_watcher() i=2 2024-05-15T14:39:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.574+0000 7f6b01f1f800 20 remove_watcher() i=3 2024-05-15T14:39:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.575+0000 7f6b01f1f800 20 remove_watcher() i=4 2024-05-15T14:39:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.576+0000 7f6b01f1f800 20 remove_watcher() i=5 2024-05-15T14:39:39.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.577+0000 7f6b01f1f800 20 remove_watcher() i=6 2024-05-15T14:39:39.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:39.578+0000 7f6b01f1f800 20 remove_watcher() i=7 2024-05-15T14:39:44.643 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:44.643 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:44.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.686+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.689+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:44.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.689+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.690+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.690+0000 7faa07723800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.690+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.690+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.690+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.691+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.691+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.691+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.691+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.692+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.692+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.692+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:44.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.692+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:44.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 20 zone MyZone found 2024-05-15T14:39:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.693+0000 7faa07723800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.694+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.694+0000 7faa07723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.694+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.694+0000 7faa07723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.694+0000 7faa07723800 20 started sync module instance, tier type = 2024-05-15T14:39:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.694+0000 7faa07723800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:44.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.704+0000 7faa07723800 20 add_watcher() i=0 2024-05-15T14:39:44.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.704+0000 7faa07723800 20 add_watcher() i=1 2024-05-15T14:39:44.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.704+0000 7faa07723800 20 add_watcher() i=2 2024-05-15T14:39:44.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.704+0000 7faa07723800 20 add_watcher() i=3 2024-05-15T14:39:44.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.704+0000 7faa07723800 20 add_watcher() i=4 2024-05-15T14:39:44.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.704+0000 7faa07723800 20 add_watcher() i=5 2024-05-15T14:39:44.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.704+0000 7faa07723800 20 add_watcher() i=6 2024-05-15T14:39:44.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.706+0000 7faa07723800 20 add_watcher() i=7 2024-05-15T14:39:44.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.706+0000 7faa07723800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:44.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.707+0000 7fa8b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.708+0000 7faa07723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.708+0000 7faa07723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.708+0000 7faa07723800 5 note: GC not initialized 2024-05-15T14:39:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.708+0000 7fa8b8fe1640 20 reqs_thread_entry: start 2024-05-15T14:39:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.708+0000 7faa07723800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.708+0000 7faa07723800 20 Filter name: none 2024-05-15T14:39:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.708+0000 7fa8327fc640 20 reqs_thread_entry: start 2024-05-15T14:39:44.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.708+0000 7faa07723800 20 rados->read ofs=0 len=0 2024-05-15T14:39:44.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.709+0000 7faa07723800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:44.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.711+0000 7fa8b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.713+0000 7faa07723800 20 remove_watcher() i=0 2024-05-15T14:39:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.713+0000 7faa07723800 2 removed watcher, disabling cache 2024-05-15T14:39:44.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.714+0000 7faa07723800 20 remove_watcher() i=1 2024-05-15T14:39:44.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.714+0000 7faa07723800 20 remove_watcher() i=2 2024-05-15T14:39:44.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.715+0000 7faa07723800 20 remove_watcher() i=3 2024-05-15T14:39:44.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.716+0000 7faa07723800 20 remove_watcher() i=4 2024-05-15T14:39:44.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.718+0000 7faa07723800 20 remove_watcher() i=5 2024-05-15T14:39:44.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.719+0000 7faa07723800 20 remove_watcher() i=6 2024-05-15T14:39:44.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:44.720+0000 7faa07723800 20 remove_watcher() i=7 2024-05-15T14:39:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:49.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.826+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.828+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:49.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.828+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.829+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:49.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.829+0000 7f7248fa2800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:49.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.829+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.829+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:49.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.829+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.830+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:49.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.830+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.830+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:49.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.830+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.831+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:49.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.831+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.831+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:49.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.831+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.832+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:49.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.832+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 zone MyZone found 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 started sync module instance, tier type = 2024-05-15T14:39:49.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.833+0000 7f7248fa2800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.844+0000 7f7248fa2800 20 add_watcher() i=0 2024-05-15T14:39:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.844+0000 7f7248fa2800 20 add_watcher() i=1 2024-05-15T14:39:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.844+0000 7f7248fa2800 20 add_watcher() i=2 2024-05-15T14:39:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.844+0000 7f7248fa2800 20 add_watcher() i=3 2024-05-15T14:39:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.844+0000 7f7248fa2800 20 add_watcher() i=4 2024-05-15T14:39:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.844+0000 7f7248fa2800 20 add_watcher() i=5 2024-05-15T14:39:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.844+0000 7f7248fa2800 20 add_watcher() i=6 2024-05-15T14:39:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.845+0000 7f7248fa2800 20 add_watcher() i=7 2024-05-15T14:39:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.845+0000 7f7248fa2800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:49.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.846+0000 7f70fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.847+0000 7f7248fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.847+0000 7f7248fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.847+0000 7f7248fa2800 5 note: GC not initialized 2024-05-15T14:39:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.847+0000 7f7077fff640 20 reqs_thread_entry: start 2024-05-15T14:39:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.847+0000 7f7248fa2800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.847+0000 7f7248fa2800 20 Filter name: none 2024-05-15T14:39:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.847+0000 7f7075ffb640 20 reqs_thread_entry: start 2024-05-15T14:39:49.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.848+0000 7f7248fa2800 20 rados->read ofs=0 len=0 2024-05-15T14:39:49.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.848+0000 7f7248fa2800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:49.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.850+0000 7f70fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:49.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.852+0000 7f7248fa2800 20 remove_watcher() i=0 2024-05-15T14:39:49.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.852+0000 7f7248fa2800 2 removed watcher, disabling cache 2024-05-15T14:39:49.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.853+0000 7f7248fa2800 20 remove_watcher() i=1 2024-05-15T14:39:49.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.854+0000 7f7248fa2800 20 remove_watcher() i=2 2024-05-15T14:39:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.855+0000 7f7248fa2800 20 remove_watcher() i=3 2024-05-15T14:39:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.856+0000 7f7248fa2800 20 remove_watcher() i=4 2024-05-15T14:39:49.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.857+0000 7f7248fa2800 20 remove_watcher() i=5 2024-05-15T14:39:49.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.858+0000 7f7248fa2800 20 remove_watcher() i=6 2024-05-15T14:39:49.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:49.860+0000 7f7248fa2800 20 remove_watcher() i=7 2024-05-15T14:39:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:39:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:39:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.968+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.970+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:54.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.970+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.971+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.971+0000 7fb230b2f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:39:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.971+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.971+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.971+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.972+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:39:54.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.972+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.972+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:39:54.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.972+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.973+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.973+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.973+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:39:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.973+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.974+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:39:54.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.974+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 20 zone MyZone found 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:39:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:54.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.975+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.976+0000 7fb230b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:39:54.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.976+0000 7fb230b2f800 20 started sync module instance, tier type = 2024-05-15T14:39:54.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.976+0000 7fb230b2f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:39:54.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.986+0000 7fb230b2f800 20 add_watcher() i=0 2024-05-15T14:39:54.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.986+0000 7fb230b2f800 20 add_watcher() i=1 2024-05-15T14:39:54.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.986+0000 7fb230b2f800 20 add_watcher() i=2 2024-05-15T14:39:54.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.986+0000 7fb230b2f800 20 add_watcher() i=3 2024-05-15T14:39:54.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.986+0000 7fb230b2f800 20 add_watcher() i=4 2024-05-15T14:39:54.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.986+0000 7fb230b2f800 20 add_watcher() i=5 2024-05-15T14:39:54.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.986+0000 7fb230b2f800 20 add_watcher() i=6 2024-05-15T14:39:54.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.987+0000 7fb230b2f800 20 add_watcher() i=7 2024-05-15T14:39:54.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.987+0000 7fb230b2f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:39:54.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.989+0000 7fb0e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:54.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.989+0000 7fb230b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:39:54.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.989+0000 7fb230b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:39:54.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.989+0000 7fb230b2f800 5 note: GC not initialized 2024-05-15T14:39:54.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.990+0000 7fb0e1fe3640 20 reqs_thread_entry: start 2024-05-15T14:39:54.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.990+0000 7fb230b2f800 20 init_complete bucket index max shards: 11 2024-05-15T14:39:54.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.990+0000 7fb230b2f800 20 Filter name: none 2024-05-15T14:39:54.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.990+0000 7fb0537fe640 20 reqs_thread_entry: start 2024-05-15T14:39:54.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.990+0000 7fb230b2f800 20 rados->read ofs=0 len=0 2024-05-15T14:39:54.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.991+0000 7fb230b2f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:39:54.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.993+0000 7fb0e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:39:54.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.995+0000 7fb230b2f800 20 remove_watcher() i=0 2024-05-15T14:39:54.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.995+0000 7fb230b2f800 2 removed watcher, disabling cache 2024-05-15T14:39:54.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.996+0000 7fb230b2f800 20 remove_watcher() i=1 2024-05-15T14:39:54.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.997+0000 7fb230b2f800 20 remove_watcher() i=2 2024-05-15T14:39:54.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.998+0000 7fb230b2f800 20 remove_watcher() i=3 2024-05-15T14:39:54.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:54.998+0000 7fb230b2f800 20 remove_watcher() i=4 2024-05-15T14:39:55.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:55.000+0000 7fb230b2f800 20 remove_watcher() i=5 2024-05-15T14:39:55.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:55.000+0000 7fb230b2f800 20 remove_watcher() i=6 2024-05-15T14:39:55.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:39:55.002+0000 7fb230b2f800 20 remove_watcher() i=7 2024-05-15T14:40:00.068 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:00.068 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:00.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.111+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.113+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:00.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.113+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.113+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:00.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.113+0000 7f21a1d33800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:00.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.113+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.114+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:00.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.114+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.114+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:00.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.114+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.115+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:00.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.115+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.115+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:00.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.115+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.115+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:00.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.115+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.116+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:00.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.116+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 20 zone MyZone found 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:00.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:00.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.117+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.118+0000 7f21a1d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:00.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.118+0000 7f21a1d33800 20 started sync module instance, tier type = 2024-05-15T14:40:00.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.118+0000 7f21a1d33800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:00.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.128+0000 7f21a1d33800 20 add_watcher() i=0 2024-05-15T14:40:00.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.128+0000 7f21a1d33800 20 add_watcher() i=1 2024-05-15T14:40:00.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.128+0000 7f21a1d33800 20 add_watcher() i=2 2024-05-15T14:40:00.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.128+0000 7f21a1d33800 20 add_watcher() i=3 2024-05-15T14:40:00.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.128+0000 7f21a1d33800 20 add_watcher() i=4 2024-05-15T14:40:00.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.128+0000 7f21a1d33800 20 add_watcher() i=5 2024-05-15T14:40:00.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.128+0000 7f21a1d33800 20 add_watcher() i=6 2024-05-15T14:40:00.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.129+0000 7f21a1d33800 20 add_watcher() i=7 2024-05-15T14:40:00.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.129+0000 7f21a1d33800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:00.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.131+0000 7f204f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:00.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.131+0000 7f21a1d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:00.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.131+0000 7f21a1d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:00.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.131+0000 7f21a1d33800 5 note: GC not initialized 2024-05-15T14:40:00.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.131+0000 7f204e7fc640 20 reqs_thread_entry: start 2024-05-15T14:40:00.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.132+0000 7f21a1d33800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:00.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.132+0000 7f21a1d33800 20 Filter name: none 2024-05-15T14:40:00.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.132+0000 7f1fbffff640 20 reqs_thread_entry: start 2024-05-15T14:40:00.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.132+0000 7f21a1d33800 20 rados->read ofs=0 len=0 2024-05-15T14:40:00.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.133+0000 7f21a1d33800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:00.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.134+0000 7f204f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:00.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.136+0000 7f21a1d33800 20 remove_watcher() i=0 2024-05-15T14:40:00.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.136+0000 7f21a1d33800 2 removed watcher, disabling cache 2024-05-15T14:40:00.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.137+0000 7f21a1d33800 20 remove_watcher() i=1 2024-05-15T14:40:00.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.138+0000 7f21a1d33800 20 remove_watcher() i=2 2024-05-15T14:40:00.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.139+0000 7f21a1d33800 20 remove_watcher() i=3 2024-05-15T14:40:00.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.140+0000 7f21a1d33800 20 remove_watcher() i=4 2024-05-15T14:40:00.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.141+0000 7f21a1d33800 20 remove_watcher() i=5 2024-05-15T14:40:00.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.142+0000 7f21a1d33800 20 remove_watcher() i=6 2024-05-15T14:40:00.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:00.143+0000 7f21a1d33800 20 remove_watcher() i=7 2024-05-15T14:40:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.256+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.258+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:05.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.258+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.258+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.258+0000 7f3b3ef1f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.258+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.259+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.259+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.260+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.260+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.260+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.260+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.260+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.260+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.261+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.261+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.261+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.261+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 20 zone MyZone found 2024-05-15T14:40:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.262+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.263+0000 7f3b3ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.263+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.263+0000 7f3b3ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.263+0000 7f3b3ef1f800 20 started sync module instance, tier type = 2024-05-15T14:40:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.263+0000 7f3b3ef1f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.274+0000 7f3b3ef1f800 20 add_watcher() i=0 2024-05-15T14:40:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.274+0000 7f3b3ef1f800 20 add_watcher() i=1 2024-05-15T14:40:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.274+0000 7f3b3ef1f800 20 add_watcher() i=2 2024-05-15T14:40:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.274+0000 7f3b3ef1f800 20 add_watcher() i=3 2024-05-15T14:40:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.274+0000 7f3b3ef1f800 20 add_watcher() i=4 2024-05-15T14:40:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.274+0000 7f3b3ef1f800 20 add_watcher() i=5 2024-05-15T14:40:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.274+0000 7f3b3ef1f800 20 add_watcher() i=6 2024-05-15T14:40:05.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.275+0000 7f3b3ef1f800 20 add_watcher() i=7 2024-05-15T14:40:05.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.275+0000 7f3b3ef1f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:05.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.277+0000 7f39f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:05.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.277+0000 7f3b3ef1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:05.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.277+0000 7f3b3ef1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:05.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.277+0000 7f3b3ef1f800 5 note: GC not initialized 2024-05-15T14:40:05.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.277+0000 7f396bfff640 20 reqs_thread_entry: start 2024-05-15T14:40:05.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.277+0000 7f3b3ef1f800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.278+0000 7f3b3ef1f800 20 Filter name: none 2024-05-15T14:40:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.278+0000 7f3969ffb640 20 reqs_thread_entry: start 2024-05-15T14:40:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.278+0000 7f3b3ef1f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.278+0000 7f3b3ef1f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.280+0000 7f39f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:05.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.282+0000 7f3b3ef1f800 20 remove_watcher() i=0 2024-05-15T14:40:05.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.282+0000 7f3b3ef1f800 2 removed watcher, disabling cache 2024-05-15T14:40:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.283+0000 7f3b3ef1f800 20 remove_watcher() i=1 2024-05-15T14:40:05.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.284+0000 7f3b3ef1f800 20 remove_watcher() i=2 2024-05-15T14:40:05.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.285+0000 7f3b3ef1f800 20 remove_watcher() i=3 2024-05-15T14:40:05.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.286+0000 7f3b3ef1f800 20 remove_watcher() i=4 2024-05-15T14:40:05.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.287+0000 7f3b3ef1f800 20 remove_watcher() i=5 2024-05-15T14:40:05.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.288+0000 7f3b3ef1f800 20 remove_watcher() i=6 2024-05-15T14:40:05.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:05.289+0000 7f3b3ef1f800 20 remove_watcher() i=7 2024-05-15T14:40:10.351 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:10.351 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.393+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.395+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:10.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.395+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.395+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.395+0000 7fe7b1325800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.395+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.396+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.396+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.396+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.396+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.397+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.397+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.397+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.397+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.397+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.397+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.398+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.398+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 20 zone MyZone found 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.399+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.400+0000 7fe7b1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.400+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.400+0000 7fe7b1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.400+0000 7fe7b1325800 20 started sync module instance, tier type = 2024-05-15T14:40:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.400+0000 7fe7b1325800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.411+0000 7fe7b1325800 20 add_watcher() i=0 2024-05-15T14:40:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.411+0000 7fe7b1325800 20 add_watcher() i=1 2024-05-15T14:40:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.411+0000 7fe7b1325800 20 add_watcher() i=2 2024-05-15T14:40:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.411+0000 7fe7b1325800 20 add_watcher() i=3 2024-05-15T14:40:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.411+0000 7fe7b1325800 20 add_watcher() i=4 2024-05-15T14:40:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.411+0000 7fe7b1325800 20 add_watcher() i=5 2024-05-15T14:40:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.411+0000 7fe7b1325800 20 add_watcher() i=6 2024-05-15T14:40:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.412+0000 7fe7b1325800 20 add_watcher() i=7 2024-05-15T14:40:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.412+0000 7fe7b1325800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:10.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.413+0000 7fe6637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.414+0000 7fe7b1325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.414+0000 7fe7b1325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.414+0000 7fe7b1325800 5 note: GC not initialized 2024-05-15T14:40:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.414+0000 7fe6627e4640 20 reqs_thread_entry: start 2024-05-15T14:40:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.414+0000 7fe7b1325800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.414+0000 7fe7b1325800 20 Filter name: none 2024-05-15T14:40:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.414+0000 7fe5d3fff640 20 reqs_thread_entry: start 2024-05-15T14:40:10.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.414+0000 7fe7b1325800 20 rados->read ofs=0 len=0 2024-05-15T14:40:10.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.415+0000 7fe7b1325800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:10.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.417+0000 7fe6637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.419+0000 7fe7b1325800 20 remove_watcher() i=0 2024-05-15T14:40:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.419+0000 7fe7b1325800 2 removed watcher, disabling cache 2024-05-15T14:40:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.420+0000 7fe7b1325800 20 remove_watcher() i=1 2024-05-15T14:40:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.421+0000 7fe7b1325800 20 remove_watcher() i=2 2024-05-15T14:40:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.422+0000 7fe7b1325800 20 remove_watcher() i=3 2024-05-15T14:40:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.423+0000 7fe7b1325800 20 remove_watcher() i=4 2024-05-15T14:40:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.424+0000 7fe7b1325800 20 remove_watcher() i=5 2024-05-15T14:40:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.425+0000 7fe7b1325800 20 remove_watcher() i=6 2024-05-15T14:40:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:10.426+0000 7fe7b1325800 20 remove_watcher() i=7 2024-05-15T14:40:15.489 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:15.489 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:15.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.533+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.535+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:15.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.535+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.535+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.536+0000 7fbf24331800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.536+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.536+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.536+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.536+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:15.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.536+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.537+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:15.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.537+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.537+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:15.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.537+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.537+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:15.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.537+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.538+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:15.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.538+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 20 zone MyZone found 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.539+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.540+0000 7fbf24331800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.540+0000 7fbf24331800 20 started sync module instance, tier type = 2024-05-15T14:40:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.540+0000 7fbf24331800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:15.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.550+0000 7fbf24331800 20 add_watcher() i=0 2024-05-15T14:40:15.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.550+0000 7fbf24331800 20 add_watcher() i=1 2024-05-15T14:40:15.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.550+0000 7fbf24331800 20 add_watcher() i=2 2024-05-15T14:40:15.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.550+0000 7fbf24331800 20 add_watcher() i=3 2024-05-15T14:40:15.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.550+0000 7fbf24331800 20 add_watcher() i=4 2024-05-15T14:40:15.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.550+0000 7fbf24331800 20 add_watcher() i=5 2024-05-15T14:40:15.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.550+0000 7fbf24331800 20 add_watcher() i=6 2024-05-15T14:40:15.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.551+0000 7fbf24331800 20 add_watcher() i=7 2024-05-15T14:40:15.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.551+0000 7fbf24331800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:15.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.553+0000 7fbdd67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:15.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.553+0000 7fbf24331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:15.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.553+0000 7fbf24331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:15.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.553+0000 7fbf24331800 5 note: GC not initialized 2024-05-15T14:40:15.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.553+0000 7fbdd57e2640 20 reqs_thread_entry: start 2024-05-15T14:40:15.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.553+0000 7fbf24331800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:15.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.554+0000 7fbf24331800 20 Filter name: none 2024-05-15T14:40:15.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.554+0000 7fbd46ffd640 20 reqs_thread_entry: start 2024-05-15T14:40:15.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.554+0000 7fbf24331800 20 rados->read ofs=0 len=0 2024-05-15T14:40:15.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.554+0000 7fbf24331800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:15.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.556+0000 7fbdd67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.558+0000 7fbf24331800 20 remove_watcher() i=0 2024-05-15T14:40:15.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.558+0000 7fbf24331800 2 removed watcher, disabling cache 2024-05-15T14:40:15.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.559+0000 7fbf24331800 20 remove_watcher() i=1 2024-05-15T14:40:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.560+0000 7fbf24331800 20 remove_watcher() i=2 2024-05-15T14:40:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.561+0000 7fbf24331800 20 remove_watcher() i=3 2024-05-15T14:40:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.562+0000 7fbf24331800 20 remove_watcher() i=4 2024-05-15T14:40:15.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.563+0000 7fbf24331800 20 remove_watcher() i=5 2024-05-15T14:40:15.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.564+0000 7fbf24331800 20 remove_watcher() i=6 2024-05-15T14:40:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:15.565+0000 7fbf24331800 20 remove_watcher() i=7 2024-05-15T14:40:20.631 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:20.631 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:20.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.676+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.678+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:20.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.678+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.679+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.679+0000 7f8b3f975800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.679+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.679+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.679+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.680+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.680+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.680+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.681+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.681+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:20.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.681+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.681+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:20.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.681+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.682+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:20.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.682+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 20 zone MyZone found 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.683+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.684+0000 7f8b3f975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.684+0000 7f8b3f975800 20 started sync module instance, tier type = 2024-05-15T14:40:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.684+0000 7f8b3f975800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.695+0000 7f8b3f975800 20 add_watcher() i=0 2024-05-15T14:40:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.695+0000 7f8b3f975800 20 add_watcher() i=1 2024-05-15T14:40:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.695+0000 7f8b3f975800 20 add_watcher() i=2 2024-05-15T14:40:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.695+0000 7f8b3f975800 20 add_watcher() i=3 2024-05-15T14:40:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.695+0000 7f8b3f975800 20 add_watcher() i=4 2024-05-15T14:40:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.695+0000 7f8b3f975800 20 add_watcher() i=5 2024-05-15T14:40:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.695+0000 7f8b3f975800 20 add_watcher() i=6 2024-05-15T14:40:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.696+0000 7f8b3f975800 20 add_watcher() i=7 2024-05-15T14:40:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.696+0000 7f8b3f975800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.697+0000 7f89f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.698+0000 7f8b3f975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.698+0000 7f8b3f975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.698+0000 7f8b3f975800 5 note: GC not initialized 2024-05-15T14:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.698+0000 7f89f2fe5640 20 reqs_thread_entry: start 2024-05-15T14:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.698+0000 7f8b3f975800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.698+0000 7f8b3f975800 20 Filter name: none 2024-05-15T14:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.698+0000 7f89f0fe1640 20 reqs_thread_entry: start 2024-05-15T14:40:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.699+0000 7f8b3f975800 20 rados->read ofs=0 len=0 2024-05-15T14:40:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.699+0000 7f8b3f975800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:20.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.701+0000 7f89f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:20.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.703+0000 7f8b3f975800 20 remove_watcher() i=0 2024-05-15T14:40:20.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.703+0000 7f8b3f975800 2 removed watcher, disabling cache 2024-05-15T14:40:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.704+0000 7f8b3f975800 20 remove_watcher() i=1 2024-05-15T14:40:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.705+0000 7f8b3f975800 20 remove_watcher() i=2 2024-05-15T14:40:20.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.706+0000 7f8b3f975800 20 remove_watcher() i=3 2024-05-15T14:40:20.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.707+0000 7f8b3f975800 20 remove_watcher() i=4 2024-05-15T14:40:20.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.708+0000 7f8b3f975800 20 remove_watcher() i=5 2024-05-15T14:40:20.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.709+0000 7f8b3f975800 20 remove_watcher() i=6 2024-05-15T14:40:20.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:20.710+0000 7f8b3f975800 20 remove_watcher() i=7 2024-05-15T14:40:25.774 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:25.774 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:25.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.814+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.816+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.816+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.817+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.817+0000 7f7ae7fdc800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.817+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.817+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:25.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.817+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.818+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:25.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.818+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.818+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.818+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.818+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.818+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.819+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.819+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.819+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.819+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 20 zone MyZone found 2024-05-15T14:40:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.820+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.821+0000 7f7ae7fdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.821+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.821+0000 7f7ae7fdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.821+0000 7f7ae7fdc800 20 started sync module instance, tier type = 2024-05-15T14:40:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.821+0000 7f7ae7fdc800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:25.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.832+0000 7f7ae7fdc800 20 add_watcher() i=0 2024-05-15T14:40:25.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.832+0000 7f7ae7fdc800 20 add_watcher() i=1 2024-05-15T14:40:25.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.832+0000 7f7ae7fdc800 20 add_watcher() i=2 2024-05-15T14:40:25.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.832+0000 7f7ae7fdc800 20 add_watcher() i=3 2024-05-15T14:40:25.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.832+0000 7f7ae7fdc800 20 add_watcher() i=4 2024-05-15T14:40:25.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.832+0000 7f7ae7fdc800 20 add_watcher() i=5 2024-05-15T14:40:25.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.832+0000 7f7ae7fdc800 20 add_watcher() i=6 2024-05-15T14:40:25.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.833+0000 7f7ae7fdc800 20 add_watcher() i=7 2024-05-15T14:40:25.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.833+0000 7f7ae7fdc800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:25.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.834+0000 7f79877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.835+0000 7f7ae7fdc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.835+0000 7f7ae7fdc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.835+0000 7f7ae7fdc800 5 note: GC not initialized 2024-05-15T14:40:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.835+0000 7f79867fc640 20 reqs_thread_entry: start 2024-05-15T14:40:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.835+0000 7f7ae7fdc800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.835+0000 7f7ae7fdc800 20 Filter name: none 2024-05-15T14:40:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.835+0000 7f7907fff640 20 reqs_thread_entry: start 2024-05-15T14:40:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.836+0000 7f7ae7fdc800 20 rados->read ofs=0 len=0 2024-05-15T14:40:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.836+0000 7f7ae7fdc800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:25.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.838+0000 7f79877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.840+0000 7f7ae7fdc800 20 remove_watcher() i=0 2024-05-15T14:40:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.840+0000 7f7ae7fdc800 2 removed watcher, disabling cache 2024-05-15T14:40:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.841+0000 7f7ae7fdc800 20 remove_watcher() i=1 2024-05-15T14:40:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.842+0000 7f7ae7fdc800 20 remove_watcher() i=2 2024-05-15T14:40:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.843+0000 7f7ae7fdc800 20 remove_watcher() i=3 2024-05-15T14:40:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.844+0000 7f7ae7fdc800 20 remove_watcher() i=4 2024-05-15T14:40:25.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.845+0000 7f7ae7fdc800 20 remove_watcher() i=5 2024-05-15T14:40:25.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.846+0000 7f7ae7fdc800 20 remove_watcher() i=6 2024-05-15T14:40:25.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:25.847+0000 7f7ae7fdc800 20 remove_watcher() i=7 2024-05-15T14:40:30.912 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:30.913 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.961+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.963+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.963+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.964+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:30.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.964+0000 7f424203b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:30.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.964+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.964+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:30.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.964+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.965+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.965+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.965+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.965+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.966+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.966+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.966+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.966+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.967+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.967+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 zone MyZone found 2024-05-15T14:40:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 started sync module instance, tier type = 2024-05-15T14:40:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.968+0000 7f424203b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.987+0000 7f424203b800 20 add_watcher() i=0 2024-05-15T14:40:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.987+0000 7f424203b800 20 add_watcher() i=1 2024-05-15T14:40:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.987+0000 7f424203b800 20 add_watcher() i=2 2024-05-15T14:40:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.987+0000 7f424203b800 20 add_watcher() i=3 2024-05-15T14:40:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.987+0000 7f424203b800 20 add_watcher() i=4 2024-05-15T14:40:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.987+0000 7f424203b800 20 add_watcher() i=5 2024-05-15T14:40:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.987+0000 7f424203b800 20 add_watcher() i=6 2024-05-15T14:40:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.988+0000 7f424203b800 20 add_watcher() i=7 2024-05-15T14:40:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.988+0000 7f424203b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.989+0000 7f40f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.990+0000 7f424203b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.990+0000 7f424203b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.990+0000 7f424203b800 5 note: GC not initialized 2024-05-15T14:40:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.990+0000 7f40f4fe1640 20 reqs_thread_entry: start 2024-05-15T14:40:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.990+0000 7f424203b800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.990+0000 7f424203b800 20 Filter name: none 2024-05-15T14:40:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.990+0000 7f406e7fc640 20 reqs_thread_entry: start 2024-05-15T14:40:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.991+0000 7f424203b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.991+0000 7f424203b800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.993+0000 7f40f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.995+0000 7f424203b800 20 remove_watcher() i=0 2024-05-15T14:40:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.995+0000 7f424203b800 2 removed watcher, disabling cache 2024-05-15T14:40:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.996+0000 7f424203b800 20 remove_watcher() i=1 2024-05-15T14:40:30.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.997+0000 7f424203b800 20 remove_watcher() i=2 2024-05-15T14:40:30.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.998+0000 7f424203b800 20 remove_watcher() i=3 2024-05-15T14:40:30.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:30.999+0000 7f424203b800 20 remove_watcher() i=4 2024-05-15T14:40:31.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:31.000+0000 7f424203b800 20 remove_watcher() i=5 2024-05-15T14:40:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:31.001+0000 7f424203b800 20 remove_watcher() i=6 2024-05-15T14:40:31.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:31.002+0000 7f424203b800 20 remove_watcher() i=7 2024-05-15T14:40:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:36.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.108+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.109+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:36.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.110+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.110+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:36.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.110+0000 7f04ec91f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:36.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.110+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.111+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:36.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.111+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.111+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:36.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.111+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.112+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:36.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.112+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.112+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:36.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.112+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.112+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:36.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.112+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.113+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:36.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.113+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:36.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 20 zone MyZone found 2024-05-15T14:40:36.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:36.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:36.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:36.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:36.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:36.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:36.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:36.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.114+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.115+0000 7f04ec91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:36.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.115+0000 7f04ec91f800 20 started sync module instance, tier type = 2024-05-15T14:40:36.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.115+0000 7f04ec91f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:36.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.126+0000 7f04ec91f800 20 add_watcher() i=0 2024-05-15T14:40:36.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.126+0000 7f04ec91f800 20 add_watcher() i=1 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.126+0000 7f04ec91f800 20 add_watcher() i=2 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.126+0000 7f04ec91f800 20 add_watcher() i=3 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.126+0000 7f04ec91f800 20 add_watcher() i=4 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.126+0000 7f04ec91f800 20 add_watcher() i=5 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.126+0000 7f04ec91f800 20 add_watcher() i=6 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.127+0000 7f04ec91f800 20 add_watcher() i=7 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.127+0000 7f04ec91f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.129+0000 7f039e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.129+0000 7f04ec91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.129+0000 7f04ec91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.129+0000 7f04ec91f800 5 note: GC not initialized 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.129+0000 7f039d7e2640 20 reqs_thread_entry: start 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.129+0000 7f04ec91f800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.129+0000 7f04ec91f800 20 Filter name: none 2024-05-15T14:40:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.130+0000 7f030effd640 20 reqs_thread_entry: start 2024-05-15T14:40:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.130+0000 7f04ec91f800 20 rados->read ofs=0 len=0 2024-05-15T14:40:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.130+0000 7f04ec91f800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.132+0000 7f039e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.134+0000 7f04ec91f800 20 remove_watcher() i=0 2024-05-15T14:40:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.134+0000 7f04ec91f800 2 removed watcher, disabling cache 2024-05-15T14:40:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.135+0000 7f04ec91f800 20 remove_watcher() i=1 2024-05-15T14:40:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.136+0000 7f04ec91f800 20 remove_watcher() i=2 2024-05-15T14:40:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.137+0000 7f04ec91f800 20 remove_watcher() i=3 2024-05-15T14:40:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.138+0000 7f04ec91f800 20 remove_watcher() i=4 2024-05-15T14:40:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.139+0000 7f04ec91f800 20 remove_watcher() i=5 2024-05-15T14:40:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.140+0000 7f04ec91f800 20 remove_watcher() i=6 2024-05-15T14:40:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:36.141+0000 7f04ec91f800 20 remove_watcher() i=7 2024-05-15T14:40:41.205 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:41.205 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.246+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.248+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:41.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.248+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.248+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:41.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.248+0000 7fa2fef2a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:41.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.248+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.249+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:41.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.249+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.249+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:41.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.249+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.250+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:41.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.250+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.250+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:41.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.250+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.250+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:41.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.250+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.251+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:41.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.251+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:41.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 20 zone MyZone found 2024-05-15T14:40:41.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:41.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:41.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:41.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:41.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:41.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:41.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.252+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.253+0000 7fa2fef2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:41.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.253+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.253+0000 7fa2fef2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:41.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.253+0000 7fa2fef2a800 20 started sync module instance, tier type = 2024-05-15T14:40:41.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.253+0000 7fa2fef2a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:41.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.264+0000 7fa2fef2a800 20 add_watcher() i=0 2024-05-15T14:40:41.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.264+0000 7fa2fef2a800 20 add_watcher() i=1 2024-05-15T14:40:41.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.264+0000 7fa2fef2a800 20 add_watcher() i=2 2024-05-15T14:40:41.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.264+0000 7fa2fef2a800 20 add_watcher() i=3 2024-05-15T14:40:41.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.264+0000 7fa2fef2a800 20 add_watcher() i=4 2024-05-15T14:40:41.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.264+0000 7fa2fef2a800 20 add_watcher() i=5 2024-05-15T14:40:41.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.264+0000 7fa2fef2a800 20 add_watcher() i=6 2024-05-15T14:40:41.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.265+0000 7fa2fef2a800 20 add_watcher() i=7 2024-05-15T14:40:41.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.265+0000 7fa2fef2a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:41.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.267+0000 7fa1b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:41.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.267+0000 7fa2fef2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:41.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.267+0000 7fa2fef2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:41.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.267+0000 7fa2fef2a800 5 note: GC not initialized 2024-05-15T14:40:41.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.267+0000 7fa12bfff640 20 reqs_thread_entry: start 2024-05-15T14:40:41.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.267+0000 7fa2fef2a800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:41.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.268+0000 7fa2fef2a800 20 Filter name: none 2024-05-15T14:40:41.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.268+0000 7fa129ffb640 20 reqs_thread_entry: start 2024-05-15T14:40:41.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.268+0000 7fa2fef2a800 20 rados->read ofs=0 len=0 2024-05-15T14:40:41.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.268+0000 7fa2fef2a800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:41.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.270+0000 7fa1b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:41.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.272+0000 7fa2fef2a800 20 remove_watcher() i=0 2024-05-15T14:40:41.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.272+0000 7fa2fef2a800 2 removed watcher, disabling cache 2024-05-15T14:40:41.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.273+0000 7fa2fef2a800 20 remove_watcher() i=1 2024-05-15T14:40:41.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.275+0000 7fa2fef2a800 20 remove_watcher() i=2 2024-05-15T14:40:41.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.276+0000 7fa2fef2a800 20 remove_watcher() i=3 2024-05-15T14:40:41.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.276+0000 7fa2fef2a800 20 remove_watcher() i=4 2024-05-15T14:40:41.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.278+0000 7fa2fef2a800 20 remove_watcher() i=5 2024-05-15T14:40:41.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.278+0000 7fa2fef2a800 20 remove_watcher() i=6 2024-05-15T14:40:41.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:41.279+0000 7fa2fef2a800 20 remove_watcher() i=7 2024-05-15T14:40:46.350 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:46.350 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.394+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.396+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:46.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.396+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.397+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:46.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.397+0000 7f169072b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:46.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.397+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.397+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:46.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.397+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.398+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:46.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.398+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.398+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:46.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.398+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.399+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:46.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.399+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.399+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:46.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.399+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.400+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:46.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.400+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:46.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 20 zone MyZone found 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.401+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.402+0000 7f169072b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.402+0000 7f169072b800 20 started sync module instance, tier type = 2024-05-15T14:40:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.402+0000 7f169072b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.412+0000 7f169072b800 20 add_watcher() i=0 2024-05-15T14:40:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.412+0000 7f169072b800 20 add_watcher() i=1 2024-05-15T14:40:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.412+0000 7f169072b800 20 add_watcher() i=2 2024-05-15T14:40:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.412+0000 7f169072b800 20 add_watcher() i=3 2024-05-15T14:40:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.412+0000 7f169072b800 20 add_watcher() i=4 2024-05-15T14:40:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.412+0000 7f169072b800 20 add_watcher() i=5 2024-05-15T14:40:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.412+0000 7f169072b800 20 add_watcher() i=6 2024-05-15T14:40:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.413+0000 7f169072b800 20 add_watcher() i=7 2024-05-15T14:40:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.413+0000 7f169072b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:46.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.415+0000 7f1542fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:46.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.415+0000 7f169072b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.415+0000 7f169072b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.415+0000 7f169072b800 5 note: GC not initialized 2024-05-15T14:40:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.416+0000 7f1541fdb640 20 reqs_thread_entry: start 2024-05-15T14:40:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.416+0000 7f169072b800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.416+0000 7f169072b800 20 Filter name: none 2024-05-15T14:40:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.416+0000 7f14b37fe640 20 reqs_thread_entry: start 2024-05-15T14:40:46.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.416+0000 7f169072b800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.417+0000 7f169072b800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:40:46.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.418+0000 7f1542fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:46.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.421+0000 7f169072b800 20 remove_watcher() i=0 2024-05-15T14:40:46.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.421+0000 7f169072b800 2 removed watcher, disabling cache 2024-05-15T14:40:46.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.421+0000 7f169072b800 20 remove_watcher() i=1 2024-05-15T14:40:46.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.422+0000 7f169072b800 20 remove_watcher() i=2 2024-05-15T14:40:46.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.423+0000 7f169072b800 20 remove_watcher() i=3 2024-05-15T14:40:46.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.424+0000 7f169072b800 20 remove_watcher() i=4 2024-05-15T14:40:46.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.426+0000 7f169072b800 20 remove_watcher() i=5 2024-05-15T14:40:46.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.427+0000 7f169072b800 20 remove_watcher() i=6 2024-05-15T14:40:46.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.428+0000 7f169072b800 20 remove_watcher() i=7 2024-05-15T14:40:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:FAIL 2024-05-15T14:40:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:test data path v2 persistent migration ... ignoring --setuser ceph since I am not root 2024-05-15T14:40:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.525+0000 7fa12b038800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.525+0000 7fa12b038800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:46.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.530+0000 7f9f6effd640 20 reqs_thread_entry: start 2024-05-15T14:40:46.592 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:46.593 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:46.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.623+0000 7fdb63119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:46.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.623+0000 7fdb63119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:46.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.627+0000 7fd9a6ffd640 20 reqs_thread_entry: start 2024-05-15T14:40:46.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.630+0000 7fdb63119800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:40:46.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.645+0000 7fdb63119800 10 found existing latest_epoch 1 >= given epoch 1, returning r=-17 2024-05-15T14:40:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:40:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:40:46.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.749+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.751+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:46.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.751+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.752+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.752+0000 7fe13132d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:40:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.752+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.752+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:46.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.752+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.753+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:40:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.753+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.753+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=1104 2024-05-15T14:40:46.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.753+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.754+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.754+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.754+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:40:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.754+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.755+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:40:46.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.755+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.755+0000 7fe13132d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:40:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 zone MyZone found 2024-05-15T14:40:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:40:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:40:46.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:1 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 rados->read ofs=0 len=0 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 started sync module instance, tier type = 2024-05-15T14:40:46.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.756+0000 7fe13132d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:40:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.766+0000 7fe13132d800 20 add_watcher() i=0 2024-05-15T14:40:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.767+0000 7fe13132d800 20 add_watcher() i=1 2024-05-15T14:40:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.767+0000 7fe13132d800 20 add_watcher() i=2 2024-05-15T14:40:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.767+0000 7fe13132d800 20 add_watcher() i=3 2024-05-15T14:40:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.767+0000 7fe13132d800 20 add_watcher() i=4 2024-05-15T14:40:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.767+0000 7fe13132d800 20 add_watcher() i=5 2024-05-15T14:40:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.767+0000 7fe13132d800 20 add_watcher() i=6 2024-05-15T14:40:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.768+0000 7fe13132d800 20 add_watcher() i=7 2024-05-15T14:40:46.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.768+0000 7fe13132d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:40:46.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.769+0000 7fdfe37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:46.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.769+0000 7fe13132d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:40:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.769+0000 7fe13132d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:40:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.770+0000 7fe13132d800 5 note: GC not initialized 2024-05-15T14:40:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.770+0000 7fdfe27e4640 20 reqs_thread_entry: start 2024-05-15T14:40:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.770+0000 7fe13132d800 20 init_complete bucket index max shards: 11 2024-05-15T14:40:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.770+0000 7fe13132d800 20 Filter name: none 2024-05-15T14:40:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.770+0000 7fdfdb7fe640 20 reqs_thread_entry: start 2024-05-15T14:40:46.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.772+0000 7fe13132d800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:40:46.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.773+0000 7fe13132d800 20 updating latest_epoch from 1 -> 2 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:40:46.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.780+0000 7fe13132d800 4 Committed new epoch 2 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:40:46.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.782+0000 7fdfe37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:40:46.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.784+0000 7fe13132d800 20 remove_watcher() i=0 2024-05-15T14:40:46.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.784+0000 7fe13132d800 2 removed watcher, disabling cache 2024-05-15T14:40:46.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.785+0000 7fe13132d800 20 remove_watcher() i=1 2024-05-15T14:40:46.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.786+0000 7fe13132d800 20 remove_watcher() i=2 2024-05-15T14:40:46.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.787+0000 7fe13132d800 20 remove_watcher() i=3 2024-05-15T14:40:46.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.788+0000 7fe13132d800 20 remove_watcher() i=4 2024-05-15T14:40:46.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.789+0000 7fe13132d800 20 remove_watcher() i=5 2024-05-15T14:40:46.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.790+0000 7fe13132d800 20 remove_watcher() i=6 2024-05-15T14:40:46.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:40:46.791+0000 7fe13132d800 20 remove_watcher() i=7 2024-05-15T14:41:13.520 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:41:13.518+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:41:13.521 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:41:13.518+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:41:13.521 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:41:13.518+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:41:13.521 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:41:13.518+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:41:13.909 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:41:13.908+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:41:13.909 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:41:13.908+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:41:13.909 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:41:13.908+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:41:13.909 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:41:13.908+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:41:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.059+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.061+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.061+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.062+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.062+0000 7f7b34b2d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.062+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.062+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.062+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.063+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.063+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.063+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=1107 2024-05-15T14:41:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.063+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.063+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.064+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.064+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.064+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 20 zone MyZone found 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:2 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.065+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.066+0000 7f7b34b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.066+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.066+0000 7f7b34b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.066+0000 7f7b34b2d800 20 started sync module instance, tier type = 2024-05-15T14:41:14.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.066+0000 7f7b34b2d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.077+0000 7f7b34b2d800 20 add_watcher() i=0 2024-05-15T14:41:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.077+0000 7f7b34b2d800 20 add_watcher() i=1 2024-05-15T14:41:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.077+0000 7f7b34b2d800 20 add_watcher() i=2 2024-05-15T14:41:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.077+0000 7f7b34b2d800 20 add_watcher() i=3 2024-05-15T14:41:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.077+0000 7f7b34b2d800 20 add_watcher() i=4 2024-05-15T14:41:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.077+0000 7f7b34b2d800 20 add_watcher() i=5 2024-05-15T14:41:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.077+0000 7f7b34b2d800 20 add_watcher() i=6 2024-05-15T14:41:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.078+0000 7f7b34b2d800 20 add_watcher() i=7 2024-05-15T14:41:14.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.078+0000 7f7b34b2d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:14.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.079+0000 7f79e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:14.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.080+0000 7f7b34b2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:14.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.080+0000 7f7b34b2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:14.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.080+0000 7f7b34b2d800 5 note: GC not initialized 2024-05-15T14:41:14.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.080+0000 7f79e5fdb640 20 reqs_thread_entry: start 2024-05-15T14:41:14.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.080+0000 7f7b34b2d800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:14.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.080+0000 7f7b34b2d800 20 Filter name: none 2024-05-15T14:41:14.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.080+0000 7f79577fe640 20 reqs_thread_entry: start 2024-05-15T14:41:14.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.080+0000 7f7b34b2d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.081+0000 7f7b34b2d800 20 rados_obj.operate() r=0 bl.length=524 2024-05-15T14:41:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.083+0000 7f79e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:14.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.084+0000 7f7b34b2d800 20 remove_watcher() i=0 2024-05-15T14:41:14.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.084+0000 7f7b34b2d800 2 removed watcher, disabling cache 2024-05-15T14:41:14.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.086+0000 7f7b34b2d800 20 remove_watcher() i=1 2024-05-15T14:41:14.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.086+0000 7f7b34b2d800 20 remove_watcher() i=2 2024-05-15T14:41:14.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.087+0000 7f7b34b2d800 20 remove_watcher() i=3 2024-05-15T14:41:14.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.088+0000 7f7b34b2d800 20 remove_watcher() i=4 2024-05-15T14:41:14.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.089+0000 7f7b34b2d800 20 remove_watcher() i=5 2024-05-15T14:41:14.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.090+0000 7f7b34b2d800 20 remove_watcher() i=6 2024-05-15T14:41:14.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.091+0000 7f7b34b2d800 20 remove_watcher() i=7 2024-05-15T14:41:14.403 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:14.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.443+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.445+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.445+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.446+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.446+0000 7f68eb936800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:14.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.446+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.446+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.446+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.447+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.447+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.447+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=1107 2024-05-15T14:41:14.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.447+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.447+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.447+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.448+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.448+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.448+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.448+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:14.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 20 zone MyZone found 2024-05-15T14:41:14.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:2 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.449+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.450+0000 7f68eb936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.450+0000 7f68eb936800 20 started sync module instance, tier type = 2024-05-15T14:41:14.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.450+0000 7f68eb936800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:14.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.460+0000 7f68eb936800 20 add_watcher() i=0 2024-05-15T14:41:14.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.460+0000 7f68eb936800 20 add_watcher() i=1 2024-05-15T14:41:14.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.460+0000 7f68eb936800 20 add_watcher() i=2 2024-05-15T14:41:14.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.460+0000 7f68eb936800 20 add_watcher() i=3 2024-05-15T14:41:14.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.460+0000 7f68eb936800 20 add_watcher() i=4 2024-05-15T14:41:14.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.460+0000 7f68eb936800 20 add_watcher() i=5 2024-05-15T14:41:14.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.460+0000 7f68eb936800 20 add_watcher() i=6 2024-05-15T14:41:14.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.461+0000 7f68eb936800 20 add_watcher() i=7 2024-05-15T14:41:14.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.461+0000 7f68eb936800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:14.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.462+0000 7f679dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.463+0000 7f68eb936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.463+0000 7f68eb936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.463+0000 7f68eb936800 5 note: GC not initialized 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.463+0000 7f679cfe1640 20 reqs_thread_entry: start 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.463+0000 7f68eb936800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.463+0000 7f68eb936800 20 Filter name: none 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.463+0000 7f67167fc640 20 reqs_thread_entry: start 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.463+0000 7f68eb936800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.464+0000 7f68eb936800 20 rados_obj.operate() r=0 bl.length=524 2024-05-15T14:41:14.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.465+0000 7f679dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:14.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.467+0000 7f68eb936800 20 remove_watcher() i=0 2024-05-15T14:41:14.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.467+0000 7f68eb936800 2 removed watcher, disabling cache 2024-05-15T14:41:14.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.468+0000 7f68eb936800 20 remove_watcher() i=1 2024-05-15T14:41:14.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.469+0000 7f68eb936800 20 remove_watcher() i=2 2024-05-15T14:41:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.470+0000 7f68eb936800 20 remove_watcher() i=3 2024-05-15T14:41:14.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.471+0000 7f68eb936800 20 remove_watcher() i=4 2024-05-15T14:41:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.472+0000 7f68eb936800 20 remove_watcher() i=5 2024-05-15T14:41:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.473+0000 7f68eb936800 20 remove_watcher() i=6 2024-05-15T14:41:14.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.473+0000 7f68eb936800 20 remove_watcher() i=7 2024-05-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:14.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.562+0000 7f8c5fd33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:14.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.562+0000 7f8c5fd33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:14.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.567+0000 7f8b1a7fc640 20 reqs_thread_entry: start 2024-05-15T14:41:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:14.626 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.655+0000 7f50d2f36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.655+0000 7f50d2f36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.660+0000 7f4f917e2640 20 reqs_thread_entry: start 2024-05-15T14:41:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.662+0000 7f50d2f36800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:41:14.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.676+0000 7f50d2f36800 20 updating latest_epoch from 1 -> 2 on period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:41:14.732 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:14.732 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.772+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.773+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.773+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.774+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.774+0000 7f09b7333800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.774+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.775+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.775+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.775+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.775+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.776+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=1107 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.776+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.776+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.776+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.776+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.776+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.777+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:14.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.777+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 zone MyZone found 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:2 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:14.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:14.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:14.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 started sync module instance, tier type = 2024-05-15T14:41:14.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.778+0000 7f09b7333800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:14.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.788+0000 7f09b7333800 20 add_watcher() i=0 2024-05-15T14:41:14.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.788+0000 7f09b7333800 20 add_watcher() i=1 2024-05-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.788+0000 7f09b7333800 20 add_watcher() i=2 2024-05-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.788+0000 7f09b7333800 20 add_watcher() i=3 2024-05-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.788+0000 7f09b7333800 20 add_watcher() i=4 2024-05-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.788+0000 7f09b7333800 20 add_watcher() i=5 2024-05-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.788+0000 7f09b7333800 20 add_watcher() i=6 2024-05-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.789+0000 7f09b7333800 20 add_watcher() i=7 2024-05-15T14:41:14.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.789+0000 7f09b7333800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:14.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.790+0000 7f08697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:14.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.790+0000 7f09b7333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:14.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.790+0000 7f09b7333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:14.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.791+0000 7f09b7333800 5 note: GC not initialized 2024-05-15T14:41:14.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.791+0000 7f07e3fff640 20 reqs_thread_entry: start 2024-05-15T14:41:14.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.791+0000 7f09b7333800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:14.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.791+0000 7f09b7333800 20 Filter name: none 2024-05-15T14:41:14.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.791+0000 7f07e1ffb640 20 reqs_thread_entry: start 2024-05-15T14:41:14.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.793+0000 7f09b7333800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:41:14.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.795+0000 7f09b7333800 20 updating latest_epoch from 2 -> 3 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:41:14.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.800+0000 7f09b7333800 4 Committed new epoch 3 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:41:14.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.802+0000 7f08697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:14.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.804+0000 7f09b7333800 20 remove_watcher() i=0 2024-05-15T14:41:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.804+0000 7f09b7333800 2 removed watcher, disabling cache 2024-05-15T14:41:14.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.805+0000 7f09b7333800 20 remove_watcher() i=1 2024-05-15T14:41:14.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.806+0000 7f09b7333800 20 remove_watcher() i=2 2024-05-15T14:41:14.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.807+0000 7f09b7333800 20 remove_watcher() i=3 2024-05-15T14:41:14.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.808+0000 7f09b7333800 20 remove_watcher() i=4 2024-05-15T14:41:14.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.808+0000 7f09b7333800 20 remove_watcher() i=5 2024-05-15T14:41:14.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.809+0000 7f09b7333800 20 remove_watcher() i=6 2024-05-15T14:41:14.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:14.810+0000 7f09b7333800 20 remove_watcher() i=7 2024-05-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.920+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.922+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:15.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.922+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.923+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.923+0000 7ffb2501d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.923+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.923+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.923+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.924+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.924+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.924+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:15.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.924+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.925+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.925+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.925+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:15.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.925+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:15.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:15.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 20 zone MyZone found 2024-05-15T14:41:15.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:15.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.926+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.927+0000 7ffb2501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.927+0000 7ffb2501d800 20 rados->read ofs=0 len=0 2024-05-15T14:41:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.927+0000 7ffb2501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:15.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.927+0000 7ffb2501d800 20 started sync module instance, tier type = 2024-05-15T14:41:15.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.927+0000 7ffb2501d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:15.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.938+0000 7ffb2501d800 20 add_watcher() i=0 2024-05-15T14:41:15.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.938+0000 7ffb2501d800 20 add_watcher() i=1 2024-05-15T14:41:15.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.938+0000 7ffb2501d800 20 add_watcher() i=2 2024-05-15T14:41:15.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.938+0000 7ffb2501d800 20 add_watcher() i=3 2024-05-15T14:41:15.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.938+0000 7ffb2501d800 20 add_watcher() i=4 2024-05-15T14:41:15.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.938+0000 7ffb2501d800 20 add_watcher() i=5 2024-05-15T14:41:15.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.938+0000 7ffb2501d800 20 add_watcher() i=6 2024-05-15T14:41:15.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.939+0000 7ffb2501d800 20 add_watcher() i=7 2024-05-15T14:41:15.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.939+0000 7ffb2501d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:15.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.940+0000 7ff9d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:15.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.941+0000 7ffb2501d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:15.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.941+0000 7ffb2501d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:15.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.941+0000 7ffb2501d800 5 note: GC not initialized 2024-05-15T14:41:15.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.941+0000 7ff953fff640 20 reqs_thread_entry: start 2024-05-15T14:41:15.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.941+0000 7ffb2501d800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:15.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.941+0000 7ffb2501d800 20 Filter name: none 2024-05-15T14:41:15.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.941+0000 7ff951ffb640 20 reqs_thread_entry: start 2024-05-15T14:41:15.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.941+0000 7ffb2501d800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:15.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.942+0000 7ffb2501d800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:15.943 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:15.942+0000 7ffb2501d800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:15.943 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:15.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.942+0000 7ffb2501d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:15.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.942+0000 7ffb2501d800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:15.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.943+0000 7ff9d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:15.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.945+0000 7ffb2501d800 20 remove_watcher() i=0 2024-05-15T14:41:15.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.945+0000 7ffb2501d800 2 removed watcher, disabling cache 2024-05-15T14:41:15.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.946+0000 7ffb2501d800 20 remove_watcher() i=1 2024-05-15T14:41:15.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.947+0000 7ffb2501d800 20 remove_watcher() i=2 2024-05-15T14:41:15.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.948+0000 7ffb2501d800 20 remove_watcher() i=3 2024-05-15T14:41:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.950+0000 7ffb2501d800 20 remove_watcher() i=4 2024-05-15T14:41:15.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.951+0000 7ffb2501d800 20 remove_watcher() i=5 2024-05-15T14:41:15.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.952+0000 7ffb2501d800 20 remove_watcher() i=6 2024-05-15T14:41:15.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:15.953+0000 7ffb2501d800 20 remove_watcher() i=7 2024-05-15T14:41:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:17.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.063+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.064+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:17.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.064+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.065+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:17.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.065+0000 7f51bca10800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:17.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.065+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.066+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:17.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.066+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.066+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:17.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.066+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.067+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:17.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.067+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.068+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:17.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.068+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.068+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:17.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.068+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:17.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:17.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 20 zone MyZone found 2024-05-15T14:41:17.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:17.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:17.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:17.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:17.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:17.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:17.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.069+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.070+0000 7f51bca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:17.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.070+0000 7f51bca10800 20 rados->read ofs=0 len=0 2024-05-15T14:41:17.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.070+0000 7f51bca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:17.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.070+0000 7f51bca10800 20 started sync module instance, tier type = 2024-05-15T14:41:17.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.070+0000 7f51bca10800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:17.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.081+0000 7f51bca10800 20 add_watcher() i=0 2024-05-15T14:41:17.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.081+0000 7f51bca10800 20 add_watcher() i=1 2024-05-15T14:41:17.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.081+0000 7f51bca10800 20 add_watcher() i=2 2024-05-15T14:41:17.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.081+0000 7f51bca10800 20 add_watcher() i=3 2024-05-15T14:41:17.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.081+0000 7f51bca10800 20 add_watcher() i=4 2024-05-15T14:41:17.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.081+0000 7f51bca10800 20 add_watcher() i=5 2024-05-15T14:41:17.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.081+0000 7f51bca10800 20 add_watcher() i=6 2024-05-15T14:41:17.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.082+0000 7f51bca10800 20 add_watcher() i=7 2024-05-15T14:41:17.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.082+0000 7f51bca10800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:17.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.084+0000 7f506efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:17.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.084+0000 7f51bca10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.084+0000 7f51bca10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.085+0000 7f51bca10800 5 note: GC not initialized 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.085+0000 7f506dfdb640 20 reqs_thread_entry: start 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.085+0000 7f51bca10800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.085+0000 7f51bca10800 20 Filter name: none 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.085+0000 7f4fdf7fe640 20 reqs_thread_entry: start 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.085+0000 7f51bca10800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.086+0000 7f51bca10800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.086+0000 7f51bca10800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:41:17.086+0000 7f51bca10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:41:17.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.086+0000 7f51bca10800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:17.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.086+0000 7f506efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.089+0000 7f51bca10800 20 remove_watcher() i=0 2024-05-15T14:41:17.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.089+0000 7f51bca10800 2 removed watcher, disabling cache 2024-05-15T14:41:17.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.090+0000 7f51bca10800 20 remove_watcher() i=1 2024-05-15T14:41:17.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.091+0000 7f51bca10800 20 remove_watcher() i=2 2024-05-15T14:41:17.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.092+0000 7f51bca10800 20 remove_watcher() i=3 2024-05-15T14:41:17.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.093+0000 7f51bca10800 20 remove_watcher() i=4 2024-05-15T14:41:17.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.094+0000 7f51bca10800 20 remove_watcher() i=5 2024-05-15T14:41:17.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.095+0000 7f51bca10800 20 remove_watcher() i=6 2024-05-15T14:41:17.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:17.096+0000 7f51bca10800 20 remove_watcher() i=7 2024-05-15T14:41:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.203+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.204+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:18.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.204+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.205+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.205+0000 7f972fe40800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.205+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.206+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:18.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.206+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.207+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:18.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.207+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.208+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.208+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.208+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.208+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.208+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.208+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.209+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:18.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.209+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 zone MyZone found 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 rados->read ofs=0 len=0 2024-05-15T14:41:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 started sync module instance, tier type = 2024-05-15T14:41:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.210+0000 7f972fe40800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.221+0000 7f972fe40800 20 add_watcher() i=0 2024-05-15T14:41:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.221+0000 7f972fe40800 20 add_watcher() i=1 2024-05-15T14:41:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.221+0000 7f972fe40800 20 add_watcher() i=2 2024-05-15T14:41:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.221+0000 7f972fe40800 20 add_watcher() i=3 2024-05-15T14:41:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.221+0000 7f972fe40800 20 add_watcher() i=4 2024-05-15T14:41:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.221+0000 7f972fe40800 20 add_watcher() i=5 2024-05-15T14:41:18.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.221+0000 7f972fe40800 20 add_watcher() i=6 2024-05-15T14:41:18.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.222+0000 7f972fe40800 20 add_watcher() i=7 2024-05-15T14:41:18.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.222+0000 7f972fe40800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:18.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.224+0000 7f95e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.225+0000 7f972fe40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.225+0000 7f972fe40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.225+0000 7f972fe40800 5 note: GC not initialized 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.225+0000 7f955bfff640 20 reqs_thread_entry: start 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.225+0000 7f972fe40800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.225+0000 7f972fe40800 20 Filter name: none 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.225+0000 7f9559ffb640 20 reqs_thread_entry: start 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.225+0000 7f972fe40800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:18.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.226+0000 7f972fe40800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:41:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.226+0000 7f972fe40800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.226+0000 7f972fe40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.226+0000 7f972fe40800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.226+0000 7f95e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:18.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.229+0000 7f972fe40800 20 remove_watcher() i=0 2024-05-15T14:41:18.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.229+0000 7f972fe40800 2 removed watcher, disabling cache 2024-05-15T14:41:18.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.230+0000 7f972fe40800 20 remove_watcher() i=1 2024-05-15T14:41:18.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.231+0000 7f972fe40800 20 remove_watcher() i=2 2024-05-15T14:41:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.232+0000 7f972fe40800 20 remove_watcher() i=3 2024-05-15T14:41:18.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.233+0000 7f972fe40800 20 remove_watcher() i=4 2024-05-15T14:41:18.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.234+0000 7f972fe40800 20 remove_watcher() i=5 2024-05-15T14:41:18.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.235+0000 7f972fe40800 20 remove_watcher() i=6 2024-05-15T14:41:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:18.236+0000 7f972fe40800 20 remove_watcher() i=7 2024-05-15T14:41:19.302 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:19.302 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:19.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.346+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.348+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.348+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.349+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.349+0000 7fcc34811800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.349+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.349+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.349+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.350+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.350+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.351+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:19.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.351+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.351+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:19.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.351+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.352+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:19.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.352+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.352+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:19.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.352+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:19.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 zone MyZone found 2024-05-15T14:41:19.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:19.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:19.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:19.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:19.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:19.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:19.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:19.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 rados->read ofs=0 len=0 2024-05-15T14:41:19.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:19.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 started sync module instance, tier type = 2024-05-15T14:41:19.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.353+0000 7fcc34811800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.364+0000 7fcc34811800 20 add_watcher() i=0 2024-05-15T14:41:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.364+0000 7fcc34811800 20 add_watcher() i=1 2024-05-15T14:41:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.364+0000 7fcc34811800 20 add_watcher() i=2 2024-05-15T14:41:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.364+0000 7fcc34811800 20 add_watcher() i=3 2024-05-15T14:41:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.364+0000 7fcc34811800 20 add_watcher() i=4 2024-05-15T14:41:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.364+0000 7fcc34811800 20 add_watcher() i=5 2024-05-15T14:41:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.364+0000 7fcc34811800 20 add_watcher() i=6 2024-05-15T14:41:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.365+0000 7fcc34811800 20 add_watcher() i=7 2024-05-15T14:41:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.365+0000 7fcc34811800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.367+0000 7fcae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.367+0000 7fcc34811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.367+0000 7fcc34811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.367+0000 7fcc34811800 5 note: GC not initialized 2024-05-15T14:41:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.368+0000 7fcae4fe1640 20 reqs_thread_entry: start 2024-05-15T14:41:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.368+0000 7fcc34811800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.368+0000 7fcc34811800 20 Filter name: none 2024-05-15T14:41:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.368+0000 7fca5e7fc640 20 reqs_thread_entry: start 2024-05-15T14:41:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.368+0000 7fcc34811800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.369+0000 7fcc34811800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:19.369+0000 7fcc34811800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.369+0000 7fcc34811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.369+0000 7fcc34811800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.370+0000 7fcae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.372+0000 7fcc34811800 20 remove_watcher() i=0 2024-05-15T14:41:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.372+0000 7fcc34811800 2 removed watcher, disabling cache 2024-05-15T14:41:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.373+0000 7fcc34811800 20 remove_watcher() i=1 2024-05-15T14:41:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.374+0000 7fcc34811800 20 remove_watcher() i=2 2024-05-15T14:41:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.375+0000 7fcc34811800 20 remove_watcher() i=3 2024-05-15T14:41:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.376+0000 7fcc34811800 20 remove_watcher() i=4 2024-05-15T14:41:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.377+0000 7fcc34811800 20 remove_watcher() i=5 2024-05-15T14:41:19.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.378+0000 7fcc34811800 20 remove_watcher() i=6 2024-05-15T14:41:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:19.379+0000 7fcc34811800 20 remove_watcher() i=7 2024-05-15T14:41:20.445 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:20.445 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:20.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.489+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.491+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:20.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.491+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.491+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:20.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.491+0000 7f191df36800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:20.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.491+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.492+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:20.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.492+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.492+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:20.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.492+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.493+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:20.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.493+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.494+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:20.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.494+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.494+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:20.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.494+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:20.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 zone MyZone found 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.495+0000 7f191df36800 20 rados->read ofs=0 len=0 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.496+0000 7f191df36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.496+0000 7f191df36800 20 started sync module instance, tier type = 2024-05-15T14:41:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.496+0000 7f191df36800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:20.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.507+0000 7f191df36800 20 add_watcher() i=0 2024-05-15T14:41:20.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.507+0000 7f191df36800 20 add_watcher() i=1 2024-05-15T14:41:20.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.507+0000 7f191df36800 20 add_watcher() i=2 2024-05-15T14:41:20.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.507+0000 7f191df36800 20 add_watcher() i=3 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.507+0000 7f191df36800 20 add_watcher() i=4 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.507+0000 7f191df36800 20 add_watcher() i=5 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.507+0000 7f191df36800 20 add_watcher() i=6 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.508+0000 7f191df36800 20 add_watcher() i=7 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.508+0000 7f191df36800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.509+0000 7f17cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.510+0000 7f191df36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.510+0000 7f191df36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.510+0000 7f191df36800 5 note: GC not initialized 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.510+0000 7f17ca7fc640 20 reqs_thread_entry: start 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.510+0000 7f191df36800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.510+0000 7f191df36800 20 Filter name: none 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.510+0000 7f173bfff640 20 reqs_thread_entry: start 2024-05-15T14:41:20.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.511+0000 7f191df36800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:20.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.511+0000 7f191df36800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:20.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.511+0000 7f191df36800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:20.514 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:41:20.511+0000 7f191df36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:20.514 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:41:20.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.511+0000 7f191df36800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:20.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.512+0000 7f17cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:20.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.514+0000 7f191df36800 20 remove_watcher() i=0 2024-05-15T14:41:20.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.514+0000 7f191df36800 2 removed watcher, disabling cache 2024-05-15T14:41:20.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.515+0000 7f191df36800 20 remove_watcher() i=1 2024-05-15T14:41:20.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.516+0000 7f191df36800 20 remove_watcher() i=2 2024-05-15T14:41:20.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.517+0000 7f191df36800 20 remove_watcher() i=3 2024-05-15T14:41:20.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.518+0000 7f191df36800 20 remove_watcher() i=4 2024-05-15T14:41:20.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.519+0000 7f191df36800 20 remove_watcher() i=5 2024-05-15T14:41:20.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.520+0000 7f191df36800 20 remove_watcher() i=6 2024-05-15T14:41:20.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:20.521+0000 7f191df36800 20 remove_watcher() i=7 2024-05-15T14:41:21.588 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:21.588 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:21.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.631+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.633+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:21.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.633+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.634+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:21.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.634+0000 7f476233f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:21.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.634+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.634+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:21.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.634+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.635+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:21.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.635+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.636+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:21.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.636+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.636+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:21.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.636+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.636+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:21.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.637+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.637+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:21.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.637+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 zone MyZone found 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:21.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:21.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:21.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 started sync module instance, tier type = 2024-05-15T14:41:21.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.638+0000 7f476233f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.649+0000 7f476233f800 20 add_watcher() i=0 2024-05-15T14:41:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.649+0000 7f476233f800 20 add_watcher() i=1 2024-05-15T14:41:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.649+0000 7f476233f800 20 add_watcher() i=2 2024-05-15T14:41:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.649+0000 7f476233f800 20 add_watcher() i=3 2024-05-15T14:41:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.649+0000 7f476233f800 20 add_watcher() i=4 2024-05-15T14:41:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.649+0000 7f476233f800 20 add_watcher() i=5 2024-05-15T14:41:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.649+0000 7f476233f800 20 add_watcher() i=6 2024-05-15T14:41:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.650+0000 7f476233f800 20 add_watcher() i=7 2024-05-15T14:41:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.650+0000 7f476233f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.652+0000 7f4614fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.652+0000 7f476233f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.652+0000 7f476233f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.652+0000 7f476233f800 5 note: GC not initialized 2024-05-15T14:41:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.652+0000 7f458f7fe640 20 reqs_thread_entry: start 2024-05-15T14:41:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.652+0000 7f476233f800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.653+0000 7f476233f800 20 Filter name: none 2024-05-15T14:41:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.653+0000 7f458d7fa640 20 reqs_thread_entry: start 2024-05-15T14:41:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.653+0000 7f476233f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:41:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.653+0000 7f476233f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.653+0000 7f476233f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.653+0000 7f476233f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.653+0000 7f476233f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.654+0000 7f4614fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:21.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.656+0000 7f476233f800 20 remove_watcher() i=0 2024-05-15T14:41:21.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.656+0000 7f476233f800 2 removed watcher, disabling cache 2024-05-15T14:41:21.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.658+0000 7f476233f800 20 remove_watcher() i=1 2024-05-15T14:41:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.659+0000 7f476233f800 20 remove_watcher() i=2 2024-05-15T14:41:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.660+0000 7f476233f800 20 remove_watcher() i=3 2024-05-15T14:41:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.661+0000 7f476233f800 20 remove_watcher() i=4 2024-05-15T14:41:21.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.662+0000 7f476233f800 20 remove_watcher() i=5 2024-05-15T14:41:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.663+0000 7f476233f800 20 remove_watcher() i=6 2024-05-15T14:41:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:21.664+0000 7f476233f800 20 remove_watcher() i=7 2024-05-15T14:41:22.731 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:22.731 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:22.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.775+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.777+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:22.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.777+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.778+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:22.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.778+0000 7fb244c16800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:22.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.778+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.778+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:22.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.778+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.779+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:22.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.779+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.780+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.780+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.780+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.780+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.781+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.781+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.781+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:22.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.781+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:22.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 zone MyZone found 2024-05-15T14:41:22.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:22.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:22.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:22.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:22.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:22.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:22.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:22.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 rados->read ofs=0 len=0 2024-05-15T14:41:22.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:22.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 started sync module instance, tier type = 2024-05-15T14:41:22.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.782+0000 7fb244c16800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:22.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.793+0000 7fb244c16800 20 add_watcher() i=0 2024-05-15T14:41:22.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.793+0000 7fb244c16800 20 add_watcher() i=1 2024-05-15T14:41:22.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.793+0000 7fb244c16800 20 add_watcher() i=2 2024-05-15T14:41:22.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.793+0000 7fb244c16800 20 add_watcher() i=3 2024-05-15T14:41:22.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.793+0000 7fb244c16800 20 add_watcher() i=4 2024-05-15T14:41:22.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.793+0000 7fb244c16800 20 add_watcher() i=5 2024-05-15T14:41:22.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.793+0000 7fb244c16800 20 add_watcher() i=6 2024-05-15T14:41:22.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.794+0000 7fb244c16800 20 add_watcher() i=7 2024-05-15T14:41:22.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.794+0000 7fb244c16800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:22.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.796+0000 7fb0f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.796+0000 7fb244c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.796+0000 7fb244c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.797+0000 7fb244c16800 5 note: GC not initialized 2024-05-15T14:41:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.797+0000 7fb0f5fdb640 20 reqs_thread_entry: start 2024-05-15T14:41:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.797+0000 7fb244c16800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.797+0000 7fb244c16800 20 Filter name: none 2024-05-15T14:41:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.797+0000 7fb0677fe640 20 reqs_thread_entry: start 2024-05-15T14:41:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.797+0000 7fb244c16800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:22.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.798+0000 7fb244c16800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:22.799 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:41:22.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.798+0000 7fb244c16800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:22.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.798+0000 7fb244c16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:22.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.798+0000 7fb244c16800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:22.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.799+0000 7fb0f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:22.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.801+0000 7fb244c16800 20 remove_watcher() i=0 2024-05-15T14:41:22.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.801+0000 7fb244c16800 2 removed watcher, disabling cache 2024-05-15T14:41:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.802+0000 7fb244c16800 20 remove_watcher() i=1 2024-05-15T14:41:22.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.803+0000 7fb244c16800 20 remove_watcher() i=2 2024-05-15T14:41:22.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.804+0000 7fb244c16800 20 remove_watcher() i=3 2024-05-15T14:41:22.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.805+0000 7fb244c16800 20 remove_watcher() i=4 2024-05-15T14:41:22.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.806+0000 7fb244c16800 20 remove_watcher() i=5 2024-05-15T14:41:22.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.807+0000 7fb244c16800 20 remove_watcher() i=6 2024-05-15T14:41:22.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:22.808+0000 7fb244c16800 20 remove_watcher() i=7 2024-05-15T14:41:23.874 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:23.874 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:23.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.918+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.919+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:23.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.919+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.920+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:23.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.920+0000 7f73329af800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:23.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.920+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.921+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:23.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.921+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.921+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:23.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.921+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.922+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:23.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.922+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.923+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:23.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.923+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.923+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:23.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.923+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 zone MyZone found 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:23.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:23.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:23.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.924+0000 7f73329af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:23.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.925+0000 7f73329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:23.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.925+0000 7f73329af800 20 started sync module instance, tier type = 2024-05-15T14:41:23.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.925+0000 7f73329af800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:23.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.936+0000 7f73329af800 20 add_watcher() i=0 2024-05-15T14:41:23.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.936+0000 7f73329af800 20 add_watcher() i=1 2024-05-15T14:41:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.936+0000 7f73329af800 20 add_watcher() i=2 2024-05-15T14:41:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.936+0000 7f73329af800 20 add_watcher() i=3 2024-05-15T14:41:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.936+0000 7f73329af800 20 add_watcher() i=4 2024-05-15T14:41:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.936+0000 7f73329af800 20 add_watcher() i=5 2024-05-15T14:41:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.936+0000 7f73329af800 20 add_watcher() i=6 2024-05-15T14:41:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.937+0000 7f73329af800 20 add_watcher() i=7 2024-05-15T14:41:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.937+0000 7f73329af800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.938+0000 7f71e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.939+0000 7f73329af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.939+0000 7f73329af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.939+0000 7f73329af800 5 note: GC not initialized 2024-05-15T14:41:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.939+0000 7f71e5fdb640 20 reqs_thread_entry: start 2024-05-15T14:41:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.939+0000 7f73329af800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.939+0000 7f73329af800 20 Filter name: none 2024-05-15T14:41:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.939+0000 7f71577fe640 20 reqs_thread_entry: start 2024-05-15T14:41:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.939+0000 7f73329af800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:23.941 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:23.940+0000 7f73329af800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:23.941 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:41:23.940+0000 7f73329af800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:23.941 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:41:23.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.940+0000 7f73329af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:23.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.940+0000 7f73329af800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:23.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.941+0000 7f71e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.943+0000 7f73329af800 20 remove_watcher() i=0 2024-05-15T14:41:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.943+0000 7f73329af800 2 removed watcher, disabling cache 2024-05-15T14:41:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.944+0000 7f73329af800 20 remove_watcher() i=1 2024-05-15T14:41:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.945+0000 7f73329af800 20 remove_watcher() i=2 2024-05-15T14:41:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.947+0000 7f73329af800 20 remove_watcher() i=3 2024-05-15T14:41:23.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.948+0000 7f73329af800 20 remove_watcher() i=4 2024-05-15T14:41:23.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.949+0000 7f73329af800 20 remove_watcher() i=5 2024-05-15T14:41:23.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.950+0000 7f73329af800 20 remove_watcher() i=6 2024-05-15T14:41:23.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:23.951+0000 7f73329af800 20 remove_watcher() i=7 2024-05-15T14:41:25.017 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:25.018 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:25.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.061+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.063+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:25.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.063+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.064+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:25.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.064+0000 7f8b375af800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:25.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.064+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.064+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:25.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.064+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.065+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:25.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.065+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.066+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:25.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.066+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.066+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:25.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.066+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.067+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:25.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.067+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.067+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:25.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.067+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 zone MyZone found 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:25.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:25.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 rados->read ofs=0 len=0 2024-05-15T14:41:25.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:25.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 started sync module instance, tier type = 2024-05-15T14:41:25.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.068+0000 7f8b375af800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:25.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.079+0000 7f8b375af800 20 add_watcher() i=0 2024-05-15T14:41:25.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.079+0000 7f8b375af800 20 add_watcher() i=1 2024-05-15T14:41:25.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.079+0000 7f8b375af800 20 add_watcher() i=2 2024-05-15T14:41:25.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.079+0000 7f8b375af800 20 add_watcher() i=3 2024-05-15T14:41:25.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.079+0000 7f8b375af800 20 add_watcher() i=4 2024-05-15T14:41:25.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.079+0000 7f8b375af800 20 add_watcher() i=5 2024-05-15T14:41:25.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.079+0000 7f8b375af800 20 add_watcher() i=6 2024-05-15T14:41:25.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.080+0000 7f8b375af800 20 add_watcher() i=7 2024-05-15T14:41:25.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.080+0000 7f8b375af800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:25.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.082+0000 7f89ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.082+0000 7f8b375af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.082+0000 7f8b375af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.082+0000 7f8b375af800 5 note: GC not initialized 2024-05-15T14:41:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.083+0000 7f89eafe5640 20 reqs_thread_entry: start 2024-05-15T14:41:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.083+0000 7f8b375af800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.083+0000 7f8b375af800 20 Filter name: none 2024-05-15T14:41:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.083+0000 7f89e8fe1640 20 reqs_thread_entry: start 2024-05-15T14:41:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.083+0000 7f8b375af800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.083+0000 7f8b375af800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:25.083+0000 7f8b375af800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:41:25.083+0000 7f8b375af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:25.085 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:41:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.083+0000 7f8b375af800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.084+0000 7f89ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:25.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.087+0000 7f8b375af800 20 remove_watcher() i=0 2024-05-15T14:41:25.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.087+0000 7f8b375af800 2 removed watcher, disabling cache 2024-05-15T14:41:25.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.088+0000 7f8b375af800 20 remove_watcher() i=1 2024-05-15T14:41:25.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.089+0000 7f8b375af800 20 remove_watcher() i=2 2024-05-15T14:41:25.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.090+0000 7f8b375af800 20 remove_watcher() i=3 2024-05-15T14:41:25.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.091+0000 7f8b375af800 20 remove_watcher() i=4 2024-05-15T14:41:25.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.092+0000 7f8b375af800 20 remove_watcher() i=5 2024-05-15T14:41:25.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.093+0000 7f8b375af800 20 remove_watcher() i=6 2024-05-15T14:41:25.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:25.094+0000 7f8b375af800 20 remove_watcher() i=7 2024-05-15T14:41:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:26.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.206+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.207+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:26.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.208+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.208+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:26.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.208+0000 7f2d0d333800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:26.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.208+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.209+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:26.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.209+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.209+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:26.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.209+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.210+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:26.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.210+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.211+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.211+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.211+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.211+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 20 zone MyZone found 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.212+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.213+0000 7f2d0d333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.213+0000 7f2d0d333800 20 rados->read ofs=0 len=0 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.213+0000 7f2d0d333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.213+0000 7f2d0d333800 20 started sync module instance, tier type = 2024-05-15T14:41:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.213+0000 7f2d0d333800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:26.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.224+0000 7f2d0d333800 20 add_watcher() i=0 2024-05-15T14:41:26.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.224+0000 7f2d0d333800 20 add_watcher() i=1 2024-05-15T14:41:26.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.224+0000 7f2d0d333800 20 add_watcher() i=2 2024-05-15T14:41:26.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.224+0000 7f2d0d333800 20 add_watcher() i=3 2024-05-15T14:41:26.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.224+0000 7f2d0d333800 20 add_watcher() i=4 2024-05-15T14:41:26.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.224+0000 7f2d0d333800 20 add_watcher() i=5 2024-05-15T14:41:26.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.224+0000 7f2d0d333800 20 add_watcher() i=6 2024-05-15T14:41:26.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.225+0000 7f2d0d333800 20 add_watcher() i=7 2024-05-15T14:41:26.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.225+0000 7f2d0d333800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:26.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.227+0000 7f2bbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:26.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.227+0000 7f2d0d333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:26.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.227+0000 7f2d0d333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:26.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.227+0000 7f2d0d333800 5 note: GC not initialized 2024-05-15T14:41:26.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2bbefe5640 20 reqs_thread_entry: start 2024-05-15T14:41:26.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2d0d333800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2d0d333800 20 Filter name: none 2024-05-15T14:41:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2bbcfe1640 20 reqs_thread_entry: start 2024-05-15T14:41:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2d0d333800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2d0d333800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:41:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2d0d333800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2d0d333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:26.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.228+0000 7f2d0d333800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:26.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.229+0000 7f2bbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:26.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.232+0000 7f2d0d333800 20 remove_watcher() i=0 2024-05-15T14:41:26.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.232+0000 7f2d0d333800 2 removed watcher, disabling cache 2024-05-15T14:41:26.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.233+0000 7f2d0d333800 20 remove_watcher() i=1 2024-05-15T14:41:26.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.234+0000 7f2d0d333800 20 remove_watcher() i=2 2024-05-15T14:41:26.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.235+0000 7f2d0d333800 20 remove_watcher() i=3 2024-05-15T14:41:26.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.236+0000 7f2d0d333800 20 remove_watcher() i=4 2024-05-15T14:41:26.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.237+0000 7f2d0d333800 20 remove_watcher() i=5 2024-05-15T14:41:26.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.238+0000 7f2d0d333800 20 remove_watcher() i=6 2024-05-15T14:41:26.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:26.239+0000 7f2d0d333800 20 remove_watcher() i=7 2024-05-15T14:41:27.305 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:27.305 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:27.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.349+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.351+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:27.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.351+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.352+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:27.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.352+0000 7f574963f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:27.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.352+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.352+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:27.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.352+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.353+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:27.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.353+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.354+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:27.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.354+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.354+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:27.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.354+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.354+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:27.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.354+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:27.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 20 zone MyZone found 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.355+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.356+0000 7f574963f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.356+0000 7f574963f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:27.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.356+0000 7f574963f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:27.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.356+0000 7f574963f800 20 started sync module instance, tier type = 2024-05-15T14:41:27.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.356+0000 7f574963f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:27.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.367+0000 7f574963f800 20 add_watcher() i=0 2024-05-15T14:41:27.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.367+0000 7f574963f800 20 add_watcher() i=1 2024-05-15T14:41:27.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.367+0000 7f574963f800 20 add_watcher() i=2 2024-05-15T14:41:27.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.367+0000 7f574963f800 20 add_watcher() i=3 2024-05-15T14:41:27.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.367+0000 7f574963f800 20 add_watcher() i=4 2024-05-15T14:41:27.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.367+0000 7f574963f800 20 add_watcher() i=5 2024-05-15T14:41:27.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.367+0000 7f574963f800 20 add_watcher() i=6 2024-05-15T14:41:27.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.368+0000 7f574963f800 20 add_watcher() i=7 2024-05-15T14:41:27.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.368+0000 7f574963f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:27.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.370+0000 7f55fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.370+0000 7f574963f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.370+0000 7f574963f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.370+0000 7f574963f800 5 note: GC not initialized 2024-05-15T14:41:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.371+0000 7f55fcfe1640 20 reqs_thread_entry: start 2024-05-15T14:41:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.371+0000 7f574963f800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.371+0000 7f574963f800 20 Filter name: none 2024-05-15T14:41:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.371+0000 7f55767fc640 20 reqs_thread_entry: start 2024-05-15T14:41:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.371+0000 7f574963f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.371+0000 7f574963f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:27.371+0000 7f574963f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.371+0000 7f574963f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.371+0000 7f574963f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.372+0000 7f55fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:27.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.375+0000 7f574963f800 20 remove_watcher() i=0 2024-05-15T14:41:27.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.375+0000 7f574963f800 2 removed watcher, disabling cache 2024-05-15T14:41:27.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.376+0000 7f574963f800 20 remove_watcher() i=1 2024-05-15T14:41:27.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.377+0000 7f574963f800 20 remove_watcher() i=2 2024-05-15T14:41:27.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.378+0000 7f574963f800 20 remove_watcher() i=3 2024-05-15T14:41:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.379+0000 7f574963f800 20 remove_watcher() i=4 2024-05-15T14:41:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.380+0000 7f574963f800 20 remove_watcher() i=5 2024-05-15T14:41:27.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.381+0000 7f574963f800 20 remove_watcher() i=6 2024-05-15T14:41:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:27.382+0000 7f574963f800 20 remove_watcher() i=7 2024-05-15T14:41:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.492+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.493+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:28.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.493+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.494+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.494+0000 7f42fec12800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.494+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.495+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.495+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.495+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:28.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.496+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.496+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.496+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.497+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.497+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.497+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.497+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.498+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.498+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.498+0000 7f42fec12800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 zone MyZone found 2024-05-15T14:41:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 rados->read ofs=0 len=0 2024-05-15T14:41:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 started sync module instance, tier type = 2024-05-15T14:41:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.499+0000 7f42fec12800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:28.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.510+0000 7f42fec12800 20 add_watcher() i=0 2024-05-15T14:41:28.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.510+0000 7f42fec12800 20 add_watcher() i=1 2024-05-15T14:41:28.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.510+0000 7f42fec12800 20 add_watcher() i=2 2024-05-15T14:41:28.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.510+0000 7f42fec12800 20 add_watcher() i=3 2024-05-15T14:41:28.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.510+0000 7f42fec12800 20 add_watcher() i=4 2024-05-15T14:41:28.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.510+0000 7f42fec12800 20 add_watcher() i=5 2024-05-15T14:41:28.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.510+0000 7f42fec12800 20 add_watcher() i=6 2024-05-15T14:41:28.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.511+0000 7f42fec12800 20 add_watcher() i=7 2024-05-15T14:41:28.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.511+0000 7f42fec12800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.513+0000 7f41b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.514+0000 7f42fec12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.514+0000 7f42fec12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.514+0000 7f42fec12800 5 note: GC not initialized 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.514+0000 7f412b7fe640 20 reqs_thread_entry: start 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.514+0000 7f42fec12800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.514+0000 7f42fec12800 20 Filter name: none 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.514+0000 7f41297fa640 20 reqs_thread_entry: start 2024-05-15T14:41:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.514+0000 7f42fec12800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.515+0000 7f42fec12800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:41:28.515+0000 7f42fec12800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:28.516 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:41:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.515+0000 7f42fec12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.515+0000 7f42fec12800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:28.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.516+0000 7f41b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.519+0000 7f42fec12800 20 remove_watcher() i=0 2024-05-15T14:41:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.519+0000 7f42fec12800 2 removed watcher, disabling cache 2024-05-15T14:41:28.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.520+0000 7f42fec12800 20 remove_watcher() i=1 2024-05-15T14:41:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.521+0000 7f42fec12800 20 remove_watcher() i=2 2024-05-15T14:41:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.522+0000 7f42fec12800 20 remove_watcher() i=3 2024-05-15T14:41:28.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.524+0000 7f42fec12800 20 remove_watcher() i=4 2024-05-15T14:41:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.525+0000 7f42fec12800 20 remove_watcher() i=5 2024-05-15T14:41:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.526+0000 7f42fec12800 20 remove_watcher() i=6 2024-05-15T14:41:28.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:28.527+0000 7f42fec12800 20 remove_watcher() i=7 2024-05-15T14:41:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.637+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.639+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:29.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.639+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.640+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:29.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.640+0000 7f28f212a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:29.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.640+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.640+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:29.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.640+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.641+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.641+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.642+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.642+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.642+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.642+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.642+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.642+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.643+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:29.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.643+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:29.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 zone MyZone found 2024-05-15T14:41:29.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:29.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:29.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 started sync module instance, tier type = 2024-05-15T14:41:29.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.644+0000 7f28f212a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:29.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.655+0000 7f28f212a800 20 add_watcher() i=0 2024-05-15T14:41:29.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.655+0000 7f28f212a800 20 add_watcher() i=1 2024-05-15T14:41:29.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.655+0000 7f28f212a800 20 add_watcher() i=2 2024-05-15T14:41:29.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.655+0000 7f28f212a800 20 add_watcher() i=3 2024-05-15T14:41:29.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.655+0000 7f28f212a800 20 add_watcher() i=4 2024-05-15T14:41:29.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.655+0000 7f28f212a800 20 add_watcher() i=5 2024-05-15T14:41:29.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.655+0000 7f28f212a800 20 add_watcher() i=6 2024-05-15T14:41:29.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.656+0000 7f28f212a800 20 add_watcher() i=7 2024-05-15T14:41:29.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.656+0000 7f28f212a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:29.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.658+0000 7f279ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.659+0000 7f28f212a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.659+0000 7f28f212a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.659+0000 7f28f212a800 5 note: GC not initialized 2024-05-15T14:41:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.659+0000 7f279effd640 20 reqs_thread_entry: start 2024-05-15T14:41:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.659+0000 7f28f212a800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.659+0000 7f28f212a800 20 Filter name: none 2024-05-15T14:41:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.659+0000 7f279cff9640 20 reqs_thread_entry: start 2024-05-15T14:41:29.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.659+0000 7f28f212a800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:29.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.660+0000 7f28f212a800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:29.661 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:41:29.660+0000 7f28f212a800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:29.661 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:41:29.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.660+0000 7f28f212a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:29.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.660+0000 7f28f212a800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:29.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.661+0000 7f279ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:29.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.663+0000 7f28f212a800 20 remove_watcher() i=0 2024-05-15T14:41:29.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.663+0000 7f28f212a800 2 removed watcher, disabling cache 2024-05-15T14:41:29.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.664+0000 7f28f212a800 20 remove_watcher() i=1 2024-05-15T14:41:29.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.665+0000 7f28f212a800 20 remove_watcher() i=2 2024-05-15T14:41:29.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.666+0000 7f28f212a800 20 remove_watcher() i=3 2024-05-15T14:41:29.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.668+0000 7f28f212a800 20 remove_watcher() i=4 2024-05-15T14:41:29.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.669+0000 7f28f212a800 20 remove_watcher() i=5 2024-05-15T14:41:29.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.670+0000 7f28f212a800 20 remove_watcher() i=6 2024-05-15T14:41:29.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:29.671+0000 7f28f212a800 20 remove_watcher() i=7 2024-05-15T14:41:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:30.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.781+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.783+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:30.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.783+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.784+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:30.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.784+0000 7f5f6a52a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:30.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.784+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.784+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:30.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.784+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.785+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:30.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.785+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.786+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:30.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.786+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.786+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:30.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.786+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.786+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:30.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.786+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.787+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:30.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.787+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.787+0000 7f5f6a52a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:30.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 zone MyZone found 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:30.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:30.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 started sync module instance, tier type = 2024-05-15T14:41:30.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.788+0000 7f5f6a52a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.800+0000 7f5f6a52a800 20 add_watcher() i=0 2024-05-15T14:41:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.800+0000 7f5f6a52a800 20 add_watcher() i=1 2024-05-15T14:41:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.800+0000 7f5f6a52a800 20 add_watcher() i=2 2024-05-15T14:41:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.800+0000 7f5f6a52a800 20 add_watcher() i=3 2024-05-15T14:41:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.800+0000 7f5f6a52a800 20 add_watcher() i=4 2024-05-15T14:41:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.800+0000 7f5f6a52a800 20 add_watcher() i=5 2024-05-15T14:41:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.800+0000 7f5f6a52a800 20 add_watcher() i=6 2024-05-15T14:41:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.801+0000 7f5f6a52a800 20 add_watcher() i=7 2024-05-15T14:41:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.801+0000 7f5f6a52a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.803+0000 7f5e1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.803+0000 7f5f6a52a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:30.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.803+0000 7f5f6a52a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:30.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.803+0000 7f5f6a52a800 5 note: GC not initialized 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.803+0000 7f5d977fe640 20 reqs_thread_entry: start 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.803+0000 7f5f6a52a800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.803+0000 7f5f6a52a800 20 Filter name: none 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.803+0000 7f5d957fa640 20 reqs_thread_entry: start 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.804+0000 7f5f6a52a800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.804+0000 7f5f6a52a800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.804+0000 7f5f6a52a800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.804+0000 7f5f6a52a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:30.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.804+0000 7f5f6a52a800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:30.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.805+0000 7f5e1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.807+0000 7f5f6a52a800 20 remove_watcher() i=0 2024-05-15T14:41:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.807+0000 7f5f6a52a800 2 removed watcher, disabling cache 2024-05-15T14:41:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.809+0000 7f5f6a52a800 20 remove_watcher() i=1 2024-05-15T14:41:30.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.810+0000 7f5f6a52a800 20 remove_watcher() i=2 2024-05-15T14:41:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.811+0000 7f5f6a52a800 20 remove_watcher() i=3 2024-05-15T14:41:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.812+0000 7f5f6a52a800 20 remove_watcher() i=4 2024-05-15T14:41:30.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.813+0000 7f5f6a52a800 20 remove_watcher() i=5 2024-05-15T14:41:30.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.814+0000 7f5f6a52a800 20 remove_watcher() i=6 2024-05-15T14:41:30.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:30.815+0000 7f5f6a52a800 20 remove_watcher() i=7 2024-05-15T14:41:31.881 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:31.881 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:31.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.926+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.927+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:31.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.927+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.928+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:31.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.928+0000 7fb48d440800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:31.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.928+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.928+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:31.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.928+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.929+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:31.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.929+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.930+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:31.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.930+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.930+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:31.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.930+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.931+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:31.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.931+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.931+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:31.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.931+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:31.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 zone MyZone found 2024-05-15T14:41:31.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:31.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 rados->read ofs=0 len=0 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 started sync module instance, tier type = 2024-05-15T14:41:31.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.932+0000 7fb48d440800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:31.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.943+0000 7fb48d440800 20 add_watcher() i=0 2024-05-15T14:41:31.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.943+0000 7fb48d440800 20 add_watcher() i=1 2024-05-15T14:41:31.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.943+0000 7fb48d440800 20 add_watcher() i=2 2024-05-15T14:41:31.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.943+0000 7fb48d440800 20 add_watcher() i=3 2024-05-15T14:41:31.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.943+0000 7fb48d440800 20 add_watcher() i=4 2024-05-15T14:41:31.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.943+0000 7fb48d440800 20 add_watcher() i=5 2024-05-15T14:41:31.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.943+0000 7fb48d440800 20 add_watcher() i=6 2024-05-15T14:41:31.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.944+0000 7fb48d440800 20 add_watcher() i=7 2024-05-15T14:41:31.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.944+0000 7fb48d440800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.946+0000 7fb33efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.947+0000 7fb48d440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.947+0000 7fb48d440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.947+0000 7fb48d440800 5 note: GC not initialized 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.947+0000 7fb33dfdb640 20 reqs_thread_entry: start 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.947+0000 7fb48d440800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.947+0000 7fb48d440800 20 Filter name: none 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.947+0000 7fb2af7fe640 20 reqs_thread_entry: start 2024-05-15T14:41:31.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.947+0000 7fb48d440800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:31.949 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:31.948+0000 7fb48d440800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:31.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.948+0000 7fb48d440800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:31.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.948+0000 7fb48d440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:31.949 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:31.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.948+0000 7fb48d440800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:31.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.949+0000 7fb33efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:31.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.951+0000 7fb48d440800 20 remove_watcher() i=0 2024-05-15T14:41:31.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.951+0000 7fb48d440800 2 removed watcher, disabling cache 2024-05-15T14:41:31.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.953+0000 7fb48d440800 20 remove_watcher() i=1 2024-05-15T14:41:31.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.954+0000 7fb48d440800 20 remove_watcher() i=2 2024-05-15T14:41:31.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.955+0000 7fb48d440800 20 remove_watcher() i=3 2024-05-15T14:41:31.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.956+0000 7fb48d440800 20 remove_watcher() i=4 2024-05-15T14:41:31.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.957+0000 7fb48d440800 20 remove_watcher() i=5 2024-05-15T14:41:31.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.958+0000 7fb48d440800 20 remove_watcher() i=6 2024-05-15T14:41:31.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:31.959+0000 7fb48d440800 20 remove_watcher() i=7 2024-05-15T14:41:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:33.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.068+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.070+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:33.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.070+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.070+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:33.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.070+0000 7f239b327800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:33.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.070+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.071+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:33.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.071+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.071+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:33.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.071+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.072+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:33.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.072+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.073+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:33.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.073+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.073+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:33.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.073+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:33.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 20 zone MyZone found 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.074+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.075+0000 7f239b327800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.075+0000 7f239b327800 20 rados->read ofs=0 len=0 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.075+0000 7f239b327800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:33.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.075+0000 7f239b327800 20 started sync module instance, tier type = 2024-05-15T14:41:33.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.075+0000 7f239b327800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:33.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.086+0000 7f239b327800 20 add_watcher() i=0 2024-05-15T14:41:33.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.086+0000 7f239b327800 20 add_watcher() i=1 2024-05-15T14:41:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.086+0000 7f239b327800 20 add_watcher() i=2 2024-05-15T14:41:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.086+0000 7f239b327800 20 add_watcher() i=3 2024-05-15T14:41:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.086+0000 7f239b327800 20 add_watcher() i=4 2024-05-15T14:41:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.086+0000 7f239b327800 20 add_watcher() i=5 2024-05-15T14:41:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.086+0000 7f239b327800 20 add_watcher() i=6 2024-05-15T14:41:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.087+0000 7f239b327800 20 add_watcher() i=7 2024-05-15T14:41:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.087+0000 7f239b327800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:33.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.089+0000 7f224dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:33.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.089+0000 7f239b327800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:33.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.089+0000 7f239b327800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:33.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.089+0000 7f239b327800 5 note: GC not initialized 2024-05-15T14:41:33.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.089+0000 7f224cfe1640 20 reqs_thread_entry: start 2024-05-15T14:41:33.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.089+0000 7f239b327800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:33.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.089+0000 7f239b327800 20 Filter name: none 2024-05-15T14:41:33.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.089+0000 7f21c67fc640 20 reqs_thread_entry: start 2024-05-15T14:41:33.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.090+0000 7f239b327800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:33.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.090+0000 7f239b327800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:33.091 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:41:33.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.090+0000 7f239b327800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:33.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.090+0000 7f239b327800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:33.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.090+0000 7f239b327800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:33.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.091+0000 7f224dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:33.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.093+0000 7f239b327800 20 remove_watcher() i=0 2024-05-15T14:41:33.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.093+0000 7f239b327800 2 removed watcher, disabling cache 2024-05-15T14:41:33.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.094+0000 7f239b327800 20 remove_watcher() i=1 2024-05-15T14:41:33.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.095+0000 7f239b327800 20 remove_watcher() i=2 2024-05-15T14:41:33.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.097+0000 7f239b327800 20 remove_watcher() i=3 2024-05-15T14:41:33.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.098+0000 7f239b327800 20 remove_watcher() i=4 2024-05-15T14:41:33.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.099+0000 7f239b327800 20 remove_watcher() i=5 2024-05-15T14:41:33.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.100+0000 7f239b327800 20 remove_watcher() i=6 2024-05-15T14:41:33.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:33.101+0000 7f239b327800 20 remove_watcher() i=7 2024-05-15T14:41:34.166 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:34.167 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:34.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.211+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.213+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.213+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.214+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.214+0000 7f756d328800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.214+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.214+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.214+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.215+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.215+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.216+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.216+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.216+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.216+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.217+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.217+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.217+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:34.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.217+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 zone MyZone found 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:34.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 rados->read ofs=0 len=0 2024-05-15T14:41:34.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:34.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 started sync module instance, tier type = 2024-05-15T14:41:34.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.218+0000 7f756d328800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:34.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.229+0000 7f756d328800 20 add_watcher() i=0 2024-05-15T14:41:34.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.229+0000 7f756d328800 20 add_watcher() i=1 2024-05-15T14:41:34.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.229+0000 7f756d328800 20 add_watcher() i=2 2024-05-15T14:41:34.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.229+0000 7f756d328800 20 add_watcher() i=3 2024-05-15T14:41:34.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.229+0000 7f756d328800 20 add_watcher() i=4 2024-05-15T14:41:34.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.229+0000 7f756d328800 20 add_watcher() i=5 2024-05-15T14:41:34.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.229+0000 7f756d328800 20 add_watcher() i=6 2024-05-15T14:41:34.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.230+0000 7f756d328800 20 add_watcher() i=7 2024-05-15T14:41:34.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.230+0000 7f756d328800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:34.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.232+0000 7f741efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:34.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.232+0000 7f756d328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:34.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.232+0000 7f756d328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:34.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.233+0000 7f756d328800 5 note: GC not initialized 2024-05-15T14:41:34.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.233+0000 7f741dfe3640 20 reqs_thread_entry: start 2024-05-15T14:41:34.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.233+0000 7f756d328800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:34.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.233+0000 7f756d328800 20 Filter name: none 2024-05-15T14:41:34.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.233+0000 7f738f7fe640 20 reqs_thread_entry: start 2024-05-15T14:41:34.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.233+0000 7f756d328800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:34.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.233+0000 7f756d328800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:34.235 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:34.234+0000 7f756d328800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:34.235 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:34.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.234+0000 7f756d328800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:34.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.234+0000 7f756d328800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:34.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.235+0000 7f741efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:34.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.237+0000 7f756d328800 20 remove_watcher() i=0 2024-05-15T14:41:34.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.237+0000 7f756d328800 2 removed watcher, disabling cache 2024-05-15T14:41:34.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.238+0000 7f756d328800 20 remove_watcher() i=1 2024-05-15T14:41:34.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.239+0000 7f756d328800 20 remove_watcher() i=2 2024-05-15T14:41:34.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.240+0000 7f756d328800 20 remove_watcher() i=3 2024-05-15T14:41:34.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.241+0000 7f756d328800 20 remove_watcher() i=4 2024-05-15T14:41:34.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.242+0000 7f756d328800 20 remove_watcher() i=5 2024-05-15T14:41:34.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.243+0000 7f756d328800 20 remove_watcher() i=6 2024-05-15T14:41:34.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:34.244+0000 7f756d328800 20 remove_watcher() i=7 2024-05-15T14:41:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:35.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.355+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.356+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.356+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.357+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.357+0000 7fa640546800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.357+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.357+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.357+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.358+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.358+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.359+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.359+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.359+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.359+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.360+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.360+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:35.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 zone MyZone found 2024-05-15T14:41:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.361+0000 7fa640546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.362+0000 7fa640546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.362+0000 7fa640546800 20 started sync module instance, tier type = 2024-05-15T14:41:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.362+0000 7fa640546800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:35.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.373+0000 7fa640546800 20 add_watcher() i=0 2024-05-15T14:41:35.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.373+0000 7fa640546800 20 add_watcher() i=1 2024-05-15T14:41:35.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.373+0000 7fa640546800 20 add_watcher() i=2 2024-05-15T14:41:35.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.373+0000 7fa640546800 20 add_watcher() i=3 2024-05-15T14:41:35.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.373+0000 7fa640546800 20 add_watcher() i=4 2024-05-15T14:41:35.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.373+0000 7fa640546800 20 add_watcher() i=5 2024-05-15T14:41:35.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.373+0000 7fa640546800 20 add_watcher() i=6 2024-05-15T14:41:35.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.374+0000 7fa640546800 20 add_watcher() i=7 2024-05-15T14:41:35.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.374+0000 7fa640546800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:35.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.376+0000 7fa4f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:35.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.376+0000 7fa640546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:35.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.376+0000 7fa640546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:35.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.376+0000 7fa640546800 5 note: GC not initialized 2024-05-15T14:41:35.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.376+0000 7fa46f7fe640 20 reqs_thread_entry: start 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.376+0000 7fa640546800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.376+0000 7fa640546800 20 Filter name: none 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.377+0000 7fa46d7fa640 20 reqs_thread_entry: start 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.377+0000 7fa640546800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:41:35.377+0000 7fa640546800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.377+0000 7fa640546800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.377+0000 7fa640546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.377+0000 7fa640546800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:35.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.378+0000 7fa4f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:35.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.380+0000 7fa640546800 20 remove_watcher() i=0 2024-05-15T14:41:35.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.380+0000 7fa640546800 2 removed watcher, disabling cache 2024-05-15T14:41:35.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.382+0000 7fa640546800 20 remove_watcher() i=1 2024-05-15T14:41:35.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.383+0000 7fa640546800 20 remove_watcher() i=2 2024-05-15T14:41:35.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.384+0000 7fa640546800 20 remove_watcher() i=3 2024-05-15T14:41:35.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.385+0000 7fa640546800 20 remove_watcher() i=4 2024-05-15T14:41:35.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.386+0000 7fa640546800 20 remove_watcher() i=5 2024-05-15T14:41:35.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.387+0000 7fa640546800 20 remove_watcher() i=6 2024-05-15T14:41:35.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:35.388+0000 7fa640546800 20 remove_watcher() i=7 2024-05-15T14:41:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:36.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.498+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.499+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.499+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.500+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.500+0000 7f4a97546800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.500+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.501+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.501+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.501+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:36.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.501+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.502+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.502+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.503+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.503+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.503+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.503+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:36.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 20 zone MyZone found 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.504+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.505+0000 7f4a97546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.505+0000 7f4a97546800 20 rados->read ofs=0 len=0 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.505+0000 7f4a97546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.505+0000 7f4a97546800 20 started sync module instance, tier type = 2024-05-15T14:41:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.505+0000 7f4a97546800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:36.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.516+0000 7f4a97546800 20 add_watcher() i=0 2024-05-15T14:41:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.516+0000 7f4a97546800 20 add_watcher() i=1 2024-05-15T14:41:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.516+0000 7f4a97546800 20 add_watcher() i=2 2024-05-15T14:41:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.516+0000 7f4a97546800 20 add_watcher() i=3 2024-05-15T14:41:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.516+0000 7f4a97546800 20 add_watcher() i=4 2024-05-15T14:41:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.516+0000 7f4a97546800 20 add_watcher() i=5 2024-05-15T14:41:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.516+0000 7f4a97546800 20 add_watcher() i=6 2024-05-15T14:41:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.517+0000 7f4a97546800 20 add_watcher() i=7 2024-05-15T14:41:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.517+0000 7f4a97546800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.519+0000 7f494b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.519+0000 7f4a97546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:36.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.519+0000 7f4a97546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.519+0000 7f4a97546800 5 note: GC not initialized 2024-05-15T14:41:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f494a7e4640 20 reqs_thread_entry: start 2024-05-15T14:41:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f4a97546800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f4a97546800 20 Filter name: none 2024-05-15T14:41:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f48bbfff640 20 reqs_thread_entry: start 2024-05-15T14:41:36.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f4a97546800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f4a97546800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:41:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f4a97546800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f4a97546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.520+0000 7f4a97546800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.521+0000 7f494b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.523+0000 7f4a97546800 20 remove_watcher() i=0 2024-05-15T14:41:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.523+0000 7f4a97546800 2 removed watcher, disabling cache 2024-05-15T14:41:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.524+0000 7f4a97546800 20 remove_watcher() i=1 2024-05-15T14:41:36.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.526+0000 7f4a97546800 20 remove_watcher() i=2 2024-05-15T14:41:36.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.527+0000 7f4a97546800 20 remove_watcher() i=3 2024-05-15T14:41:36.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.528+0000 7f4a97546800 20 remove_watcher() i=4 2024-05-15T14:41:36.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.529+0000 7f4a97546800 20 remove_watcher() i=5 2024-05-15T14:41:36.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.530+0000 7f4a97546800 20 remove_watcher() i=6 2024-05-15T14:41:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:36.531+0000 7f4a97546800 20 remove_watcher() i=7 2024-05-15T14:41:37.596 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:37.597 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:37.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.639+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.641+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:37.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.641+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.642+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:37.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.642+0000 7f0baa733800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:37.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.642+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.642+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:37.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.642+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.643+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:37.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.643+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.644+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:37.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.644+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.644+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:37.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.644+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.644+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:37.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.645+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.645+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:37.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.645+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:37.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 zone MyZone found 2024-05-15T14:41:37.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:37.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:37.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 rados->read ofs=0 len=0 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 started sync module instance, tier type = 2024-05-15T14:41:37.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.646+0000 7f0baa733800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:37.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.658+0000 7f0baa733800 20 add_watcher() i=0 2024-05-15T14:41:37.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.658+0000 7f0baa733800 20 add_watcher() i=1 2024-05-15T14:41:37.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.658+0000 7f0baa733800 20 add_watcher() i=2 2024-05-15T14:41:37.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.658+0000 7f0baa733800 20 add_watcher() i=3 2024-05-15T14:41:37.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.658+0000 7f0baa733800 20 add_watcher() i=4 2024-05-15T14:41:37.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.658+0000 7f0baa733800 20 add_watcher() i=5 2024-05-15T14:41:37.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.658+0000 7f0baa733800 20 add_watcher() i=6 2024-05-15T14:41:37.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.659+0000 7f0baa733800 20 add_watcher() i=7 2024-05-15T14:41:37.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.659+0000 7f0baa733800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:37.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.661+0000 7f0a5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:37.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.661+0000 7f0baa733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:37.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.661+0000 7f0baa733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:37.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.661+0000 7f0baa733800 5 note: GC not initialized 2024-05-15T14:41:37.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.661+0000 7f09d77fe640 20 reqs_thread_entry: start 2024-05-15T14:41:37.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.661+0000 7f0baa733800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:37.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.661+0000 7f0baa733800 20 Filter name: none 2024-05-15T14:41:37.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.662+0000 7f09d57fa640 20 reqs_thread_entry: start 2024-05-15T14:41:37.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.662+0000 7f0baa733800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:37.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.662+0000 7f0baa733800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:37.663 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:41:37.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.662+0000 7f0baa733800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:37.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.662+0000 7f0baa733800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:37.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.662+0000 7f0baa733800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:37.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.663+0000 7f0a5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.665+0000 7f0baa733800 20 remove_watcher() i=0 2024-05-15T14:41:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.665+0000 7f0baa733800 2 removed watcher, disabling cache 2024-05-15T14:41:37.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.666+0000 7f0baa733800 20 remove_watcher() i=1 2024-05-15T14:41:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.667+0000 7f0baa733800 20 remove_watcher() i=2 2024-05-15T14:41:37.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.668+0000 7f0baa733800 20 remove_watcher() i=3 2024-05-15T14:41:37.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.669+0000 7f0baa733800 20 remove_watcher() i=4 2024-05-15T14:41:37.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.670+0000 7f0baa733800 20 remove_watcher() i=5 2024-05-15T14:41:37.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.671+0000 7f0baa733800 20 remove_watcher() i=6 2024-05-15T14:41:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:37.672+0000 7f0baa733800 20 remove_watcher() i=7 2024-05-15T14:41:38.738 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:38.739 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.783+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.784+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:38.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.784+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.785+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:38.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.785+0000 7fc16dd23800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:38.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.785+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.785+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:38.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.785+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.786+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.786+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.787+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.787+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.787+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:38.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.787+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.788+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:38.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.788+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:38.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:38.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 zone MyZone found 2024-05-15T14:41:38.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:38.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.789+0000 7fc16dd23800 20 rados->read ofs=0 len=0 2024-05-15T14:41:38.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.790+0000 7fc16dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:38.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.790+0000 7fc16dd23800 20 started sync module instance, tier type = 2024-05-15T14:41:38.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.790+0000 7fc16dd23800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:38.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 20 add_watcher() i=0 2024-05-15T14:41:38.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 20 add_watcher() i=1 2024-05-15T14:41:38.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 20 add_watcher() i=2 2024-05-15T14:41:38.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 20 add_watcher() i=3 2024-05-15T14:41:38.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 20 add_watcher() i=4 2024-05-15T14:41:38.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 20 add_watcher() i=5 2024-05-15T14:41:38.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 20 add_watcher() i=6 2024-05-15T14:41:38.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 20 add_watcher() i=7 2024-05-15T14:41:38.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.801+0000 7fc16dd23800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:38.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.803+0000 7fc01b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.804+0000 7fc16dd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.804+0000 7fc16dd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.804+0000 7fc16dd23800 5 note: GC not initialized 2024-05-15T14:41:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.804+0000 7fc01a7fc640 20 reqs_thread_entry: start 2024-05-15T14:41:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.804+0000 7fc16dd23800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.804+0000 7fc16dd23800 20 Filter name: none 2024-05-15T14:41:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.804+0000 7fbf8bfff640 20 reqs_thread_entry: start 2024-05-15T14:41:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.804+0000 7fc16dd23800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:38.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.805+0000 7fc16dd23800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:38.806 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:38.805+0000 7fc16dd23800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:38.806 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:38.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.805+0000 7fc16dd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:38.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.805+0000 7fc16dd23800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:38.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.806+0000 7fc01b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:38.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.808+0000 7fc16dd23800 20 remove_watcher() i=0 2024-05-15T14:41:38.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.808+0000 7fc16dd23800 2 removed watcher, disabling cache 2024-05-15T14:41:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.810+0000 7fc16dd23800 20 remove_watcher() i=1 2024-05-15T14:41:38.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.811+0000 7fc16dd23800 20 remove_watcher() i=2 2024-05-15T14:41:38.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.812+0000 7fc16dd23800 20 remove_watcher() i=3 2024-05-15T14:41:38.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.813+0000 7fc16dd23800 20 remove_watcher() i=4 2024-05-15T14:41:38.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.814+0000 7fc16dd23800 20 remove_watcher() i=5 2024-05-15T14:41:38.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.815+0000 7fc16dd23800 20 remove_watcher() i=6 2024-05-15T14:41:38.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:38.816+0000 7fc16dd23800 20 remove_watcher() i=7 2024-05-15T14:41:39.882 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:39.882 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.927+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.929+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.929+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.930+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.930+0000 7f580b2bb800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.930+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.930+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.930+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.931+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.931+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.932+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.932+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.932+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:39.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.932+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.932+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:39.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.932+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:39.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 20 zone MyZone found 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.933+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.934+0000 7f580b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:39.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.934+0000 7f580b2bb800 20 rados->read ofs=0 len=0 2024-05-15T14:41:39.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.934+0000 7f580b2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:39.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.934+0000 7f580b2bb800 20 started sync module instance, tier type = 2024-05-15T14:41:39.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.934+0000 7f580b2bb800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:39.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.946+0000 7f580b2bb800 20 add_watcher() i=0 2024-05-15T14:41:39.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.946+0000 7f580b2bb800 20 add_watcher() i=1 2024-05-15T14:41:39.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.946+0000 7f580b2bb800 20 add_watcher() i=2 2024-05-15T14:41:39.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.946+0000 7f580b2bb800 20 add_watcher() i=3 2024-05-15T14:41:39.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.946+0000 7f580b2bb800 20 add_watcher() i=4 2024-05-15T14:41:39.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.946+0000 7f580b2bb800 20 add_watcher() i=5 2024-05-15T14:41:39.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.946+0000 7f580b2bb800 20 add_watcher() i=6 2024-05-15T14:41:39.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.947+0000 7f580b2bb800 20 add_watcher() i=7 2024-05-15T14:41:39.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.947+0000 7f580b2bb800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.949+0000 7f56befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.949+0000 7f580b2bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.949+0000 7f580b2bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.949+0000 7f580b2bb800 5 note: GC not initialized 2024-05-15T14:41:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.949+0000 7f56bdfe3640 20 reqs_thread_entry: start 2024-05-15T14:41:39.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.949+0000 7f580b2bb800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:39.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.949+0000 7f580b2bb800 20 Filter name: none 2024-05-15T14:41:39.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.950+0000 7f562f7fe640 20 reqs_thread_entry: start 2024-05-15T14:41:39.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.950+0000 7f580b2bb800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:39.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.950+0000 7f580b2bb800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:39.952 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:39.950+0000 7f580b2bb800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:39.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.950+0000 7f580b2bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:39.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.950+0000 7f580b2bb800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:39.952 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:39.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.951+0000 7f56befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.953+0000 7f580b2bb800 20 remove_watcher() i=0 2024-05-15T14:41:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.953+0000 7f580b2bb800 2 removed watcher, disabling cache 2024-05-15T14:41:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.955+0000 7f580b2bb800 20 remove_watcher() i=1 2024-05-15T14:41:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.956+0000 7f580b2bb800 20 remove_watcher() i=2 2024-05-15T14:41:39.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.957+0000 7f580b2bb800 20 remove_watcher() i=3 2024-05-15T14:41:39.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.958+0000 7f580b2bb800 20 remove_watcher() i=4 2024-05-15T14:41:39.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.959+0000 7f580b2bb800 20 remove_watcher() i=5 2024-05-15T14:41:39.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.960+0000 7f580b2bb800 20 remove_watcher() i=6 2024-05-15T14:41:39.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:39.961+0000 7f580b2bb800 20 remove_watcher() i=7 2024-05-15T14:41:41.028 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:41.028 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:41.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.073+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.075+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.075+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.076+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.076+0000 7f694421f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:41.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.076+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.076+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:41.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.076+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.077+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.077+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.078+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.078+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.078+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.078+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.078+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.078+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:41.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 20 zone MyZone found 2024-05-15T14:41:41.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:41.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:41.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:41.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.079+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.080+0000 7f694421f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.080+0000 7f694421f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.080+0000 7f694421f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.080+0000 7f694421f800 20 started sync module instance, tier type = 2024-05-15T14:41:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.080+0000 7f694421f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.091+0000 7f694421f800 20 add_watcher() i=0 2024-05-15T14:41:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.091+0000 7f694421f800 20 add_watcher() i=1 2024-05-15T14:41:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.091+0000 7f694421f800 20 add_watcher() i=2 2024-05-15T14:41:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.091+0000 7f694421f800 20 add_watcher() i=3 2024-05-15T14:41:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.091+0000 7f694421f800 20 add_watcher() i=4 2024-05-15T14:41:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.091+0000 7f694421f800 20 add_watcher() i=5 2024-05-15T14:41:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.091+0000 7f694421f800 20 add_watcher() i=6 2024-05-15T14:41:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.093+0000 7f694421f800 20 add_watcher() i=7 2024-05-15T14:41:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.093+0000 7f694421f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.094+0000 7f67f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.095+0000 7f694421f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.095+0000 7f694421f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.095+0000 7f694421f800 5 note: GC not initialized 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.095+0000 7f67f27fc640 20 reqs_thread_entry: start 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.095+0000 7f694421f800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.095+0000 7f694421f800 20 Filter name: none 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.095+0000 7f6763fff640 20 reqs_thread_entry: start 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.095+0000 7f694421f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.096+0000 7f694421f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:41.096+0000 7f694421f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.096+0000 7f694421f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.096+0000 7f694421f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.096+0000 7f67f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.100+0000 7f694421f800 20 remove_watcher() i=0 2024-05-15T14:41:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.100+0000 7f694421f800 2 removed watcher, disabling cache 2024-05-15T14:41:41.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.101+0000 7f694421f800 20 remove_watcher() i=1 2024-05-15T14:41:41.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.104+0000 7f694421f800 20 remove_watcher() i=2 2024-05-15T14:41:41.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.105+0000 7f694421f800 20 remove_watcher() i=3 2024-05-15T14:41:41.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.107+0000 7f694421f800 20 remove_watcher() i=4 2024-05-15T14:41:41.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.109+0000 7f694421f800 20 remove_watcher() i=5 2024-05-15T14:41:41.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.111+0000 7f694421f800 20 remove_watcher() i=6 2024-05-15T14:41:41.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:41.113+0000 7f694421f800 20 remove_watcher() i=7 2024-05-15T14:41:42.180 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:42.180 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:42.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.224+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.226+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:42.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.226+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.227+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:42.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.227+0000 7f2cff52c800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.227+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.227+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.227+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.228+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.228+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.229+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:42.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.229+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.229+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:42.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.229+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.229+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:42.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.230+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.230+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:42.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.230+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 zone MyZone found 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:42.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 rados->read ofs=0 len=0 2024-05-15T14:41:42.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:42.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 started sync module instance, tier type = 2024-05-15T14:41:42.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.231+0000 7f2cff52c800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:42.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.243+0000 7f2cff52c800 20 add_watcher() i=0 2024-05-15T14:41:42.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.243+0000 7f2cff52c800 20 add_watcher() i=1 2024-05-15T14:41:42.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.243+0000 7f2cff52c800 20 add_watcher() i=2 2024-05-15T14:41:42.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.243+0000 7f2cff52c800 20 add_watcher() i=3 2024-05-15T14:41:42.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.243+0000 7f2cff52c800 20 add_watcher() i=4 2024-05-15T14:41:42.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.243+0000 7f2cff52c800 20 add_watcher() i=5 2024-05-15T14:41:42.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.243+0000 7f2cff52c800 20 add_watcher() i=6 2024-05-15T14:41:42.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.244+0000 7f2cff52c800 20 add_watcher() i=7 2024-05-15T14:41:42.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.244+0000 7f2cff52c800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:42.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.246+0000 7f2bb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:42.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.246+0000 7f2cff52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:42.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.246+0000 7f2cff52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:42.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.246+0000 7f2cff52c800 5 note: GC not initialized 2024-05-15T14:41:42.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.246+0000 7f2bb0fe1640 20 reqs_thread_entry: start 2024-05-15T14:41:42.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.246+0000 7f2cff52c800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:42.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.246+0000 7f2cff52c800 20 Filter name: none 2024-05-15T14:41:42.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.247+0000 7f2b2a7fc640 20 reqs_thread_entry: start 2024-05-15T14:41:42.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.247+0000 7f2cff52c800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:42.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.247+0000 7f2cff52c800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:42.249 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:41:42.247+0000 7f2cff52c800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:42.249 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:41:42.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.247+0000 7f2cff52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:42.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.247+0000 7f2cff52c800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:42.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.248+0000 7f2bb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:42.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.250+0000 7f2cff52c800 20 remove_watcher() i=0 2024-05-15T14:41:42.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.250+0000 7f2cff52c800 2 removed watcher, disabling cache 2024-05-15T14:41:42.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.251+0000 7f2cff52c800 20 remove_watcher() i=1 2024-05-15T14:41:42.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.253+0000 7f2cff52c800 20 remove_watcher() i=2 2024-05-15T14:41:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.254+0000 7f2cff52c800 20 remove_watcher() i=3 2024-05-15T14:41:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.255+0000 7f2cff52c800 20 remove_watcher() i=4 2024-05-15T14:41:42.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.256+0000 7f2cff52c800 20 remove_watcher() i=5 2024-05-15T14:41:42.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.257+0000 7f2cff52c800 20 remove_watcher() i=6 2024-05-15T14:41:42.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:42.258+0000 7f2cff52c800 20 remove_watcher() i=7 2024-05-15T14:41:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:43.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.368+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.370+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.370+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.371+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.371+0000 7fbf92d2e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.371+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.371+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.371+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.372+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.372+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.373+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.373+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.373+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.373+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.373+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.373+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 20 zone MyZone found 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.374+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.375+0000 7fbf92d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.375+0000 7fbf92d2e800 20 rados->read ofs=0 len=0 2024-05-15T14:41:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.375+0000 7fbf92d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.375+0000 7fbf92d2e800 20 started sync module instance, tier type = 2024-05-15T14:41:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.375+0000 7fbf92d2e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.387+0000 7fbf92d2e800 20 add_watcher() i=0 2024-05-15T14:41:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.387+0000 7fbf92d2e800 20 add_watcher() i=1 2024-05-15T14:41:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.387+0000 7fbf92d2e800 20 add_watcher() i=2 2024-05-15T14:41:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.387+0000 7fbf92d2e800 20 add_watcher() i=3 2024-05-15T14:41:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.387+0000 7fbf92d2e800 20 add_watcher() i=4 2024-05-15T14:41:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.387+0000 7fbf92d2e800 20 add_watcher() i=5 2024-05-15T14:41:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.387+0000 7fbf92d2e800 20 add_watcher() i=6 2024-05-15T14:41:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.388+0000 7fbf92d2e800 20 add_watcher() i=7 2024-05-15T14:41:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.388+0000 7fbf92d2e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:43.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.390+0000 7fbe457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:43.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.390+0000 7fbf92d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:43.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.390+0000 7fbf92d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:43.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.390+0000 7fbf92d2e800 5 note: GC not initialized 2024-05-15T14:41:43.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.390+0000 7fbdbffff640 20 reqs_thread_entry: start 2024-05-15T14:41:43.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.390+0000 7fbf92d2e800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.390+0000 7fbf92d2e800 20 Filter name: none 2024-05-15T14:41:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.391+0000 7fbdbdffb640 20 reqs_thread_entry: start 2024-05-15T14:41:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.391+0000 7fbf92d2e800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.391+0000 7fbf92d2e800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:43.391+0000 7fbf92d2e800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.391+0000 7fbf92d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.391+0000 7fbf92d2e800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.392+0000 7fbe457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:43.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.395+0000 7fbf92d2e800 20 remove_watcher() i=0 2024-05-15T14:41:43.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.395+0000 7fbf92d2e800 2 removed watcher, disabling cache 2024-05-15T14:41:43.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.396+0000 7fbf92d2e800 20 remove_watcher() i=1 2024-05-15T14:41:43.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.397+0000 7fbf92d2e800 20 remove_watcher() i=2 2024-05-15T14:41:43.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.398+0000 7fbf92d2e800 20 remove_watcher() i=3 2024-05-15T14:41:43.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.399+0000 7fbf92d2e800 20 remove_watcher() i=4 2024-05-15T14:41:43.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.400+0000 7fbf92d2e800 20 remove_watcher() i=5 2024-05-15T14:41:43.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.401+0000 7fbf92d2e800 20 remove_watcher() i=6 2024-05-15T14:41:43.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:43.402+0000 7fbf92d2e800 20 remove_watcher() i=7 2024-05-15T14:41:44.467 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:44.467 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:44.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.511+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.513+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:44.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.513+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.514+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.514+0000 7f020832f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.514+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.514+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.514+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.515+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.515+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.516+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.516+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.516+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:44.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.516+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.516+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.516+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 20 zone MyZone found 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:44.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:44.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.517+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.518+0000 7f020832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:44.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.518+0000 7f020832f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:44.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.518+0000 7f020832f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:44.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.518+0000 7f020832f800 20 started sync module instance, tier type = 2024-05-15T14:41:44.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.518+0000 7f020832f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.529+0000 7f020832f800 20 add_watcher() i=0 2024-05-15T14:41:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.529+0000 7f020832f800 20 add_watcher() i=1 2024-05-15T14:41:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.529+0000 7f020832f800 20 add_watcher() i=2 2024-05-15T14:41:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.529+0000 7f020832f800 20 add_watcher() i=3 2024-05-15T14:41:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.529+0000 7f020832f800 20 add_watcher() i=4 2024-05-15T14:41:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.529+0000 7f020832f800 20 add_watcher() i=5 2024-05-15T14:41:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.529+0000 7f020832f800 20 add_watcher() i=6 2024-05-15T14:41:44.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.530+0000 7f020832f800 20 add_watcher() i=7 2024-05-15T14:41:44.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.530+0000 7f020832f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.532+0000 7f00bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.532+0000 7f020832f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.532+0000 7f020832f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.532+0000 7f020832f800 5 note: GC not initialized 2024-05-15T14:41:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.532+0000 7f00b9fdb640 20 reqs_thread_entry: start 2024-05-15T14:41:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.533+0000 7f020832f800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.533+0000 7f020832f800 20 Filter name: none 2024-05-15T14:41:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.533+0000 7f002b7fe640 20 reqs_thread_entry: start 2024-05-15T14:41:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.533+0000 7f020832f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.533+0000 7f020832f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:41:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:41:44.533+0000 7f020832f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.533+0000 7f020832f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:41:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.533+0000 7f020832f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:41:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:41:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.534+0000 7f00bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:44.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.537+0000 7f020832f800 20 remove_watcher() i=0 2024-05-15T14:41:44.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.537+0000 7f020832f800 2 removed watcher, disabling cache 2024-05-15T14:41:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.538+0000 7f020832f800 20 remove_watcher() i=1 2024-05-15T14:41:44.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.539+0000 7f020832f800 20 remove_watcher() i=2 2024-05-15T14:41:44.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.540+0000 7f020832f800 20 remove_watcher() i=3 2024-05-15T14:41:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.541+0000 7f020832f800 20 remove_watcher() i=4 2024-05-15T14:41:44.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.542+0000 7f020832f800 20 remove_watcher() i=5 2024-05-15T14:41:44.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.543+0000 7f020832f800 20 remove_watcher() i=6 2024-05-15T14:41:44.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:44.544+0000 7f020832f800 20 remove_watcher() i=7 2024-05-15T14:41:44.880 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:41:44.880+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:41:44.880 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:41:44.880+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:41:44.880 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:41:44.880+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:41:44.881 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:41:44.880+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:41:45.354 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:41:45.353+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:41:45.354 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:41:45.353+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:41:45.354 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:41:45.353+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:41:45.354 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:41:45.353+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:41:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:45.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.651+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.652+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:45.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.652+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.653+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:45.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.653+0000 7fb1dce3a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:45.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.653+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.654+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:45.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.654+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.654+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:45.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.654+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.655+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:45.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.655+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.655+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:45.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.655+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.656+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:45.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.656+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.656+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:45.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.656+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:45.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 zone MyZone found 2024-05-15T14:41:45.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:45.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:45.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:45.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:45.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:45.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:45.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:45.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:45.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 started sync module instance, tier type = 2024-05-15T14:41:45.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.657+0000 7fb1dce3a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:45.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.667+0000 7fb1dce3a800 20 add_watcher() i=0 2024-05-15T14:41:45.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.667+0000 7fb1dce3a800 20 add_watcher() i=1 2024-05-15T14:41:45.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.667+0000 7fb1dce3a800 20 add_watcher() i=2 2024-05-15T14:41:45.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.667+0000 7fb1dce3a800 20 add_watcher() i=3 2024-05-15T14:41:45.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.667+0000 7fb1dce3a800 20 add_watcher() i=4 2024-05-15T14:41:45.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.667+0000 7fb1dce3a800 20 add_watcher() i=5 2024-05-15T14:41:45.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.667+0000 7fb1dce3a800 20 add_watcher() i=6 2024-05-15T14:41:45.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.668+0000 7fb1dce3a800 20 add_watcher() i=7 2024-05-15T14:41:45.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.668+0000 7fb1dce3a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:45.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.669+0000 7fb08dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:45.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.670+0000 7fb1dce3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:45.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.670+0000 7fb1dce3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:45.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.670+0000 7fb1dce3a800 5 note: GC not initialized 2024-05-15T14:41:45.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.670+0000 7fb08cfe1640 20 reqs_thread_entry: start 2024-05-15T14:41:45.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.670+0000 7fb1dce3a800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:45.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.670+0000 7fb1dce3a800 20 Filter name: none 2024-05-15T14:41:45.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.670+0000 7fb0067fc640 20 reqs_thread_entry: start 2024-05-15T14:41:45.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:41:45.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:41:45.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:41:45.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 10 cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:41:45.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 10 cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-23_topic_1 : miss 2024-05-15T14:41:45.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:45.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 10 cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-23_topic_1 info.flags=0x0 2024-05-15T14:41:45.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 10 adding MyZone.rgw.meta+topics+topic.:vwwrqh-23_topic_1 to cache LRU end 2024-05-15T14:41:45.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 1 failed to read topic info for name: vwwrqh-23_topic_1 tenant: , ret=-2 2024-05-15T14:41:45.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.671+0000 7fb1dce3a800 10 WARNING: topic name:vwwrqh-23_topic_1 does not exist, deletion is a no-op: ret=-2 2024-05-15T14:41:45.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.672+0000 7fb08dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:45.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.674+0000 7fb1dce3a800 20 remove_watcher() i=0 2024-05-15T14:41:45.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.674+0000 7fb1dce3a800 2 removed watcher, disabling cache 2024-05-15T14:41:45.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.675+0000 7fb1dce3a800 20 remove_watcher() i=1 2024-05-15T14:41:45.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.676+0000 7fb1dce3a800 20 remove_watcher() i=2 2024-05-15T14:41:45.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.677+0000 7fb1dce3a800 20 remove_watcher() i=3 2024-05-15T14:41:45.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.678+0000 7fb1dce3a800 20 remove_watcher() i=4 2024-05-15T14:41:45.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.679+0000 7fb1dce3a800 20 remove_watcher() i=5 2024-05-15T14:41:45.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.680+0000 7fb1dce3a800 20 remove_watcher() i=6 2024-05-15T14:41:45.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.681+0000 7fb1dce3a800 20 remove_watcher() i=7 2024-05-15T14:41:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.776+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.778+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.778+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.779+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.779+0000 7f8a7e21f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.779+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.779+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:45.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.779+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.779+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:45.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.779+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.780+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.780+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.781+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.781+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.781+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.781+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.781+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:45.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 20 zone MyZone found 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.782+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.783+0000 7f8a7e21f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.783+0000 7f8a7e21f800 20 started sync module instance, tier type = 2024-05-15T14:41:45.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.783+0000 7f8a7e21f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:45.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.792+0000 7f8a7e21f800 20 add_watcher() i=0 2024-05-15T14:41:45.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.792+0000 7f8a7e21f800 20 add_watcher() i=1 2024-05-15T14:41:45.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.792+0000 7f8a7e21f800 20 add_watcher() i=2 2024-05-15T14:41:45.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.792+0000 7f8a7e21f800 20 add_watcher() i=3 2024-05-15T14:41:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.792+0000 7f8a7e21f800 20 add_watcher() i=4 2024-05-15T14:41:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.792+0000 7f8a7e21f800 20 add_watcher() i=5 2024-05-15T14:41:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.792+0000 7f8a7e21f800 20 add_watcher() i=6 2024-05-15T14:41:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.793+0000 7f8a7e21f800 20 add_watcher() i=7 2024-05-15T14:41:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.793+0000 7f8a7e21f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:45.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.795+0000 7f8931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:45.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.795+0000 7f8a7e21f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:45.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.795+0000 7f8a7e21f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:45.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.795+0000 7f8a7e21f800 5 note: GC not initialized 2024-05-15T14:41:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.795+0000 7f8930fe1640 20 reqs_thread_entry: start 2024-05-15T14:41:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.795+0000 7f8a7e21f800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.796+0000 7f8a7e21f800 20 Filter name: none 2024-05-15T14:41:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.796+0000 7f88aa7fc640 20 reqs_thread_entry: start 2024-05-15T14:41:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.796+0000 7f8a7e21f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.797+0000 7f8a7e21f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:41:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.798+0000 7f8931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.800+0000 7f8a7e21f800 20 remove_watcher() i=0 2024-05-15T14:41:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.800+0000 7f8a7e21f800 2 removed watcher, disabling cache 2024-05-15T14:41:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.801+0000 7f8a7e21f800 20 remove_watcher() i=1 2024-05-15T14:41:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.802+0000 7f8a7e21f800 20 remove_watcher() i=2 2024-05-15T14:41:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.803+0000 7f8a7e21f800 20 remove_watcher() i=3 2024-05-15T14:41:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.804+0000 7f8a7e21f800 20 remove_watcher() i=4 2024-05-15T14:41:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.805+0000 7f8a7e21f800 20 remove_watcher() i=5 2024-05-15T14:41:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.806+0000 7f8a7e21f800 20 remove_watcher() i=6 2024-05-15T14:41:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:45.807+0000 7f8a7e21f800 20 remove_watcher() i=7 2024-05-15T14:41:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.151+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.153+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:46.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.153+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.154+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.154+0000 7f8ec3416800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.154+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.154+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.154+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.155+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.155+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.156+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.156+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.156+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.156+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 20 zone MyZone found 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.157+0000 7f8ec3416800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.158+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.158+0000 7f8ec3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.158+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.158+0000 7f8ec3416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.158+0000 7f8ec3416800 20 started sync module instance, tier type = 2024-05-15T14:41:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.158+0000 7f8ec3416800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.168+0000 7f8ec3416800 20 add_watcher() i=0 2024-05-15T14:41:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.168+0000 7f8ec3416800 20 add_watcher() i=1 2024-05-15T14:41:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.168+0000 7f8ec3416800 20 add_watcher() i=2 2024-05-15T14:41:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.168+0000 7f8ec3416800 20 add_watcher() i=3 2024-05-15T14:41:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.168+0000 7f8ec3416800 20 add_watcher() i=4 2024-05-15T14:41:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.168+0000 7f8ec3416800 20 add_watcher() i=5 2024-05-15T14:41:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.168+0000 7f8ec3416800 20 add_watcher() i=6 2024-05-15T14:41:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.169+0000 7f8ec3416800 20 add_watcher() i=7 2024-05-15T14:41:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.169+0000 7f8ec3416800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:46.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.170+0000 7f8d76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:46.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.170+0000 7f8ec3416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:46.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.170+0000 7f8ec3416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:46.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.170+0000 7f8ec3416800 5 note: GC not initialized 2024-05-15T14:41:46.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.171+0000 7f8d75fe3640 20 reqs_thread_entry: start 2024-05-15T14:41:46.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.171+0000 7f8ec3416800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:46.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.171+0000 7f8ec3416800 20 Filter name: none 2024-05-15T14:41:46.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.171+0000 7f8ce77fe640 20 reqs_thread_entry: start 2024-05-15T14:41:46.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.172+0000 7f8ec3416800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.172+0000 7f8ec3416800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:41:46.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.174+0000 7f8d76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:46.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.176+0000 7f8ec3416800 20 remove_watcher() i=0 2024-05-15T14:41:46.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.176+0000 7f8ec3416800 2 removed watcher, disabling cache 2024-05-15T14:41:46.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.178+0000 7f8ec3416800 20 remove_watcher() i=1 2024-05-15T14:41:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.179+0000 7f8ec3416800 20 remove_watcher() i=2 2024-05-15T14:41:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.179+0000 7f8ec3416800 20 remove_watcher() i=3 2024-05-15T14:41:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.180+0000 7f8ec3416800 20 remove_watcher() i=4 2024-05-15T14:41:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.181+0000 7f8ec3416800 20 remove_watcher() i=5 2024-05-15T14:41:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.182+0000 7f8ec3416800 20 remove_watcher() i=6 2024-05-15T14:41:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.183+0000 7f8ec3416800 20 remove_watcher() i=7 2024-05-15T14:41:46.198 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:41:46] "POST / HTTP/1.1" 200 - 2024-05-15T14:41:46.243 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:46.243 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:46.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.282+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.284+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:46.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.284+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.285+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.285+0000 7f455580f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.285+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.285+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.285+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.286+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:46.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.286+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.287+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.287+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.287+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.287+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.288+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.288+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.288+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.288+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 zone MyZone found 2024-05-15T14:41:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 started sync module instance, tier type = 2024-05-15T14:41:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.289+0000 7f455580f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.299+0000 7f455580f800 20 add_watcher() i=0 2024-05-15T14:41:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.299+0000 7f455580f800 20 add_watcher() i=1 2024-05-15T14:41:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.299+0000 7f455580f800 20 add_watcher() i=2 2024-05-15T14:41:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.299+0000 7f455580f800 20 add_watcher() i=3 2024-05-15T14:41:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.299+0000 7f455580f800 20 add_watcher() i=4 2024-05-15T14:41:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.299+0000 7f455580f800 20 add_watcher() i=5 2024-05-15T14:41:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.299+0000 7f455580f800 20 add_watcher() i=6 2024-05-15T14:41:46.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.300+0000 7f455580f800 20 add_watcher() i=7 2024-05-15T14:41:46.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.300+0000 7f455580f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:46.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.301+0000 7f4406fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:46.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.302+0000 7f455580f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:46.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.302+0000 7f455580f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:46.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.302+0000 7f455580f800 5 note: GC not initialized 2024-05-15T14:41:46.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.302+0000 7f4405fe3640 20 reqs_thread_entry: start 2024-05-15T14:41:46.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.302+0000 7f455580f800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:46.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.302+0000 7f455580f800 20 Filter name: none 2024-05-15T14:41:46.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.302+0000 7f43777fe640 20 reqs_thread_entry: start 2024-05-15T14:41:46.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.303+0000 7f455580f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:46.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.303+0000 7f455580f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:41:46.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.305+0000 7f4406fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:46.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.307+0000 7f455580f800 20 remove_watcher() i=0 2024-05-15T14:41:46.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.307+0000 7f455580f800 2 removed watcher, disabling cache 2024-05-15T14:41:46.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.308+0000 7f455580f800 20 remove_watcher() i=1 2024-05-15T14:41:46.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.309+0000 7f455580f800 20 remove_watcher() i=2 2024-05-15T14:41:46.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.310+0000 7f455580f800 20 remove_watcher() i=3 2024-05-15T14:41:46.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.311+0000 7f455580f800 20 remove_watcher() i=4 2024-05-15T14:41:46.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.312+0000 7f455580f800 20 remove_watcher() i=5 2024-05-15T14:41:46.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.313+0000 7f455580f800 20 remove_watcher() i=6 2024-05-15T14:41:46.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:46.314+0000 7f455580f800 20 remove_watcher() i=7 2024-05-15T14:41:51.382 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:51.383 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:51.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.426+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.428+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:51.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.428+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.429+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:51.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.429+0000 7f3337f2f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:51.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.429+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.429+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:51.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.429+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.430+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:51.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.430+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.431+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:51.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.431+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.432+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:51.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.432+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.432+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:51.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.432+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:51.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:51.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 zone MyZone found 2024-05-15T14:41:51.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:51.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:51.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:51.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:51.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:51.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:51.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:51.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.433+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.434+0000 7f3337f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:51.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.434+0000 7f3337f2f800 20 started sync module instance, tier type = 2024-05-15T14:41:51.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.434+0000 7f3337f2f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.445+0000 7f3337f2f800 20 add_watcher() i=0 2024-05-15T14:41:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.445+0000 7f3337f2f800 20 add_watcher() i=1 2024-05-15T14:41:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.445+0000 7f3337f2f800 20 add_watcher() i=2 2024-05-15T14:41:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.445+0000 7f3337f2f800 20 add_watcher() i=3 2024-05-15T14:41:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.445+0000 7f3337f2f800 20 add_watcher() i=4 2024-05-15T14:41:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.445+0000 7f3337f2f800 20 add_watcher() i=5 2024-05-15T14:41:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.445+0000 7f3337f2f800 20 add_watcher() i=6 2024-05-15T14:41:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.446+0000 7f3337f2f800 20 add_watcher() i=7 2024-05-15T14:41:51.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.446+0000 7f3337f2f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:51.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.448+0000 7f31e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:51.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.448+0000 7f3337f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:51.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.448+0000 7f3337f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:51.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.448+0000 7f3337f2f800 5 note: GC not initialized 2024-05-15T14:41:51.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.448+0000 7f31e8fe1640 20 reqs_thread_entry: start 2024-05-15T14:41:51.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.449+0000 7f3337f2f800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:51.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.449+0000 7f3337f2f800 20 Filter name: none 2024-05-15T14:41:51.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.449+0000 7f31627fc640 20 reqs_thread_entry: start 2024-05-15T14:41:51.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.449+0000 7f3337f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:41:51.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.450+0000 7f3337f2f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:41:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.451+0000 7f31e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.453+0000 7f3337f2f800 20 remove_watcher() i=0 2024-05-15T14:41:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.453+0000 7f3337f2f800 2 removed watcher, disabling cache 2024-05-15T14:41:51.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.455+0000 7f3337f2f800 20 remove_watcher() i=1 2024-05-15T14:41:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.456+0000 7f3337f2f800 20 remove_watcher() i=2 2024-05-15T14:41:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.457+0000 7f3337f2f800 20 remove_watcher() i=3 2024-05-15T14:41:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.458+0000 7f3337f2f800 20 remove_watcher() i=4 2024-05-15T14:41:51.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.459+0000 7f3337f2f800 20 remove_watcher() i=5 2024-05-15T14:41:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.460+0000 7f3337f2f800 20 remove_watcher() i=6 2024-05-15T14:41:51.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:51.461+0000 7f3337f2f800 20 remove_watcher() i=7 2024-05-15T14:41:56.530 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:41:56.531 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:41:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.574+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.576+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.576+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.577+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:56.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.577+0000 7fd12f211800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:41:56.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.577+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.578+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.578+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.578+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:41:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.578+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.579+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:41:56.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.579+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.580+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:56.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.580+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.580+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:41:56.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.580+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.581+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:41:56.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.581+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.581+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:41:56.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.581+0000 7fd12f211800 20 zone MyZone found 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.581+0000 7fd12f211800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.581+0000 7fd12f211800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.581+0000 7fd12f211800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.581+0000 7fd12f211800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.582+0000 7fd12f211800 20 period zonegroup name MyZoneGroup 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.582+0000 7fd12f211800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.582+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.582+0000 7fd12f211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.582+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.582+0000 7fd12f211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:41:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.582+0000 7fd12f211800 20 started sync module instance, tier type = 2024-05-15T14:41:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.582+0000 7fd12f211800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:41:56.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.593+0000 7fd12f211800 20 add_watcher() i=0 2024-05-15T14:41:56.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.593+0000 7fd12f211800 20 add_watcher() i=1 2024-05-15T14:41:56.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.593+0000 7fd12f211800 20 add_watcher() i=2 2024-05-15T14:41:56.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.593+0000 7fd12f211800 20 add_watcher() i=3 2024-05-15T14:41:56.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.593+0000 7fd12f211800 20 add_watcher() i=4 2024-05-15T14:41:56.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.593+0000 7fd12f211800 20 add_watcher() i=5 2024-05-15T14:41:56.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.593+0000 7fd12f211800 20 add_watcher() i=6 2024-05-15T14:41:56.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.594+0000 7fd12f211800 20 add_watcher() i=7 2024-05-15T14:41:56.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.594+0000 7fd12f211800 2 all 8 watchers are set, enabling cache 2024-05-15T14:41:56.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.596+0000 7fcfe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:56.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.597+0000 7fd12f211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:41:56.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.597+0000 7fd12f211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:41:56.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.597+0000 7fd12f211800 5 note: GC not initialized 2024-05-15T14:41:56.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.597+0000 7fcf5bfff640 20 reqs_thread_entry: start 2024-05-15T14:41:56.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.597+0000 7fd12f211800 20 init_complete bucket index max shards: 11 2024-05-15T14:41:56.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.597+0000 7fd12f211800 20 Filter name: none 2024-05-15T14:41:56.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.597+0000 7fcf59ffb640 20 reqs_thread_entry: start 2024-05-15T14:41:56.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.597+0000 7fd12f211800 20 rados->read ofs=0 len=0 2024-05-15T14:41:56.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.598+0000 7fd12f211800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:41:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.599+0000 7fcfe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:41:56.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.602+0000 7fd12f211800 20 remove_watcher() i=0 2024-05-15T14:41:56.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.602+0000 7fd12f211800 2 removed watcher, disabling cache 2024-05-15T14:41:56.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.603+0000 7fd12f211800 20 remove_watcher() i=1 2024-05-15T14:41:56.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.604+0000 7fd12f211800 20 remove_watcher() i=2 2024-05-15T14:41:56.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.605+0000 7fd12f211800 20 remove_watcher() i=3 2024-05-15T14:41:56.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.606+0000 7fd12f211800 20 remove_watcher() i=4 2024-05-15T14:41:56.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.607+0000 7fd12f211800 20 remove_watcher() i=5 2024-05-15T14:41:56.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.609+0000 7fd12f211800 20 remove_watcher() i=6 2024-05-15T14:41:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:41:56.610+0000 7fd12f211800 20 remove_watcher() i=7 2024-05-15T14:42:01.680 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:01.681 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:01.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.724+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.726+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:01.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.726+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.727+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:01.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.727+0000 7f1673129800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:01.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.727+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.728+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:01.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.728+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.728+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:01.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.728+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.729+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:01.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.729+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.730+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:01.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.730+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.730+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:01.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.730+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:01.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 20 zone MyZone found 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.731+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.732+0000 7f1673129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.732+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.732+0000 7f1673129800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.732+0000 7f1673129800 20 started sync module instance, tier type = 2024-05-15T14:42:01.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.732+0000 7f1673129800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:01.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.743+0000 7f1673129800 20 add_watcher() i=0 2024-05-15T14:42:01.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.743+0000 7f1673129800 20 add_watcher() i=1 2024-05-15T14:42:01.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.743+0000 7f1673129800 20 add_watcher() i=2 2024-05-15T14:42:01.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.743+0000 7f1673129800 20 add_watcher() i=3 2024-05-15T14:42:01.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.743+0000 7f1673129800 20 add_watcher() i=4 2024-05-15T14:42:01.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.743+0000 7f1673129800 20 add_watcher() i=5 2024-05-15T14:42:01.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.743+0000 7f1673129800 20 add_watcher() i=6 2024-05-15T14:42:01.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.744+0000 7f1673129800 20 add_watcher() i=7 2024-05-15T14:42:01.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.744+0000 7f1673129800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:01.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.746+0000 7f15257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:01.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.746+0000 7f1673129800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:01.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.746+0000 7f1673129800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:01.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.746+0000 7f1673129800 5 note: GC not initialized 2024-05-15T14:42:01.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.746+0000 7f149ffff640 20 reqs_thread_entry: start 2024-05-15T14:42:01.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.746+0000 7f1673129800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:01.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.747+0000 7f1673129800 20 Filter name: none 2024-05-15T14:42:01.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.747+0000 7f149dffb640 20 reqs_thread_entry: start 2024-05-15T14:42:01.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.747+0000 7f1673129800 20 rados->read ofs=0 len=0 2024-05-15T14:42:01.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.748+0000 7f1673129800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:01.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.749+0000 7f15257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:01.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.751+0000 7f1673129800 20 remove_watcher() i=0 2024-05-15T14:42:01.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.751+0000 7f1673129800 2 removed watcher, disabling cache 2024-05-15T14:42:01.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.752+0000 7f1673129800 20 remove_watcher() i=1 2024-05-15T14:42:01.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.753+0000 7f1673129800 20 remove_watcher() i=2 2024-05-15T14:42:01.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.754+0000 7f1673129800 20 remove_watcher() i=3 2024-05-15T14:42:01.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.755+0000 7f1673129800 20 remove_watcher() i=4 2024-05-15T14:42:01.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.756+0000 7f1673129800 20 remove_watcher() i=5 2024-05-15T14:42:01.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.757+0000 7f1673129800 20 remove_watcher() i=6 2024-05-15T14:42:01.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:01.758+0000 7f1673129800 20 remove_watcher() i=7 2024-05-15T14:42:06.827 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:06.827 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.872+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.874+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:06.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.874+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.875+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:06.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.875+0000 7f791c720800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:06.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.875+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.875+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:06.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.875+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.876+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:06.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.876+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.877+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.877+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.877+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.877+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.878+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:06.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.878+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:06.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:06.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 20 zone MyZone found 2024-05-15T14:42:06.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:06.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:06.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:06.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:06.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:06.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:06.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.879+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.880+0000 7f791c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:06.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.880+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.880+0000 7f791c720800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:06.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.880+0000 7f791c720800 20 started sync module instance, tier type = 2024-05-15T14:42:06.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.880+0000 7f791c720800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:06.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.891+0000 7f791c720800 20 add_watcher() i=0 2024-05-15T14:42:06.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.891+0000 7f791c720800 20 add_watcher() i=1 2024-05-15T14:42:06.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.891+0000 7f791c720800 20 add_watcher() i=2 2024-05-15T14:42:06.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.891+0000 7f791c720800 20 add_watcher() i=3 2024-05-15T14:42:06.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.891+0000 7f791c720800 20 add_watcher() i=4 2024-05-15T14:42:06.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.891+0000 7f791c720800 20 add_watcher() i=5 2024-05-15T14:42:06.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.891+0000 7f791c720800 20 add_watcher() i=6 2024-05-15T14:42:06.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.892+0000 7f791c720800 20 add_watcher() i=7 2024-05-15T14:42:06.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.892+0000 7f791c720800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:06.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.894+0000 7f77cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:06.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.894+0000 7f791c720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:06.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.894+0000 7f791c720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:06.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.894+0000 7f791c720800 5 note: GC not initialized 2024-05-15T14:42:06.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.895+0000 7f77cdfdb640 20 reqs_thread_entry: start 2024-05-15T14:42:06.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.895+0000 7f791c720800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:06.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.895+0000 7f791c720800 20 Filter name: none 2024-05-15T14:42:06.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.895+0000 7f773f7fe640 20 reqs_thread_entry: start 2024-05-15T14:42:06.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.896+0000 7f791c720800 20 rados->read ofs=0 len=0 2024-05-15T14:42:06.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.896+0000 7f791c720800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:06.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.898+0000 7f77cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:06.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.900+0000 7f791c720800 20 remove_watcher() i=0 2024-05-15T14:42:06.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.900+0000 7f791c720800 2 removed watcher, disabling cache 2024-05-15T14:42:06.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.901+0000 7f791c720800 20 remove_watcher() i=1 2024-05-15T14:42:06.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.903+0000 7f791c720800 20 remove_watcher() i=2 2024-05-15T14:42:06.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.904+0000 7f791c720800 20 remove_watcher() i=3 2024-05-15T14:42:06.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.905+0000 7f791c720800 20 remove_watcher() i=4 2024-05-15T14:42:06.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.906+0000 7f791c720800 20 remove_watcher() i=5 2024-05-15T14:42:06.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.907+0000 7f791c720800 20 remove_watcher() i=6 2024-05-15T14:42:06.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:06.908+0000 7f791c720800 20 remove_watcher() i=7 2024-05-15T14:42:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:12.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.018+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.020+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:12.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.020+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.021+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:12.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.021+0000 7fc50a519800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:12.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.021+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.021+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:12.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.021+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.022+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:12.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.022+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.023+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:12.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.023+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.023+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:12.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.023+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.023+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:12.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.023+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:12.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 20 zone MyZone found 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:12.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.024+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.025+0000 7fc50a519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:12.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.025+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.025+0000 7fc50a519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:12.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.025+0000 7fc50a519800 20 started sync module instance, tier type = 2024-05-15T14:42:12.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.025+0000 7fc50a519800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 20 add_watcher() i=0 2024-05-15T14:42:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 20 add_watcher() i=1 2024-05-15T14:42:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 20 add_watcher() i=2 2024-05-15T14:42:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 20 add_watcher() i=3 2024-05-15T14:42:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 20 add_watcher() i=4 2024-05-15T14:42:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 20 add_watcher() i=5 2024-05-15T14:42:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 20 add_watcher() i=6 2024-05-15T14:42:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 20 add_watcher() i=7 2024-05-15T14:42:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.037+0000 7fc50a519800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.039+0000 7fc3befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.040+0000 7fc50a519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.040+0000 7fc50a519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.040+0000 7fc50a519800 5 note: GC not initialized 2024-05-15T14:42:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.040+0000 7fc3bdfdb640 20 reqs_thread_entry: start 2024-05-15T14:42:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.040+0000 7fc50a519800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.040+0000 7fc50a519800 20 Filter name: none 2024-05-15T14:42:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.040+0000 7fc32f7fe640 20 reqs_thread_entry: start 2024-05-15T14:42:12.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.041+0000 7fc50a519800 20 rados->read ofs=0 len=0 2024-05-15T14:42:12.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.042+0000 7fc50a519800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:12.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.043+0000 7fc3befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:12.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.046+0000 7fc50a519800 20 remove_watcher() i=0 2024-05-15T14:42:12.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.046+0000 7fc50a519800 2 removed watcher, disabling cache 2024-05-15T14:42:12.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.047+0000 7fc50a519800 20 remove_watcher() i=1 2024-05-15T14:42:12.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.048+0000 7fc50a519800 20 remove_watcher() i=2 2024-05-15T14:42:12.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.049+0000 7fc50a519800 20 remove_watcher() i=3 2024-05-15T14:42:12.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.050+0000 7fc50a519800 20 remove_watcher() i=4 2024-05-15T14:42:12.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.051+0000 7fc50a519800 20 remove_watcher() i=5 2024-05-15T14:42:12.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.052+0000 7fc50a519800 20 remove_watcher() i=6 2024-05-15T14:42:12.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:12.053+0000 7fc50a519800 20 remove_watcher() i=7 2024-05-15T14:42:17.117 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:17.117 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:17.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.158+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.160+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.160+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.161+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.161+0000 7f7c28a40800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.161+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.161+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.161+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.162+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.162+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.163+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.163+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.163+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.163+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.163+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.163+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.164+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.164+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.164+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 zone MyZone found 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:17.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 started sync module instance, tier type = 2024-05-15T14:42:17.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.165+0000 7f7c28a40800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.176+0000 7f7c28a40800 20 add_watcher() i=0 2024-05-15T14:42:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.176+0000 7f7c28a40800 20 add_watcher() i=1 2024-05-15T14:42:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.176+0000 7f7c28a40800 20 add_watcher() i=2 2024-05-15T14:42:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.176+0000 7f7c28a40800 20 add_watcher() i=3 2024-05-15T14:42:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.176+0000 7f7c28a40800 20 add_watcher() i=4 2024-05-15T14:42:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.176+0000 7f7c28a40800 20 add_watcher() i=5 2024-05-15T14:42:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.176+0000 7f7c28a40800 20 add_watcher() i=6 2024-05-15T14:42:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.177+0000 7f7c28a40800 20 add_watcher() i=7 2024-05-15T14:42:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.177+0000 7f7c28a40800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.179+0000 7f7ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.179+0000 7f7c28a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.179+0000 7f7c28a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.179+0000 7f7c28a40800 5 note: GC not initialized 2024-05-15T14:42:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.179+0000 7f7ad8fe1640 20 reqs_thread_entry: start 2024-05-15T14:42:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.179+0000 7f7c28a40800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.179+0000 7f7c28a40800 20 Filter name: none 2024-05-15T14:42:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.180+0000 7f7a527fc640 20 reqs_thread_entry: start 2024-05-15T14:42:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.180+0000 7f7c28a40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.180+0000 7f7c28a40800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.182+0000 7f7ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.184+0000 7f7c28a40800 20 remove_watcher() i=0 2024-05-15T14:42:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.184+0000 7f7c28a40800 2 removed watcher, disabling cache 2024-05-15T14:42:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.185+0000 7f7c28a40800 20 remove_watcher() i=1 2024-05-15T14:42:17.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.186+0000 7f7c28a40800 20 remove_watcher() i=2 2024-05-15T14:42:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.187+0000 7f7c28a40800 20 remove_watcher() i=3 2024-05-15T14:42:17.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.188+0000 7f7c28a40800 20 remove_watcher() i=4 2024-05-15T14:42:17.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.189+0000 7f7c28a40800 20 remove_watcher() i=5 2024-05-15T14:42:17.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.191+0000 7f7c28a40800 20 remove_watcher() i=6 2024-05-15T14:42:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:17.191+0000 7f7c28a40800 20 remove_watcher() i=7 2024-05-15T14:42:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:22.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.301+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.303+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:22.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.303+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.304+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:22.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.304+0000 7f2c72436800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:22.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.304+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.304+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:22.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.304+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.305+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:22.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.305+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.306+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:22.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.306+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.306+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:22.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.306+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.306+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:22.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.306+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:22.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 20 zone MyZone found 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.307+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.308+0000 7f2c72436800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:22.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.308+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.308+0000 7f2c72436800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:22.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.308+0000 7f2c72436800 20 started sync module instance, tier type = 2024-05-15T14:42:22.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.308+0000 7f2c72436800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.318+0000 7f2c72436800 20 add_watcher() i=0 2024-05-15T14:42:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.318+0000 7f2c72436800 20 add_watcher() i=1 2024-05-15T14:42:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.318+0000 7f2c72436800 20 add_watcher() i=2 2024-05-15T14:42:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.318+0000 7f2c72436800 20 add_watcher() i=3 2024-05-15T14:42:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.318+0000 7f2c72436800 20 add_watcher() i=4 2024-05-15T14:42:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.318+0000 7f2c72436800 20 add_watcher() i=5 2024-05-15T14:42:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.318+0000 7f2c72436800 20 add_watcher() i=6 2024-05-15T14:42:22.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.319+0000 7f2c72436800 20 add_watcher() i=7 2024-05-15T14:42:22.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.319+0000 7f2c72436800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:22.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.320+0000 7f2b25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.321+0000 7f2c72436800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.321+0000 7f2c72436800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.321+0000 7f2c72436800 5 note: GC not initialized 2024-05-15T14:42:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.321+0000 7f2b24fe1640 20 reqs_thread_entry: start 2024-05-15T14:42:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.321+0000 7f2c72436800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.321+0000 7f2c72436800 20 Filter name: none 2024-05-15T14:42:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.321+0000 7f2a9e7fc640 20 reqs_thread_entry: start 2024-05-15T14:42:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.322+0000 7f2c72436800 20 rados->read ofs=0 len=0 2024-05-15T14:42:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.322+0000 7f2c72436800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:22.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.324+0000 7f2b25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:22.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.327+0000 7f2c72436800 20 remove_watcher() i=0 2024-05-15T14:42:22.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.327+0000 7f2c72436800 2 removed watcher, disabling cache 2024-05-15T14:42:22.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.327+0000 7f2c72436800 20 remove_watcher() i=1 2024-05-15T14:42:22.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.328+0000 7f2c72436800 20 remove_watcher() i=2 2024-05-15T14:42:22.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.329+0000 7f2c72436800 20 remove_watcher() i=3 2024-05-15T14:42:22.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.330+0000 7f2c72436800 20 remove_watcher() i=4 2024-05-15T14:42:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.331+0000 7f2c72436800 20 remove_watcher() i=5 2024-05-15T14:42:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.332+0000 7f2c72436800 20 remove_watcher() i=6 2024-05-15T14:42:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:22.333+0000 7f2c72436800 20 remove_watcher() i=7 2024-05-15T14:42:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:27.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.442+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.445+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:27.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.445+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.446+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:27.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.446+0000 7f5d84e3e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:27.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.446+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.446+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:27.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.446+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.447+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:27.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.447+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.448+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:27.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.448+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.448+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:27.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.448+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.448+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:27.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.448+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.449+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:27.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.449+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 zone MyZone found 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:27.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:27.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 started sync module instance, tier type = 2024-05-15T14:42:27.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.450+0000 7f5d84e3e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:27.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.461+0000 7f5d84e3e800 20 add_watcher() i=0 2024-05-15T14:42:27.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.461+0000 7f5d84e3e800 20 add_watcher() i=1 2024-05-15T14:42:27.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.461+0000 7f5d84e3e800 20 add_watcher() i=2 2024-05-15T14:42:27.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.461+0000 7f5d84e3e800 20 add_watcher() i=3 2024-05-15T14:42:27.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.461+0000 7f5d84e3e800 20 add_watcher() i=4 2024-05-15T14:42:27.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.461+0000 7f5d84e3e800 20 add_watcher() i=5 2024-05-15T14:42:27.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.461+0000 7f5d84e3e800 20 add_watcher() i=6 2024-05-15T14:42:27.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.462+0000 7f5d84e3e800 20 add_watcher() i=7 2024-05-15T14:42:27.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.462+0000 7f5d84e3e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:27.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.463+0000 7f5c35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.464+0000 7f5d84e3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.464+0000 7f5d84e3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.464+0000 7f5d84e3e800 5 note: GC not initialized 2024-05-15T14:42:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.464+0000 7f5c34fe1640 20 reqs_thread_entry: start 2024-05-15T14:42:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.464+0000 7f5d84e3e800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.464+0000 7f5d84e3e800 20 Filter name: none 2024-05-15T14:42:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.464+0000 7f5bae7fc640 20 reqs_thread_entry: start 2024-05-15T14:42:27.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.464+0000 7f5d84e3e800 20 rados->read ofs=0 len=0 2024-05-15T14:42:27.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.465+0000 7f5d84e3e800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:27.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.466+0000 7f5c35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:27.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.469+0000 7f5d84e3e800 20 remove_watcher() i=0 2024-05-15T14:42:27.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.469+0000 7f5d84e3e800 2 removed watcher, disabling cache 2024-05-15T14:42:27.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.470+0000 7f5d84e3e800 20 remove_watcher() i=1 2024-05-15T14:42:27.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.471+0000 7f5d84e3e800 20 remove_watcher() i=2 2024-05-15T14:42:27.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.472+0000 7f5d84e3e800 20 remove_watcher() i=3 2024-05-15T14:42:27.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.472+0000 7f5d84e3e800 20 remove_watcher() i=4 2024-05-15T14:42:27.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.474+0000 7f5d84e3e800 20 remove_watcher() i=5 2024-05-15T14:42:27.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.475+0000 7f5d84e3e800 20 remove_watcher() i=6 2024-05-15T14:42:27.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:27.476+0000 7f5d84e3e800 20 remove_watcher() i=7 2024-05-15T14:42:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.579+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.581+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:32.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.581+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.582+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:32.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.582+0000 7f001e287800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:32.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.582+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.582+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:32.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.582+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.583+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:32.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.583+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.584+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:32.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.584+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.584+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:32.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.584+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.584+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:32.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.584+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:32.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 20 zone MyZone found 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.585+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.586+0000 7f001e287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.586+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.586+0000 7f001e287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.586+0000 7f001e287800 20 started sync module instance, tier type = 2024-05-15T14:42:32.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.586+0000 7f001e287800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:32.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.596+0000 7f001e287800 20 add_watcher() i=0 2024-05-15T14:42:32.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.596+0000 7f001e287800 20 add_watcher() i=1 2024-05-15T14:42:32.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.596+0000 7f001e287800 20 add_watcher() i=2 2024-05-15T14:42:32.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.596+0000 7f001e287800 20 add_watcher() i=3 2024-05-15T14:42:32.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.596+0000 7f001e287800 20 add_watcher() i=4 2024-05-15T14:42:32.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.596+0000 7f001e287800 20 add_watcher() i=5 2024-05-15T14:42:32.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.596+0000 7f001e287800 20 add_watcher() i=6 2024-05-15T14:42:32.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.597+0000 7f001e287800 20 add_watcher() i=7 2024-05-15T14:42:32.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.597+0000 7f001e287800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.599+0000 7efed1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:32.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.599+0000 7f001e287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.599+0000 7f001e287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.599+0000 7f001e287800 5 note: GC not initialized 2024-05-15T14:42:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.600+0000 7efed0fe1640 20 reqs_thread_entry: start 2024-05-15T14:42:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.600+0000 7f001e287800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.600+0000 7f001e287800 20 Filter name: none 2024-05-15T14:42:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.600+0000 7efe4a7fc640 20 reqs_thread_entry: start 2024-05-15T14:42:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.600+0000 7f001e287800 20 rados->read ofs=0 len=0 2024-05-15T14:42:32.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.601+0000 7f001e287800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:32.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.602+0000 7efed1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.605+0000 7f001e287800 20 remove_watcher() i=0 2024-05-15T14:42:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.605+0000 7f001e287800 2 removed watcher, disabling cache 2024-05-15T14:42:32.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.606+0000 7f001e287800 20 remove_watcher() i=1 2024-05-15T14:42:32.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.607+0000 7f001e287800 20 remove_watcher() i=2 2024-05-15T14:42:32.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.608+0000 7f001e287800 20 remove_watcher() i=3 2024-05-15T14:42:32.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.609+0000 7f001e287800 20 remove_watcher() i=4 2024-05-15T14:42:32.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.610+0000 7f001e287800 20 remove_watcher() i=5 2024-05-15T14:42:32.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.611+0000 7f001e287800 20 remove_watcher() i=6 2024-05-15T14:42:32.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:32.612+0000 7f001e287800 20 remove_watcher() i=7 2024-05-15T14:42:37.677 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:37.678 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.720+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.722+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:37.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.722+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.723+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:37.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.723+0000 7f779b133800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:37.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.723+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.723+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:37.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.723+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.724+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:37.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.724+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.725+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:37.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.725+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.725+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.725+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.725+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:37.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.725+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 20 zone MyZone found 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:37.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:37.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:37.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.726+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.727+0000 7f779b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:37.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.727+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.727+0000 7f779b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:37.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.727+0000 7f779b133800 20 started sync module instance, tier type = 2024-05-15T14:42:37.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.727+0000 7f779b133800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:37.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.738+0000 7f779b133800 20 add_watcher() i=0 2024-05-15T14:42:37.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.738+0000 7f779b133800 20 add_watcher() i=1 2024-05-15T14:42:37.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.738+0000 7f779b133800 20 add_watcher() i=2 2024-05-15T14:42:37.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.738+0000 7f779b133800 20 add_watcher() i=3 2024-05-15T14:42:37.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.738+0000 7f779b133800 20 add_watcher() i=4 2024-05-15T14:42:37.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.738+0000 7f779b133800 20 add_watcher() i=5 2024-05-15T14:42:37.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.738+0000 7f779b133800 20 add_watcher() i=6 2024-05-15T14:42:37.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.739+0000 7f779b133800 20 add_watcher() i=7 2024-05-15T14:42:37.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.739+0000 7f779b133800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:37.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.741+0000 7f764d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:37.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.741+0000 7f779b133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:37.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.741+0000 7f779b133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:37.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.741+0000 7f779b133800 5 note: GC not initialized 2024-05-15T14:42:37.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.741+0000 7f75c7fff640 20 reqs_thread_entry: start 2024-05-15T14:42:37.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.741+0000 7f779b133800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:37.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.742+0000 7f779b133800 20 Filter name: none 2024-05-15T14:42:37.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.742+0000 7f75c5ffb640 20 reqs_thread_entry: start 2024-05-15T14:42:37.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.742+0000 7f779b133800 20 rados->read ofs=0 len=0 2024-05-15T14:42:37.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.742+0000 7f779b133800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:37.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.744+0000 7f764d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:37.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.746+0000 7f779b133800 20 remove_watcher() i=0 2024-05-15T14:42:37.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.746+0000 7f779b133800 2 removed watcher, disabling cache 2024-05-15T14:42:37.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.747+0000 7f779b133800 20 remove_watcher() i=1 2024-05-15T14:42:37.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.748+0000 7f779b133800 20 remove_watcher() i=2 2024-05-15T14:42:37.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.749+0000 7f779b133800 20 remove_watcher() i=3 2024-05-15T14:42:37.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.750+0000 7f779b133800 20 remove_watcher() i=4 2024-05-15T14:42:37.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.751+0000 7f779b133800 20 remove_watcher() i=5 2024-05-15T14:42:37.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.752+0000 7f779b133800 20 remove_watcher() i=6 2024-05-15T14:42:37.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:37.753+0000 7f779b133800 20 remove_watcher() i=7 2024-05-15T14:42:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:42.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.858+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.860+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:42.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.860+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.861+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:42.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.861+0000 7f7704d40800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:42.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.861+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.861+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:42.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.861+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.862+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:42.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.862+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.863+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:42.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.863+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.863+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:42.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.863+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.864+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:42.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.864+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.864+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:42.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.864+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 zone MyZone found 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:42.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 started sync module instance, tier type = 2024-05-15T14:42:42.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.865+0000 7f7704d40800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:42.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.876+0000 7f7704d40800 20 add_watcher() i=0 2024-05-15T14:42:42.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.876+0000 7f7704d40800 20 add_watcher() i=1 2024-05-15T14:42:42.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.876+0000 7f7704d40800 20 add_watcher() i=2 2024-05-15T14:42:42.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.876+0000 7f7704d40800 20 add_watcher() i=3 2024-05-15T14:42:42.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.876+0000 7f7704d40800 20 add_watcher() i=4 2024-05-15T14:42:42.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.876+0000 7f7704d40800 20 add_watcher() i=5 2024-05-15T14:42:42.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.876+0000 7f7704d40800 20 add_watcher() i=6 2024-05-15T14:42:42.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.877+0000 7f7704d40800 20 add_watcher() i=7 2024-05-15T14:42:42.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.877+0000 7f7704d40800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:42.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.878+0000 7f75b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:42.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.879+0000 7f7704d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:42.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.879+0000 7f7704d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:42.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.879+0000 7f7704d40800 5 note: GC not initialized 2024-05-15T14:42:42.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.879+0000 7f7533fff640 20 reqs_thread_entry: start 2024-05-15T14:42:42.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.879+0000 7f7704d40800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:42.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.879+0000 7f7704d40800 20 Filter name: none 2024-05-15T14:42:42.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.879+0000 7f7531ffb640 20 reqs_thread_entry: start 2024-05-15T14:42:42.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.880+0000 7f7704d40800 20 rados->read ofs=0 len=0 2024-05-15T14:42:42.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.880+0000 7f7704d40800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:42.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.882+0000 7f75b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:42.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.884+0000 7f7704d40800 20 remove_watcher() i=0 2024-05-15T14:42:42.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.884+0000 7f7704d40800 2 removed watcher, disabling cache 2024-05-15T14:42:42.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.885+0000 7f7704d40800 20 remove_watcher() i=1 2024-05-15T14:42:42.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.886+0000 7f7704d40800 20 remove_watcher() i=2 2024-05-15T14:42:42.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.887+0000 7f7704d40800 20 remove_watcher() i=3 2024-05-15T14:42:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.888+0000 7f7704d40800 20 remove_watcher() i=4 2024-05-15T14:42:42.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.889+0000 7f7704d40800 20 remove_watcher() i=5 2024-05-15T14:42:42.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.890+0000 7f7704d40800 20 remove_watcher() i=6 2024-05-15T14:42:42.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:42.891+0000 7f7704d40800 20 remove_watcher() i=7 2024-05-15T14:42:47.959 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:47.959 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.005+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.008+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.008+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.009+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.009+0000 7fc18303b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.009+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.009+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.009+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.010+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.010+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.011+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.011+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.011+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.011+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.011+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.012+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 zone MyZone found 2024-05-15T14:42:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.013+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.014+0000 7fc18303b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.014+0000 7fc18303b800 20 started sync module instance, tier type = 2024-05-15T14:42:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.014+0000 7fc18303b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.025+0000 7fc18303b800 20 add_watcher() i=0 2024-05-15T14:42:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.025+0000 7fc18303b800 20 add_watcher() i=1 2024-05-15T14:42:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.025+0000 7fc18303b800 20 add_watcher() i=2 2024-05-15T14:42:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.025+0000 7fc18303b800 20 add_watcher() i=3 2024-05-15T14:42:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.025+0000 7fc18303b800 20 add_watcher() i=4 2024-05-15T14:42:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.025+0000 7fc18303b800 20 add_watcher() i=5 2024-05-15T14:42:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.025+0000 7fc18303b800 20 add_watcher() i=6 2024-05-15T14:42:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.026+0000 7fc18303b800 20 add_watcher() i=7 2024-05-15T14:42:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.026+0000 7fc18303b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:48.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.028+0000 7fc0377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.029+0000 7fc18303b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.029+0000 7fc18303b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.029+0000 7fc18303b800 5 note: GC not initialized 2024-05-15T14:42:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.029+0000 7fc0367e4640 20 reqs_thread_entry: start 2024-05-15T14:42:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.029+0000 7fc18303b800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.029+0000 7fc18303b800 20 Filter name: none 2024-05-15T14:42:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.029+0000 7fc02ffff640 20 reqs_thread_entry: start 2024-05-15T14:42:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.030+0000 7fc18303b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.030+0000 7fc18303b800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:48.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.032+0000 7fc0377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.034+0000 7fc18303b800 20 remove_watcher() i=0 2024-05-15T14:42:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.034+0000 7fc18303b800 2 removed watcher, disabling cache 2024-05-15T14:42:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.035+0000 7fc18303b800 20 remove_watcher() i=1 2024-05-15T14:42:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.036+0000 7fc18303b800 20 remove_watcher() i=2 2024-05-15T14:42:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.037+0000 7fc18303b800 20 remove_watcher() i=3 2024-05-15T14:42:48.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.038+0000 7fc18303b800 20 remove_watcher() i=4 2024-05-15T14:42:48.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.039+0000 7fc18303b800 20 remove_watcher() i=5 2024-05-15T14:42:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.041+0000 7fc18303b800 20 remove_watcher() i=6 2024-05-15T14:42:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:48.042+0000 7fc18303b800 20 remove_watcher() i=7 2024-05-15T14:42:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.160+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.162+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.162+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.163+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.163+0000 7fc19cd36800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.163+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.163+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:53.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.163+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.164+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:53.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.164+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.165+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.165+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.165+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.166+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.166+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.166+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 zone MyZone found 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:53.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:53.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.167+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.168+0000 7fc19cd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:53.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.168+0000 7fc19cd36800 20 started sync module instance, tier type = 2024-05-15T14:42:53.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.168+0000 7fc19cd36800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:53.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.179+0000 7fc19cd36800 20 add_watcher() i=0 2024-05-15T14:42:53.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.179+0000 7fc19cd36800 20 add_watcher() i=1 2024-05-15T14:42:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.179+0000 7fc19cd36800 20 add_watcher() i=2 2024-05-15T14:42:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.179+0000 7fc19cd36800 20 add_watcher() i=3 2024-05-15T14:42:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.179+0000 7fc19cd36800 20 add_watcher() i=4 2024-05-15T14:42:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.179+0000 7fc19cd36800 20 add_watcher() i=5 2024-05-15T14:42:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.179+0000 7fc19cd36800 20 add_watcher() i=6 2024-05-15T14:42:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.181+0000 7fc19cd36800 20 add_watcher() i=7 2024-05-15T14:42:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.181+0000 7fc19cd36800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.182+0000 7fc04efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.183+0000 7fc19cd36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.183+0000 7fc19cd36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.183+0000 7fc19cd36800 5 note: GC not initialized 2024-05-15T14:42:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.183+0000 7fc04dfe3640 20 reqs_thread_entry: start 2024-05-15T14:42:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.183+0000 7fc19cd36800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.183+0000 7fc19cd36800 20 Filter name: none 2024-05-15T14:42:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.184+0000 7fbfbf7fe640 20 reqs_thread_entry: start 2024-05-15T14:42:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.184+0000 7fc19cd36800 20 rados->read ofs=0 len=0 2024-05-15T14:42:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.184+0000 7fc19cd36800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.187+0000 7fc04efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.189+0000 7fc19cd36800 20 remove_watcher() i=0 2024-05-15T14:42:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.189+0000 7fc19cd36800 2 removed watcher, disabling cache 2024-05-15T14:42:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.190+0000 7fc19cd36800 20 remove_watcher() i=1 2024-05-15T14:42:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.191+0000 7fc19cd36800 20 remove_watcher() i=2 2024-05-15T14:42:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.192+0000 7fc19cd36800 20 remove_watcher() i=3 2024-05-15T14:42:53.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.193+0000 7fc19cd36800 20 remove_watcher() i=4 2024-05-15T14:42:53.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.194+0000 7fc19cd36800 20 remove_watcher() i=5 2024-05-15T14:42:53.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.196+0000 7fc19cd36800 20 remove_watcher() i=6 2024-05-15T14:42:53.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:53.197+0000 7fc19cd36800 20 remove_watcher() i=7 2024-05-15T14:42:58.271 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:42:58.271 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:42:58.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.319+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.321+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:58.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.321+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.322+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:58.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.322+0000 7f056092b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:42:58.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.322+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.322+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:58.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.322+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.323+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:42:58.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.323+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.324+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:42:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.324+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.324+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.324+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.325+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:42:58.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.325+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.325+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.325+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 zone MyZone found 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:42:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 started sync module instance, tier type = 2024-05-15T14:42:58.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.326+0000 7f056092b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:42:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.338+0000 7f056092b800 20 add_watcher() i=0 2024-05-15T14:42:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.338+0000 7f056092b800 20 add_watcher() i=1 2024-05-15T14:42:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.338+0000 7f056092b800 20 add_watcher() i=2 2024-05-15T14:42:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.338+0000 7f056092b800 20 add_watcher() i=3 2024-05-15T14:42:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.338+0000 7f056092b800 20 add_watcher() i=4 2024-05-15T14:42:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.338+0000 7f056092b800 20 add_watcher() i=5 2024-05-15T14:42:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.338+0000 7f056092b800 20 add_watcher() i=6 2024-05-15T14:42:58.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.339+0000 7f056092b800 20 add_watcher() i=7 2024-05-15T14:42:58.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.339+0000 7f056092b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:42:58.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.341+0000 7f0412fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.341+0000 7f056092b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:42:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.341+0000 7f056092b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:42:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.341+0000 7f056092b800 5 note: GC not initialized 2024-05-15T14:42:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.342+0000 7f0411fdb640 20 reqs_thread_entry: start 2024-05-15T14:42:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.342+0000 7f056092b800 20 init_complete bucket index max shards: 11 2024-05-15T14:42:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.342+0000 7f056092b800 20 Filter name: none 2024-05-15T14:42:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.342+0000 7f03837fe640 20 reqs_thread_entry: start 2024-05-15T14:42:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.342+0000 7f056092b800 20 rados->read ofs=0 len=0 2024-05-15T14:42:58.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.343+0000 7f056092b800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:42:58.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.344+0000 7f0412fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:42:58.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.346+0000 7f056092b800 20 remove_watcher() i=0 2024-05-15T14:42:58.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.346+0000 7f056092b800 2 removed watcher, disabling cache 2024-05-15T14:42:58.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.348+0000 7f056092b800 20 remove_watcher() i=1 2024-05-15T14:42:58.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.349+0000 7f056092b800 20 remove_watcher() i=2 2024-05-15T14:42:58.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.350+0000 7f056092b800 20 remove_watcher() i=3 2024-05-15T14:42:58.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.351+0000 7f056092b800 20 remove_watcher() i=4 2024-05-15T14:42:58.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.352+0000 7f056092b800 20 remove_watcher() i=5 2024-05-15T14:42:58.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.353+0000 7f056092b800 20 remove_watcher() i=6 2024-05-15T14:42:58.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:42:58.355+0000 7f056092b800 20 remove_watcher() i=7 2024-05-15T14:43:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:03.423 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.471+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.473+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:03.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.473+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.474+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.474+0000 7fa66721f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.474+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.475+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.475+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.475+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:03.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.475+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.476+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:03.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.476+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.477+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:03.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.477+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.477+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:03.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.477+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 20 zone MyZone found 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:03.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:03.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:03.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.478+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.479+0000 7fa66721f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:03.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.479+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.479+0000 7fa66721f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:03.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.479+0000 7fa66721f800 20 started sync module instance, tier type = 2024-05-15T14:43:03.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.479+0000 7fa66721f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:03.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.490+0000 7fa66721f800 20 add_watcher() i=0 2024-05-15T14:43:03.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.490+0000 7fa66721f800 20 add_watcher() i=1 2024-05-15T14:43:03.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.490+0000 7fa66721f800 20 add_watcher() i=2 2024-05-15T14:43:03.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.490+0000 7fa66721f800 20 add_watcher() i=3 2024-05-15T14:43:03.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.490+0000 7fa66721f800 20 add_watcher() i=4 2024-05-15T14:43:03.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.490+0000 7fa66721f800 20 add_watcher() i=5 2024-05-15T14:43:03.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.490+0000 7fa66721f800 20 add_watcher() i=6 2024-05-15T14:43:03.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.491+0000 7fa66721f800 20 add_watcher() i=7 2024-05-15T14:43:03.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.491+0000 7fa66721f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:03.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.493+0000 7fa51afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.493+0000 7fa66721f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.493+0000 7fa66721f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.493+0000 7fa66721f800 5 note: GC not initialized 2024-05-15T14:43:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.494+0000 7fa519fe3640 20 reqs_thread_entry: start 2024-05-15T14:43:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.494+0000 7fa66721f800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.494+0000 7fa66721f800 20 Filter name: none 2024-05-15T14:43:03.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.494+0000 7fa48b7fe640 20 reqs_thread_entry: start 2024-05-15T14:43:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.494+0000 7fa66721f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:03.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.495+0000 7fa66721f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:03.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.497+0000 7fa51afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.499+0000 7fa66721f800 20 remove_watcher() i=0 2024-05-15T14:43:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.499+0000 7fa66721f800 2 removed watcher, disabling cache 2024-05-15T14:43:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.500+0000 7fa66721f800 20 remove_watcher() i=1 2024-05-15T14:43:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.501+0000 7fa66721f800 20 remove_watcher() i=2 2024-05-15T14:43:03.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.502+0000 7fa66721f800 20 remove_watcher() i=3 2024-05-15T14:43:03.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.503+0000 7fa66721f800 20 remove_watcher() i=4 2024-05-15T14:43:03.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.504+0000 7fa66721f800 20 remove_watcher() i=5 2024-05-15T14:43:03.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.505+0000 7fa66721f800 20 remove_watcher() i=6 2024-05-15T14:43:03.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:03.506+0000 7fa66721f800 20 remove_watcher() i=7 2024-05-15T14:43:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:08.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.625+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.627+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.627+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.628+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:08.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.628+0000 7f5d9c735800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:08.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.628+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.628+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:08.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.628+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.629+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:08.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.629+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.630+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:08.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.630+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.630+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:08.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.630+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.631+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:08.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.631+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:08.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:08.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 20 zone MyZone found 2024-05-15T14:43:08.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:08.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:08.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:08.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:08.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:08.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:08.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.632+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.633+0000 7f5d9c735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:08.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.633+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.633+0000 7f5d9c735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:08.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.633+0000 7f5d9c735800 20 started sync module instance, tier type = 2024-05-15T14:43:08.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.633+0000 7f5d9c735800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.645+0000 7f5d9c735800 20 add_watcher() i=0 2024-05-15T14:43:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.645+0000 7f5d9c735800 20 add_watcher() i=1 2024-05-15T14:43:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.645+0000 7f5d9c735800 20 add_watcher() i=2 2024-05-15T14:43:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.645+0000 7f5d9c735800 20 add_watcher() i=3 2024-05-15T14:43:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.645+0000 7f5d9c735800 20 add_watcher() i=4 2024-05-15T14:43:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.645+0000 7f5d9c735800 20 add_watcher() i=5 2024-05-15T14:43:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.645+0000 7f5d9c735800 20 add_watcher() i=6 2024-05-15T14:43:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.646+0000 7f5d9c735800 20 add_watcher() i=7 2024-05-15T14:43:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.646+0000 7f5d9c735800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:08.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.647+0000 7f5c4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.648+0000 7f5d9c735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.648+0000 7f5d9c735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.648+0000 7f5d9c735800 5 note: GC not initialized 2024-05-15T14:43:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.648+0000 7f5c4dfdb640 20 reqs_thread_entry: start 2024-05-15T14:43:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.648+0000 7f5d9c735800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.648+0000 7f5d9c735800 20 Filter name: none 2024-05-15T14:43:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.648+0000 7f5bbf7fe640 20 reqs_thread_entry: start 2024-05-15T14:43:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.649+0000 7f5d9c735800 20 rados->read ofs=0 len=0 2024-05-15T14:43:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.649+0000 7f5d9c735800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:08.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.651+0000 7f5c4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:08.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.653+0000 7f5d9c735800 20 remove_watcher() i=0 2024-05-15T14:43:08.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.653+0000 7f5d9c735800 2 removed watcher, disabling cache 2024-05-15T14:43:08.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.655+0000 7f5d9c735800 20 remove_watcher() i=1 2024-05-15T14:43:08.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.656+0000 7f5d9c735800 20 remove_watcher() i=2 2024-05-15T14:43:08.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.657+0000 7f5d9c735800 20 remove_watcher() i=3 2024-05-15T14:43:08.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.658+0000 7f5d9c735800 20 remove_watcher() i=4 2024-05-15T14:43:08.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.659+0000 7f5d9c735800 20 remove_watcher() i=5 2024-05-15T14:43:08.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.660+0000 7f5d9c735800 20 remove_watcher() i=6 2024-05-15T14:43:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:08.661+0000 7f5d9c735800 20 remove_watcher() i=7 2024-05-15T14:43:13.730 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:13.730 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.774+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.777+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.777+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.778+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:13.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.778+0000 7f88c3d2a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:13.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.778+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.778+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:13.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.778+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.779+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.779+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.780+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.780+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.780+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.780+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.780+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.780+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.781+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:13.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.781+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:13.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 zone MyZone found 2024-05-15T14:43:13.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:13.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:13.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:13.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:13.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:13.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:13.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:13.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:13.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 started sync module instance, tier type = 2024-05-15T14:43:13.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.782+0000 7f88c3d2a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:13.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.794+0000 7f88c3d2a800 20 add_watcher() i=0 2024-05-15T14:43:13.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.794+0000 7f88c3d2a800 20 add_watcher() i=1 2024-05-15T14:43:13.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.794+0000 7f88c3d2a800 20 add_watcher() i=2 2024-05-15T14:43:13.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.794+0000 7f88c3d2a800 20 add_watcher() i=3 2024-05-15T14:43:13.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.794+0000 7f88c3d2a800 20 add_watcher() i=4 2024-05-15T14:43:13.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.794+0000 7f88c3d2a800 20 add_watcher() i=5 2024-05-15T14:43:13.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.794+0000 7f88c3d2a800 20 add_watcher() i=6 2024-05-15T14:43:13.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.795+0000 7f88c3d2a800 20 add_watcher() i=7 2024-05-15T14:43:13.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.795+0000 7f88c3d2a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:13.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.797+0000 7f8775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:13.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.797+0000 7f88c3d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:13.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.797+0000 7f88c3d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:13.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.797+0000 7f88c3d2a800 5 note: GC not initialized 2024-05-15T14:43:13.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.798+0000 7f8774fe1640 20 reqs_thread_entry: start 2024-05-15T14:43:13.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.798+0000 7f88c3d2a800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:13.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.798+0000 7f88c3d2a800 20 Filter name: none 2024-05-15T14:43:13.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.798+0000 7f86ee7fc640 20 reqs_thread_entry: start 2024-05-15T14:43:13.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.798+0000 7f88c3d2a800 20 rados->read ofs=0 len=0 2024-05-15T14:43:13.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.799+0000 7f88c3d2a800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:13.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.801+0000 7f8775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:13.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.803+0000 7f88c3d2a800 20 remove_watcher() i=0 2024-05-15T14:43:13.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.803+0000 7f88c3d2a800 2 removed watcher, disabling cache 2024-05-15T14:43:13.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.804+0000 7f88c3d2a800 20 remove_watcher() i=1 2024-05-15T14:43:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.805+0000 7f88c3d2a800 20 remove_watcher() i=2 2024-05-15T14:43:13.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.806+0000 7f88c3d2a800 20 remove_watcher() i=3 2024-05-15T14:43:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.808+0000 7f88c3d2a800 20 remove_watcher() i=4 2024-05-15T14:43:13.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.809+0000 7f88c3d2a800 20 remove_watcher() i=5 2024-05-15T14:43:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.810+0000 7f88c3d2a800 20 remove_watcher() i=6 2024-05-15T14:43:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:13.811+0000 7f88c3d2a800 20 remove_watcher() i=7 2024-05-15T14:43:18.882 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:18.882 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:18.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.928+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.930+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:18.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.930+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.931+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.931+0000 7f5fbb32e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.931+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.931+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.931+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.932+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.932+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.933+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:18.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.933+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.933+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:18.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.933+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.933+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:18.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.933+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.934+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:18.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.934+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 zone MyZone found 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:18.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:18.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 started sync module instance, tier type = 2024-05-15T14:43:18.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.935+0000 7f5fbb32e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:18.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.947+0000 7f5fbb32e800 20 add_watcher() i=0 2024-05-15T14:43:18.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.947+0000 7f5fbb32e800 20 add_watcher() i=1 2024-05-15T14:43:18.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.947+0000 7f5fbb32e800 20 add_watcher() i=2 2024-05-15T14:43:18.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.947+0000 7f5fbb32e800 20 add_watcher() i=3 2024-05-15T14:43:18.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.947+0000 7f5fbb32e800 20 add_watcher() i=4 2024-05-15T14:43:18.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.947+0000 7f5fbb32e800 20 add_watcher() i=5 2024-05-15T14:43:18.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.947+0000 7f5fbb32e800 20 add_watcher() i=6 2024-05-15T14:43:18.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.948+0000 7f5fbb32e800 20 add_watcher() i=7 2024-05-15T14:43:18.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.948+0000 7f5fbb32e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:18.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.950+0000 7f5e6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.950+0000 7f5fbb32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.950+0000 7f5fbb32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.950+0000 7f5fbb32e800 5 note: GC not initialized 2024-05-15T14:43:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.951+0000 7f5e6cfe1640 20 reqs_thread_entry: start 2024-05-15T14:43:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.951+0000 7f5fbb32e800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.951+0000 7f5fbb32e800 20 Filter name: none 2024-05-15T14:43:18.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.951+0000 7f5de67fc640 20 reqs_thread_entry: start 2024-05-15T14:43:18.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.951+0000 7f5fbb32e800 20 rados->read ofs=0 len=0 2024-05-15T14:43:18.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.952+0000 7f5fbb32e800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:18.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.954+0000 7f5e6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.956+0000 7f5fbb32e800 20 remove_watcher() i=0 2024-05-15T14:43:18.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.956+0000 7f5fbb32e800 2 removed watcher, disabling cache 2024-05-15T14:43:18.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.957+0000 7f5fbb32e800 20 remove_watcher() i=1 2024-05-15T14:43:18.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.958+0000 7f5fbb32e800 20 remove_watcher() i=2 2024-05-15T14:43:18.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.959+0000 7f5fbb32e800 20 remove_watcher() i=3 2024-05-15T14:43:18.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.960+0000 7f5fbb32e800 20 remove_watcher() i=4 2024-05-15T14:43:18.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.961+0000 7f5fbb32e800 20 remove_watcher() i=5 2024-05-15T14:43:18.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.962+0000 7f5fbb32e800 20 remove_watcher() i=6 2024-05-15T14:43:18.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:18.964+0000 7f5fbb32e800 20 remove_watcher() i=7 2024-05-15T14:43:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:24.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.081+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.083+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:24.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.083+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.084+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:24.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.084+0000 7f288e731800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:24.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.084+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.084+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:24.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.084+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.085+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:24.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.085+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.086+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:24.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.086+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.086+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:24.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.086+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.087+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:24.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.087+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.087+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.087+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 zone MyZone found 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 started sync module instance, tier type = 2024-05-15T14:43:24.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.088+0000 7f288e731800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.100+0000 7f288e731800 20 add_watcher() i=0 2024-05-15T14:43:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.100+0000 7f288e731800 20 add_watcher() i=1 2024-05-15T14:43:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.100+0000 7f288e731800 20 add_watcher() i=2 2024-05-15T14:43:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.100+0000 7f288e731800 20 add_watcher() i=3 2024-05-15T14:43:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.100+0000 7f288e731800 20 add_watcher() i=4 2024-05-15T14:43:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.100+0000 7f288e731800 20 add_watcher() i=5 2024-05-15T14:43:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.100+0000 7f288e731800 20 add_watcher() i=6 2024-05-15T14:43:24.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.101+0000 7f288e731800 20 add_watcher() i=7 2024-05-15T14:43:24.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.101+0000 7f288e731800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.103+0000 7f2740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.103+0000 7f288e731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.103+0000 7f288e731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.103+0000 7f288e731800 5 note: GC not initialized 2024-05-15T14:43:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.104+0000 7f26bb7fe640 20 reqs_thread_entry: start 2024-05-15T14:43:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.104+0000 7f288e731800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.104+0000 7f288e731800 20 Filter name: none 2024-05-15T14:43:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.104+0000 7f26b97fa640 20 reqs_thread_entry: start 2024-05-15T14:43:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.104+0000 7f288e731800 20 rados->read ofs=0 len=0 2024-05-15T14:43:24.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.105+0000 7f288e731800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:24.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.107+0000 7f2740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:24.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.109+0000 7f288e731800 20 remove_watcher() i=0 2024-05-15T14:43:24.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.109+0000 7f288e731800 2 removed watcher, disabling cache 2024-05-15T14:43:24.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.110+0000 7f288e731800 20 remove_watcher() i=1 2024-05-15T14:43:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.111+0000 7f288e731800 20 remove_watcher() i=2 2024-05-15T14:43:24.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.112+0000 7f288e731800 20 remove_watcher() i=3 2024-05-15T14:43:24.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.113+0000 7f288e731800 20 remove_watcher() i=4 2024-05-15T14:43:24.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.114+0000 7f288e731800 20 remove_watcher() i=5 2024-05-15T14:43:24.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.115+0000 7f288e731800 20 remove_watcher() i=6 2024-05-15T14:43:24.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:24.116+0000 7f288e731800 20 remove_watcher() i=7 2024-05-15T14:43:29.187 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:29.188 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:29.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.237+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.239+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:29.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.239+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.240+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:29.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.240+0000 7fc216815800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:29.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.240+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.241+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.241+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.242+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.242+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.242+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.242+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.243+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.243+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.243+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.243+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 20 zone MyZone found 2024-05-15T14:43:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:29.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:29.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.244+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.245+0000 7fc216815800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:29.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.245+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.245+0000 7fc216815800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:29.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.245+0000 7fc216815800 20 started sync module instance, tier type = 2024-05-15T14:43:29.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.245+0000 7fc216815800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:29.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.257+0000 7fc216815800 20 add_watcher() i=0 2024-05-15T14:43:29.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.257+0000 7fc216815800 20 add_watcher() i=1 2024-05-15T14:43:29.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.257+0000 7fc216815800 20 add_watcher() i=2 2024-05-15T14:43:29.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.257+0000 7fc216815800 20 add_watcher() i=3 2024-05-15T14:43:29.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.257+0000 7fc216815800 20 add_watcher() i=4 2024-05-15T14:43:29.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.257+0000 7fc216815800 20 add_watcher() i=5 2024-05-15T14:43:29.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.257+0000 7fc216815800 20 add_watcher() i=6 2024-05-15T14:43:29.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.258+0000 7fc216815800 20 add_watcher() i=7 2024-05-15T14:43:29.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.258+0000 7fc216815800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:29.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.259+0000 7fc0bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:29.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.260+0000 7fc216815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:29.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.260+0000 7fc216815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:29.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.260+0000 7fc216815800 5 note: GC not initialized 2024-05-15T14:43:29.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.260+0000 7fc0ba7fc640 20 reqs_thread_entry: start 2024-05-15T14:43:29.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.260+0000 7fc216815800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:29.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.260+0000 7fc216815800 20 Filter name: none 2024-05-15T14:43:29.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.260+0000 7fc033fff640 20 reqs_thread_entry: start 2024-05-15T14:43:29.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.261+0000 7fc216815800 20 rados->read ofs=0 len=0 2024-05-15T14:43:29.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.261+0000 7fc216815800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:29.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.263+0000 7fc0bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:29.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.265+0000 7fc216815800 20 remove_watcher() i=0 2024-05-15T14:43:29.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.265+0000 7fc216815800 2 removed watcher, disabling cache 2024-05-15T14:43:29.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.266+0000 7fc216815800 20 remove_watcher() i=1 2024-05-15T14:43:29.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.267+0000 7fc216815800 20 remove_watcher() i=2 2024-05-15T14:43:29.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.269+0000 7fc216815800 20 remove_watcher() i=3 2024-05-15T14:43:29.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.270+0000 7fc216815800 20 remove_watcher() i=4 2024-05-15T14:43:29.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.271+0000 7fc216815800 20 remove_watcher() i=5 2024-05-15T14:43:29.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.272+0000 7fc216815800 20 remove_watcher() i=6 2024-05-15T14:43:29.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:29.273+0000 7fc216815800 20 remove_watcher() i=7 2024-05-15T14:43:34.346 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:34.346 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:34.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.391+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.393+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:34.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.393+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.395+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.395+0000 7f7b894df800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.395+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.395+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.395+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.396+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.396+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.397+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.397+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.397+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.397+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.397+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.397+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.398+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:34.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.398+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 zone MyZone found 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 started sync module instance, tier type = 2024-05-15T14:43:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.399+0000 7f7b894df800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.411+0000 7f7b894df800 20 add_watcher() i=0 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.411+0000 7f7b894df800 20 add_watcher() i=1 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.411+0000 7f7b894df800 20 add_watcher() i=2 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.411+0000 7f7b894df800 20 add_watcher() i=3 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.411+0000 7f7b894df800 20 add_watcher() i=4 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.411+0000 7f7b894df800 20 add_watcher() i=5 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.411+0000 7f7b894df800 20 add_watcher() i=6 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.412+0000 7f7b894df800 20 add_watcher() i=7 2024-05-15T14:43:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.412+0000 7f7b894df800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:34.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.413+0000 7f7a3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:34.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.414+0000 7f7b894df800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:34.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.414+0000 7f7b894df800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:34.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.414+0000 7f7b894df800 5 note: GC not initialized 2024-05-15T14:43:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.415+0000 7f79b7fff640 20 reqs_thread_entry: start 2024-05-15T14:43:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.415+0000 7f7b894df800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.415+0000 7f7b894df800 20 Filter name: none 2024-05-15T14:43:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.415+0000 7f79b5ffb640 20 reqs_thread_entry: start 2024-05-15T14:43:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.415+0000 7f7b894df800 20 rados->read ofs=0 len=0 2024-05-15T14:43:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.416+0000 7f7b894df800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:34.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.418+0000 7f7a3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.420+0000 7f7b894df800 20 remove_watcher() i=0 2024-05-15T14:43:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.420+0000 7f7b894df800 2 removed watcher, disabling cache 2024-05-15T14:43:34.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.421+0000 7f7b894df800 20 remove_watcher() i=1 2024-05-15T14:43:34.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.422+0000 7f7b894df800 20 remove_watcher() i=2 2024-05-15T14:43:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.423+0000 7f7b894df800 20 remove_watcher() i=3 2024-05-15T14:43:34.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.424+0000 7f7b894df800 20 remove_watcher() i=4 2024-05-15T14:43:34.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.425+0000 7f7b894df800 20 remove_watcher() i=5 2024-05-15T14:43:34.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.426+0000 7f7b894df800 20 remove_watcher() i=6 2024-05-15T14:43:34.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:34.427+0000 7f7b894df800 20 remove_watcher() i=7 2024-05-15T14:43:39.496 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:39.496 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:39.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.547+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.548+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.548+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.549+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:39.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.549+0000 7fb862640800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:39.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.549+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.549+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:39.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.549+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.550+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:39.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.550+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.551+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.551+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.552+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.552+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.552+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:39.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.552+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:39.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:39.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 20 zone MyZone found 2024-05-15T14:43:39.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:39.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:39.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:39.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:39.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:39.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:39.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.553+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.554+0000 7fb862640800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:39.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.554+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.554+0000 7fb862640800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:39.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.554+0000 7fb862640800 20 started sync module instance, tier type = 2024-05-15T14:43:39.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.554+0000 7fb862640800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.566+0000 7fb862640800 20 add_watcher() i=0 2024-05-15T14:43:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.566+0000 7fb862640800 20 add_watcher() i=1 2024-05-15T14:43:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.566+0000 7fb862640800 20 add_watcher() i=2 2024-05-15T14:43:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.566+0000 7fb862640800 20 add_watcher() i=3 2024-05-15T14:43:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.566+0000 7fb862640800 20 add_watcher() i=4 2024-05-15T14:43:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.566+0000 7fb862640800 20 add_watcher() i=5 2024-05-15T14:43:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.566+0000 7fb862640800 20 add_watcher() i=6 2024-05-15T14:43:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.567+0000 7fb862640800 20 add_watcher() i=7 2024-05-15T14:43:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.567+0000 7fb862640800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.568+0000 7fb7137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.569+0000 7fb862640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.569+0000 7fb862640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.569+0000 7fb862640800 5 note: GC not initialized 2024-05-15T14:43:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.569+0000 7fb7127e4640 20 reqs_thread_entry: start 2024-05-15T14:43:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.569+0000 7fb862640800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.569+0000 7fb862640800 20 Filter name: none 2024-05-15T14:43:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.569+0000 7fb683fff640 20 reqs_thread_entry: start 2024-05-15T14:43:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.570+0000 7fb862640800 20 rados->read ofs=0 len=0 2024-05-15T14:43:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.570+0000 7fb862640800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.572+0000 7fb7137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.574+0000 7fb862640800 20 remove_watcher() i=0 2024-05-15T14:43:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.574+0000 7fb862640800 2 removed watcher, disabling cache 2024-05-15T14:43:39.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.575+0000 7fb862640800 20 remove_watcher() i=1 2024-05-15T14:43:39.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.576+0000 7fb862640800 20 remove_watcher() i=2 2024-05-15T14:43:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.578+0000 7fb862640800 20 remove_watcher() i=3 2024-05-15T14:43:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.579+0000 7fb862640800 20 remove_watcher() i=4 2024-05-15T14:43:39.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.580+0000 7fb862640800 20 remove_watcher() i=5 2024-05-15T14:43:39.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.581+0000 7fb862640800 20 remove_watcher() i=6 2024-05-15T14:43:39.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:39.582+0000 7fb862640800 20 remove_watcher() i=7 2024-05-15T14:43:44.653 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:44.654 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:44.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.702+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.704+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:44.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.704+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.705+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.705+0000 7f5457f33800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.705+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.705+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.705+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.706+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:44.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.706+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.707+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.707+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.708+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:44.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.708+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.708+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:44.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.708+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:44.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:44.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 20 zone MyZone found 2024-05-15T14:43:44.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:44.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:44.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.709+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.710+0000 7f5457f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.710+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.710+0000 7f5457f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.710+0000 7f5457f33800 20 started sync module instance, tier type = 2024-05-15T14:43:44.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.710+0000 7f5457f33800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:44.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.722+0000 7f5457f33800 20 add_watcher() i=0 2024-05-15T14:43:44.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.722+0000 7f5457f33800 20 add_watcher() i=1 2024-05-15T14:43:44.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.722+0000 7f5457f33800 20 add_watcher() i=2 2024-05-15T14:43:44.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.722+0000 7f5457f33800 20 add_watcher() i=3 2024-05-15T14:43:44.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.722+0000 7f5457f33800 20 add_watcher() i=4 2024-05-15T14:43:44.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.722+0000 7f5457f33800 20 add_watcher() i=5 2024-05-15T14:43:44.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.722+0000 7f5457f33800 20 add_watcher() i=6 2024-05-15T14:43:44.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.723+0000 7f5457f33800 20 add_watcher() i=7 2024-05-15T14:43:44.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.723+0000 7f5457f33800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:44.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.725+0000 7f5309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:44.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.725+0000 7f5457f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:44.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.725+0000 7f5457f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:44.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.725+0000 7f5457f33800 5 note: GC not initialized 2024-05-15T14:43:44.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.725+0000 7f5308fe1640 20 reqs_thread_entry: start 2024-05-15T14:43:44.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.726+0000 7f5457f33800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:44.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.726+0000 7f5457f33800 20 Filter name: none 2024-05-15T14:43:44.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.726+0000 7f52827fc640 20 reqs_thread_entry: start 2024-05-15T14:43:44.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.726+0000 7f5457f33800 20 rados->read ofs=0 len=0 2024-05-15T14:43:44.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.727+0000 7f5457f33800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:44.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.728+0000 7f5309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.730+0000 7f5457f33800 20 remove_watcher() i=0 2024-05-15T14:43:44.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.730+0000 7f5457f33800 2 removed watcher, disabling cache 2024-05-15T14:43:44.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.732+0000 7f5457f33800 20 remove_watcher() i=1 2024-05-15T14:43:44.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.733+0000 7f5457f33800 20 remove_watcher() i=2 2024-05-15T14:43:44.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.734+0000 7f5457f33800 20 remove_watcher() i=3 2024-05-15T14:43:44.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.735+0000 7f5457f33800 20 remove_watcher() i=4 2024-05-15T14:43:44.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.736+0000 7f5457f33800 20 remove_watcher() i=5 2024-05-15T14:43:44.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.737+0000 7f5457f33800 20 remove_watcher() i=6 2024-05-15T14:43:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:44.738+0000 7f5457f33800 20 remove_watcher() i=7 2024-05-15T14:43:49.809 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:49.809 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.856+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.858+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:49.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.858+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.859+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:49.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.859+0000 7f1f93c13800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:49.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.859+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.859+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:49.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.859+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.860+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:49.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.860+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.861+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:49.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.861+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.861+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:49.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.862+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.862+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:49.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.862+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:49.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:49.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 20 zone MyZone found 2024-05-15T14:43:49.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:49.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:49.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:49.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:49.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:49.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:49.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.863+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.864+0000 7f1f93c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:49.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.864+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.864+0000 7f1f93c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:49.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.864+0000 7f1f93c13800 20 started sync module instance, tier type = 2024-05-15T14:43:49.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.864+0000 7f1f93c13800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.875+0000 7f1f93c13800 20 add_watcher() i=0 2024-05-15T14:43:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.875+0000 7f1f93c13800 20 add_watcher() i=1 2024-05-15T14:43:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.875+0000 7f1f93c13800 20 add_watcher() i=2 2024-05-15T14:43:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.875+0000 7f1f93c13800 20 add_watcher() i=3 2024-05-15T14:43:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.875+0000 7f1f93c13800 20 add_watcher() i=4 2024-05-15T14:43:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.875+0000 7f1f93c13800 20 add_watcher() i=5 2024-05-15T14:43:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.875+0000 7f1f93c13800 20 add_watcher() i=6 2024-05-15T14:43:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.876+0000 7f1f93c13800 20 add_watcher() i=7 2024-05-15T14:43:49.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.876+0000 7f1f93c13800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:49.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.878+0000 7f1e45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.878+0000 7f1f93c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.878+0000 7f1f93c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.878+0000 7f1f93c13800 5 note: GC not initialized 2024-05-15T14:43:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.879+0000 7f1e44fe1640 20 reqs_thread_entry: start 2024-05-15T14:43:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.879+0000 7f1f93c13800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.879+0000 7f1f93c13800 20 Filter name: none 2024-05-15T14:43:49.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.879+0000 7f1dbe7fc640 20 reqs_thread_entry: start 2024-05-15T14:43:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.879+0000 7f1f93c13800 20 rados->read ofs=0 len=0 2024-05-15T14:43:49.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.880+0000 7f1f93c13800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:49.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.882+0000 7f1e45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:49.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.884+0000 7f1f93c13800 20 remove_watcher() i=0 2024-05-15T14:43:49.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.884+0000 7f1f93c13800 2 removed watcher, disabling cache 2024-05-15T14:43:49.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.885+0000 7f1f93c13800 20 remove_watcher() i=1 2024-05-15T14:43:49.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.886+0000 7f1f93c13800 20 remove_watcher() i=2 2024-05-15T14:43:49.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.887+0000 7f1f93c13800 20 remove_watcher() i=3 2024-05-15T14:43:49.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.888+0000 7f1f93c13800 20 remove_watcher() i=4 2024-05-15T14:43:49.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.889+0000 7f1f93c13800 20 remove_watcher() i=5 2024-05-15T14:43:49.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.890+0000 7f1f93c13800 20 remove_watcher() i=6 2024-05-15T14:43:49.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:49.891+0000 7f1f93c13800 20 remove_watcher() i=7 2024-05-15T14:43:54.963 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:43:54.963 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:43:55.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.010+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.013+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:55.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.013+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.014+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.014+0000 7fa59f21f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:43:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.014+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.014+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.014+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.015+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:43:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.015+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.016+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:43:55.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.016+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.016+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:55.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.016+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.016+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:43:55.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.016+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.017+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:43:55.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.017+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:43:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 zone MyZone found 2024-05-15T14:43:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:43:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:43:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:43:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:43:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:43:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:43:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:43:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 started sync module instance, tier type = 2024-05-15T14:43:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.018+0000 7fa59f21f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:43:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.030+0000 7fa59f21f800 20 add_watcher() i=0 2024-05-15T14:43:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.030+0000 7fa59f21f800 20 add_watcher() i=1 2024-05-15T14:43:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.030+0000 7fa59f21f800 20 add_watcher() i=2 2024-05-15T14:43:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.030+0000 7fa59f21f800 20 add_watcher() i=3 2024-05-15T14:43:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.030+0000 7fa59f21f800 20 add_watcher() i=4 2024-05-15T14:43:55.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.030+0000 7fa59f21f800 20 add_watcher() i=5 2024-05-15T14:43:55.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.030+0000 7fa59f21f800 20 add_watcher() i=6 2024-05-15T14:43:55.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.031+0000 7fa59f21f800 20 add_watcher() i=7 2024-05-15T14:43:55.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.031+0000 7fa59f21f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:43:55.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.032+0000 7fa452fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:55.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.033+0000 7fa59f21f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:43:55.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.033+0000 7fa59f21f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:43:55.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.033+0000 7fa59f21f800 5 note: GC not initialized 2024-05-15T14:43:55.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.033+0000 7fa451fe3640 20 reqs_thread_entry: start 2024-05-15T14:43:55.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.033+0000 7fa59f21f800 20 init_complete bucket index max shards: 11 2024-05-15T14:43:55.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.033+0000 7fa59f21f800 20 Filter name: none 2024-05-15T14:43:55.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.033+0000 7fa3c37fe640 20 reqs_thread_entry: start 2024-05-15T14:43:55.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.034+0000 7fa59f21f800 20 rados->read ofs=0 len=0 2024-05-15T14:43:55.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.034+0000 7fa59f21f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:43:55.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.036+0000 7fa452fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:43:55.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.039+0000 7fa59f21f800 20 remove_watcher() i=0 2024-05-15T14:43:55.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.039+0000 7fa59f21f800 2 removed watcher, disabling cache 2024-05-15T14:43:55.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.041+0000 7fa59f21f800 20 remove_watcher() i=1 2024-05-15T14:43:55.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.043+0000 7fa59f21f800 20 remove_watcher() i=2 2024-05-15T14:43:55.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.045+0000 7fa59f21f800 20 remove_watcher() i=3 2024-05-15T14:43:55.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.047+0000 7fa59f21f800 20 remove_watcher() i=4 2024-05-15T14:43:55.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.049+0000 7fa59f21f800 20 remove_watcher() i=5 2024-05-15T14:43:55.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.051+0000 7fa59f21f800 20 remove_watcher() i=6 2024-05-15T14:43:55.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:43:55.053+0000 7fa59f21f800 20 remove_watcher() i=7 2024-05-15T14:44:00.124 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:00.125 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:00.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.176+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.179+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:00.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.179+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.180+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.180+0000 7f0e3ae10800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.180+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.180+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.180+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.181+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.181+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.182+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.182+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.182+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.182+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.183+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.183+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 zone MyZone found 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.184+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.185+0000 7f0e3ae10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.185+0000 7f0e3ae10800 20 started sync module instance, tier type = 2024-05-15T14:44:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.185+0000 7f0e3ae10800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:00.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.196+0000 7f0e3ae10800 20 add_watcher() i=0 2024-05-15T14:44:00.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.196+0000 7f0e3ae10800 20 add_watcher() i=1 2024-05-15T14:44:00.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.197+0000 7f0e3ae10800 20 add_watcher() i=2 2024-05-15T14:44:00.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.197+0000 7f0e3ae10800 20 add_watcher() i=3 2024-05-15T14:44:00.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.197+0000 7f0e3ae10800 20 add_watcher() i=4 2024-05-15T14:44:00.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.197+0000 7f0e3ae10800 20 add_watcher() i=5 2024-05-15T14:44:00.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.197+0000 7f0e3ae10800 20 add_watcher() i=6 2024-05-15T14:44:00.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.198+0000 7f0e3ae10800 20 add_watcher() i=7 2024-05-15T14:44:00.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.198+0000 7f0e3ae10800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:00.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.199+0000 7f0cecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:00.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.200+0000 7f0e3ae10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:00.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.200+0000 7f0e3ae10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:00.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.200+0000 7f0e3ae10800 5 note: GC not initialized 2024-05-15T14:44:00.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.200+0000 7f0c677fe640 20 reqs_thread_entry: start 2024-05-15T14:44:00.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.200+0000 7f0e3ae10800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:00.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.200+0000 7f0e3ae10800 20 Filter name: none 2024-05-15T14:44:00.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.200+0000 7f0c657fa640 20 reqs_thread_entry: start 2024-05-15T14:44:00.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.201+0000 7f0e3ae10800 20 rados->read ofs=0 len=0 2024-05-15T14:44:00.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.201+0000 7f0e3ae10800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:44:00.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.203+0000 7f0cecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:00.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.205+0000 7f0e3ae10800 20 remove_watcher() i=0 2024-05-15T14:44:00.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.205+0000 7f0e3ae10800 2 removed watcher, disabling cache 2024-05-15T14:44:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.206+0000 7f0e3ae10800 20 remove_watcher() i=1 2024-05-15T14:44:00.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.207+0000 7f0e3ae10800 20 remove_watcher() i=2 2024-05-15T14:44:00.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.208+0000 7f0e3ae10800 20 remove_watcher() i=3 2024-05-15T14:44:00.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.209+0000 7f0e3ae10800 20 remove_watcher() i=4 2024-05-15T14:44:00.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.210+0000 7f0e3ae10800 20 remove_watcher() i=5 2024-05-15T14:44:00.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.212+0000 7f0e3ae10800 20 remove_watcher() i=6 2024-05-15T14:44:00.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:00.213+0000 7f0e3ae10800 20 remove_watcher() i=7 2024-05-15T14:44:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:05.283 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:05.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.333+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.334+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:05.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.334+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.335+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:05.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.335+0000 7fb532d22800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:05.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.335+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.335+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:05.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.335+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.336+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:05.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.336+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.337+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:05.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.337+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.338+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:05.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.338+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.338+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:05.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.338+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:05.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:05.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 zone MyZone found 2024-05-15T14:44:05.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:05.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:05.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:05.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:44:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.339+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.340+0000 7fb532d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.340+0000 7fb532d22800 20 started sync module instance, tier type = 2024-05-15T14:44:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.340+0000 7fb532d22800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:05.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.351+0000 7fb532d22800 20 add_watcher() i=0 2024-05-15T14:44:05.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.351+0000 7fb532d22800 20 add_watcher() i=1 2024-05-15T14:44:05.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.351+0000 7fb532d22800 20 add_watcher() i=2 2024-05-15T14:44:05.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.351+0000 7fb532d22800 20 add_watcher() i=3 2024-05-15T14:44:05.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.351+0000 7fb532d22800 20 add_watcher() i=4 2024-05-15T14:44:05.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.351+0000 7fb532d22800 20 add_watcher() i=5 2024-05-15T14:44:05.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.351+0000 7fb532d22800 20 add_watcher() i=6 2024-05-15T14:44:05.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.352+0000 7fb532d22800 20 add_watcher() i=7 2024-05-15T14:44:05.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.352+0000 7fb532d22800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:05.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.353+0000 7fb3e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:05.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.354+0000 7fb532d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:05.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.354+0000 7fb532d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:05.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.354+0000 7fb532d22800 5 note: GC not initialized 2024-05-15T14:44:05.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.354+0000 7fb35ffff640 20 reqs_thread_entry: start 2024-05-15T14:44:05.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.354+0000 7fb532d22800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:05.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.354+0000 7fb532d22800 20 Filter name: none 2024-05-15T14:44:05.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.354+0000 7fb35dffb640 20 reqs_thread_entry: start 2024-05-15T14:44:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.355+0000 7fb532d22800 20 rados->read ofs=0 len=0 2024-05-15T14:44:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.355+0000 7fb532d22800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:44:05.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.357+0000 7fb3e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.359+0000 7fb532d22800 20 remove_watcher() i=0 2024-05-15T14:44:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.359+0000 7fb532d22800 2 removed watcher, disabling cache 2024-05-15T14:44:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.360+0000 7fb532d22800 20 remove_watcher() i=1 2024-05-15T14:44:05.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.361+0000 7fb532d22800 20 remove_watcher() i=2 2024-05-15T14:44:05.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.362+0000 7fb532d22800 20 remove_watcher() i=3 2024-05-15T14:44:05.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.363+0000 7fb532d22800 20 remove_watcher() i=4 2024-05-15T14:44:05.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.365+0000 7fb532d22800 20 remove_watcher() i=5 2024-05-15T14:44:05.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.366+0000 7fb532d22800 20 remove_watcher() i=6 2024-05-15T14:44:05.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:05.367+0000 7fb532d22800 20 remove_watcher() i=7 2024-05-15T14:44:10.441 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:10.441 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:10.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.488+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.489+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.489+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.490+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.490+0000 7f5aeff33800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.490+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.491+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.491+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.491+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:10.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.491+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.492+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:10.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.492+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.492+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:10.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.492+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.493+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:10.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.493+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:10.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 zone MyZone found 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.494+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.495+0000 7f5aeff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.495+0000 7f5aeff33800 20 started sync module instance, tier type = 2024-05-15T14:44:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.495+0000 7f5aeff33800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.506+0000 7f5aeff33800 20 add_watcher() i=0 2024-05-15T14:44:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.506+0000 7f5aeff33800 20 add_watcher() i=1 2024-05-15T14:44:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.506+0000 7f5aeff33800 20 add_watcher() i=2 2024-05-15T14:44:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.506+0000 7f5aeff33800 20 add_watcher() i=3 2024-05-15T14:44:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.506+0000 7f5aeff33800 20 add_watcher() i=4 2024-05-15T14:44:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.506+0000 7f5aeff33800 20 add_watcher() i=5 2024-05-15T14:44:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.506+0000 7f5aeff33800 20 add_watcher() i=6 2024-05-15T14:44:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.507+0000 7f5aeff33800 20 add_watcher() i=7 2024-05-15T14:44:10.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.507+0000 7f5aeff33800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:10.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.509+0000 7f59a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:10.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.509+0000 7f5aeff33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:10.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.509+0000 7f5aeff33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:10.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.509+0000 7f5aeff33800 5 note: GC not initialized 2024-05-15T14:44:10.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.510+0000 7f59a0fe1640 20 reqs_thread_entry: start 2024-05-15T14:44:10.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.510+0000 7f5aeff33800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:10.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.510+0000 7f5aeff33800 20 Filter name: none 2024-05-15T14:44:10.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.510+0000 7f591a7fc640 20 reqs_thread_entry: start 2024-05-15T14:44:10.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.510+0000 7f5aeff33800 20 rados->read ofs=0 len=0 2024-05-15T14:44:10.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.511+0000 7f5aeff33800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:44:10.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.513+0000 7f59a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:10.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.516+0000 7f5aeff33800 20 remove_watcher() i=0 2024-05-15T14:44:10.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.516+0000 7f5aeff33800 2 removed watcher, disabling cache 2024-05-15T14:44:10.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.517+0000 7f5aeff33800 20 remove_watcher() i=1 2024-05-15T14:44:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.518+0000 7f5aeff33800 20 remove_watcher() i=2 2024-05-15T14:44:10.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.519+0000 7f5aeff33800 20 remove_watcher() i=3 2024-05-15T14:44:10.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.520+0000 7f5aeff33800 20 remove_watcher() i=4 2024-05-15T14:44:10.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.521+0000 7f5aeff33800 20 remove_watcher() i=5 2024-05-15T14:44:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.523+0000 7f5aeff33800 20 remove_watcher() i=6 2024-05-15T14:44:10.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:10.524+0000 7f5aeff33800 20 remove_watcher() i=7 2024-05-15T14:44:15.593 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:15.593 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.642+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.645+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.645+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.646+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.646+0000 7f4aaf51f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.646+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.646+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.646+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.647+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:15.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.647+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.648+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.648+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.649+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.649+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.649+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.649+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.650+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:15.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.650+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.650+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 zone MyZone found 2024-05-15T14:44:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 started sync module instance, tier type = 2024-05-15T14:44:15.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.651+0000 7f4aaf51f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:15.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.662+0000 7f4aaf51f800 20 add_watcher() i=0 2024-05-15T14:44:15.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.662+0000 7f4aaf51f800 20 add_watcher() i=1 2024-05-15T14:44:15.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.662+0000 7f4aaf51f800 20 add_watcher() i=2 2024-05-15T14:44:15.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.662+0000 7f4aaf51f800 20 add_watcher() i=3 2024-05-15T14:44:15.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.662+0000 7f4aaf51f800 20 add_watcher() i=4 2024-05-15T14:44:15.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.662+0000 7f4aaf51f800 20 add_watcher() i=5 2024-05-15T14:44:15.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.662+0000 7f4aaf51f800 20 add_watcher() i=6 2024-05-15T14:44:15.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.664+0000 7f4aaf51f800 20 add_watcher() i=7 2024-05-15T14:44:15.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.664+0000 7f4aaf51f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:15.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.665+0000 7f4961fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:15.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.666+0000 7f4aaf51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:15.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.666+0000 7f4aaf51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:15.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.666+0000 7f4aaf51f800 5 note: GC not initialized 2024-05-15T14:44:15.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.666+0000 7f4960fe1640 20 reqs_thread_entry: start 2024-05-15T14:44:15.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.666+0000 7f4aaf51f800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:15.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.666+0000 7f4aaf51f800 20 Filter name: none 2024-05-15T14:44:15.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.666+0000 7f48da7fc640 20 reqs_thread_entry: start 2024-05-15T14:44:15.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.667+0000 7f4aaf51f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:15.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.667+0000 7f4aaf51f800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:44:15.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.669+0000 7f4961fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:15.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.671+0000 7f4aaf51f800 20 remove_watcher() i=0 2024-05-15T14:44:15.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.671+0000 7f4aaf51f800 2 removed watcher, disabling cache 2024-05-15T14:44:15.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.673+0000 7f4aaf51f800 20 remove_watcher() i=1 2024-05-15T14:44:15.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.674+0000 7f4aaf51f800 20 remove_watcher() i=2 2024-05-15T14:44:15.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.675+0000 7f4aaf51f800 20 remove_watcher() i=3 2024-05-15T14:44:15.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.676+0000 7f4aaf51f800 20 remove_watcher() i=4 2024-05-15T14:44:15.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.677+0000 7f4aaf51f800 20 remove_watcher() i=5 2024-05-15T14:44:15.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.678+0000 7f4aaf51f800 20 remove_watcher() i=6 2024-05-15T14:44:15.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:15.679+0000 7f4aaf51f800 20 remove_watcher() i=7 2024-05-15T14:44:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.800+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.802+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:20.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.802+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.803+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.803+0000 7f0a4eb0c800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.803+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.803+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.803+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.804+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.804+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.805+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:20.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.805+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.806+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.806+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.806+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.806+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:20.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 20 zone MyZone found 2024-05-15T14:44:20.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:20.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:20.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:20.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:44:20.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.807+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.808+0000 7f0a4eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.808+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.808+0000 7f0a4eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.808+0000 7f0a4eb0c800 20 started sync module instance, tier type = 2024-05-15T14:44:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.808+0000 7f0a4eb0c800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.819+0000 7f0a4eb0c800 20 add_watcher() i=0 2024-05-15T14:44:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.819+0000 7f0a4eb0c800 20 add_watcher() i=1 2024-05-15T14:44:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.819+0000 7f0a4eb0c800 20 add_watcher() i=2 2024-05-15T14:44:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.819+0000 7f0a4eb0c800 20 add_watcher() i=3 2024-05-15T14:44:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.819+0000 7f0a4eb0c800 20 add_watcher() i=4 2024-05-15T14:44:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.819+0000 7f0a4eb0c800 20 add_watcher() i=5 2024-05-15T14:44:20.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.819+0000 7f0a4eb0c800 20 add_watcher() i=6 2024-05-15T14:44:20.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.820+0000 7f0a4eb0c800 20 add_watcher() i=7 2024-05-15T14:44:20.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.820+0000 7f0a4eb0c800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:20.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.822+0000 7f09027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:20.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.822+0000 7f0a4eb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:20.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.822+0000 7f0a4eb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.822+0000 7f0a4eb0c800 5 note: GC not initialized 2024-05-15T14:44:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.822+0000 7f09017e2640 20 reqs_thread_entry: start 2024-05-15T14:44:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.823+0000 7f0a4eb0c800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.823+0000 7f0a4eb0c800 20 Filter name: none 2024-05-15T14:44:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.823+0000 7f0872ffd640 20 reqs_thread_entry: start 2024-05-15T14:44:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.823+0000 7f0a4eb0c800 20 rados->read ofs=0 len=0 2024-05-15T14:44:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.824+0000 7f0a4eb0c800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:44:20.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.826+0000 7f09027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:20.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.828+0000 7f0a4eb0c800 20 remove_watcher() i=0 2024-05-15T14:44:20.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.828+0000 7f0a4eb0c800 2 removed watcher, disabling cache 2024-05-15T14:44:20.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.829+0000 7f0a4eb0c800 20 remove_watcher() i=1 2024-05-15T14:44:20.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.830+0000 7f0a4eb0c800 20 remove_watcher() i=2 2024-05-15T14:44:20.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.831+0000 7f0a4eb0c800 20 remove_watcher() i=3 2024-05-15T14:44:20.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.832+0000 7f0a4eb0c800 20 remove_watcher() i=4 2024-05-15T14:44:20.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.833+0000 7f0a4eb0c800 20 remove_watcher() i=5 2024-05-15T14:44:20.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.834+0000 7f0a4eb0c800 20 remove_watcher() i=6 2024-05-15T14:44:20.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:20.836+0000 7f0a4eb0c800 20 remove_watcher() i=7 2024-05-15T14:44:21.353 INFO:teuthology.orchestra.run.smithi018.stderr:FAIL 2024-05-15T14:44:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:test data path v2 migration ... 127.0.0.1 - - [15/May/2024 14:44:21] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:21.403 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:21.403 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:21.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.435+0000 7fa3b8062800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:21.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.435+0000 7fa3b8062800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.440+0000 7fa1ebfff640 20 reqs_thread_entry: start 2024-05-15T14:44:21.500 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:21.500 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:21.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.534+0000 7f62284bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:21.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.534+0000 7f62284bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:21.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.539+0000 7f605bfff640 20 reqs_thread_entry: start 2024-05-15T14:44:21.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.543+0000 7f62284bb800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:44:21.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.556+0000 7f62284bb800 20 updating latest_epoch from 2 -> 3 on period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:44:21.614 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:21.614 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.659+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.660+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.660+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.661+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.661+0000 7fe883862800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.661+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.662+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:21.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.662+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.663+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:21.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.663+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.663+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.663+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.664+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.664+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.664+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.664+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 20 zone MyZone found 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:3 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.665+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.666+0000 7fe883862800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.666+0000 7fe883862800 20 rados->read ofs=0 len=0 2024-05-15T14:44:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.666+0000 7fe883862800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.666+0000 7fe883862800 20 started sync module instance, tier type = 2024-05-15T14:44:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.666+0000 7fe883862800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.677+0000 7fe883862800 20 add_watcher() i=0 2024-05-15T14:44:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.677+0000 7fe883862800 20 add_watcher() i=1 2024-05-15T14:44:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.677+0000 7fe883862800 20 add_watcher() i=2 2024-05-15T14:44:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.677+0000 7fe883862800 20 add_watcher() i=3 2024-05-15T14:44:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.677+0000 7fe883862800 20 add_watcher() i=4 2024-05-15T14:44:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.677+0000 7fe883862800 20 add_watcher() i=5 2024-05-15T14:44:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.677+0000 7fe883862800 20 add_watcher() i=6 2024-05-15T14:44:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.678+0000 7fe883862800 20 add_watcher() i=7 2024-05-15T14:44:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.678+0000 7fe883862800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.679+0000 7fe7377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.680+0000 7fe883862800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.680+0000 7fe883862800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.680+0000 7fe883862800 5 note: GC not initialized 2024-05-15T14:44:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.680+0000 7fe7367e4640 20 reqs_thread_entry: start 2024-05-15T14:44:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.680+0000 7fe883862800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.680+0000 7fe883862800 20 Filter name: none 2024-05-15T14:44:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.680+0000 7fe6a7fff640 20 reqs_thread_entry: start 2024-05-15T14:44:21.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.683+0000 7fe883862800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:44:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.684+0000 7fe883862800 20 updating latest_epoch from 3 -> 4 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:44:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.690+0000 7fe883862800 4 Committed new epoch 4 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:44:21.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.692+0000 7fe7377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.694+0000 7fe883862800 20 remove_watcher() i=0 2024-05-15T14:44:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.694+0000 7fe883862800 2 removed watcher, disabling cache 2024-05-15T14:44:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.695+0000 7fe883862800 20 remove_watcher() i=1 2024-05-15T14:44:21.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.696+0000 7fe883862800 20 remove_watcher() i=2 2024-05-15T14:44:21.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.697+0000 7fe883862800 20 remove_watcher() i=3 2024-05-15T14:44:21.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.698+0000 7fe883862800 20 remove_watcher() i=4 2024-05-15T14:44:21.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.699+0000 7fe883862800 20 remove_watcher() i=5 2024-05-15T14:44:21.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.700+0000 7fe883862800 20 remove_watcher() i=6 2024-05-15T14:44:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:21.701+0000 7fe883862800 20 remove_watcher() i=7 2024-05-15T14:44:47.066 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:44:47.065+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:44:47.067 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:44:47.065+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:44:47.067 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:44:47.065+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:44:47.067 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:44:47.065+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:44:47.466 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:44:47.465+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:44:47.466 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:44:47.465+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:44:47.466 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:44:47.465+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:44:47.466 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:44:47.465+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:44:47.704 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.729 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.743 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.768 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.771 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.782 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.782 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.785 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:44:47] "POST / HTTP/1.1" 200 - 2024-05-15T14:44:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:47.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:47.873+0000 7fe47092e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:47.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:47.873+0000 7fe47092e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:47.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:47.877+0000 7fe2b27fc640 20 reqs_thread_entry: start 2024-05-15T14:44:47.935 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:47.935 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:47.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:47.966+0000 7f254c413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:47.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:47.966+0000 7f254c413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:47.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:47.969+0000 7f238dffb640 20 reqs_thread_entry: start 2024-05-15T14:44:47.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:47.972+0000 7f254c413800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:44:47.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:47.986+0000 7f254c413800 20 updating latest_epoch from 3 -> 4 on period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:44:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:48.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.080+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.082+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.082+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.082+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.083+0000 7fa1eda16800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.083+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.083+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.083+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.083+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:48.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.083+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.084+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=1107 2024-05-15T14:44:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.084+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.084+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.084+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.084+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:48.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.084+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.085+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:48.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.085+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 20 zone MyZone found 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:4 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.086+0000 7fa1eda16800 20 rados->read ofs=0 len=0 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.087+0000 7fa1eda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.087+0000 7fa1eda16800 20 started sync module instance, tier type = 2024-05-15T14:44:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.087+0000 7fa1eda16800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.097+0000 7fa1eda16800 20 add_watcher() i=0 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.097+0000 7fa1eda16800 20 add_watcher() i=1 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.097+0000 7fa1eda16800 20 add_watcher() i=2 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.097+0000 7fa1eda16800 20 add_watcher() i=3 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.097+0000 7fa1eda16800 20 add_watcher() i=4 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.097+0000 7fa1eda16800 20 add_watcher() i=5 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.097+0000 7fa1eda16800 20 add_watcher() i=6 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.098+0000 7fa1eda16800 20 add_watcher() i=7 2024-05-15T14:44:48.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.098+0000 7fa1eda16800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:48.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.099+0000 7fa09f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:48.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.100+0000 7fa1eda16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:48.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.100+0000 7fa1eda16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:48.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.100+0000 7fa1eda16800 5 note: GC not initialized 2024-05-15T14:44:48.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.100+0000 7fa09e7e4640 20 reqs_thread_entry: start 2024-05-15T14:44:48.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.100+0000 7fa1eda16800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:48.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.100+0000 7fa1eda16800 20 Filter name: none 2024-05-15T14:44:48.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.100+0000 7fa00ffff640 20 reqs_thread_entry: start 2024-05-15T14:44:48.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.102+0000 7fa1eda16800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:44:48.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.104+0000 7fa1eda16800 20 updating latest_epoch from 4 -> 5 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:44:48.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.110+0000 7fa1eda16800 4 Committed new epoch 5 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:44:48.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.112+0000 7fa09f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:48.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.114+0000 7fa1eda16800 20 remove_watcher() i=0 2024-05-15T14:44:48.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.114+0000 7fa1eda16800 2 removed watcher, disabling cache 2024-05-15T14:44:48.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.115+0000 7fa1eda16800 20 remove_watcher() i=1 2024-05-15T14:44:48.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.116+0000 7fa1eda16800 20 remove_watcher() i=2 2024-05-15T14:44:48.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.117+0000 7fa1eda16800 20 remove_watcher() i=3 2024-05-15T14:44:48.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.118+0000 7fa1eda16800 20 remove_watcher() i=4 2024-05-15T14:44:48.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.119+0000 7fa1eda16800 20 remove_watcher() i=5 2024-05-15T14:44:48.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.120+0000 7fa1eda16800 20 remove_watcher() i=6 2024-05-15T14:44:48.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:48.121+0000 7fa1eda16800 20 remove_watcher() i=7 2024-05-15T14:44:49.186 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:49.186 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:49.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.230+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.232+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:49.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.232+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.233+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:49.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.233+0000 7feb1dc62800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:49.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.233+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.233+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:49.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.233+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.234+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:49.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.234+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.234+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:49.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.234+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.235+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:49.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.235+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.235+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:49.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.235+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.236+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:49.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.236+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 20 zone MyZone found 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.237+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.238+0000 7feb1dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.238+0000 7feb1dc62800 20 rados->read ofs=0 len=0 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.238+0000 7feb1dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.238+0000 7feb1dc62800 20 started sync module instance, tier type = 2024-05-15T14:44:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.238+0000 7feb1dc62800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:49.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.249+0000 7feb1dc62800 20 add_watcher() i=0 2024-05-15T14:44:49.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.249+0000 7feb1dc62800 20 add_watcher() i=1 2024-05-15T14:44:49.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.249+0000 7feb1dc62800 20 add_watcher() i=2 2024-05-15T14:44:49.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.249+0000 7feb1dc62800 20 add_watcher() i=3 2024-05-15T14:44:49.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.249+0000 7feb1dc62800 20 add_watcher() i=4 2024-05-15T14:44:49.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.249+0000 7feb1dc62800 20 add_watcher() i=5 2024-05-15T14:44:49.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.249+0000 7feb1dc62800 20 add_watcher() i=6 2024-05-15T14:44:49.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.250+0000 7feb1dc62800 20 add_watcher() i=7 2024-05-15T14:44:49.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.250+0000 7feb1dc62800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:49.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.252+0000 7fe9d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:49.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.252+0000 7feb1dc62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:49.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.252+0000 7feb1dc62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:49.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.252+0000 7feb1dc62800 5 note: GC not initialized 2024-05-15T14:44:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.252+0000 7fe9d0fe1640 20 reqs_thread_entry: start 2024-05-15T14:44:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.253+0000 7feb1dc62800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.253+0000 7feb1dc62800 20 Filter name: none 2024-05-15T14:44:49.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.253+0000 7fe94a7fc640 20 reqs_thread_entry: start 2024-05-15T14:44:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.253+0000 7feb1dc62800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.253+0000 7feb1dc62800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:44:49.253+0000 7feb1dc62800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:44:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.253+0000 7feb1dc62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.253+0000 7feb1dc62800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:49.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.254+0000 7fe9d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.256+0000 7feb1dc62800 20 remove_watcher() i=0 2024-05-15T14:44:49.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.256+0000 7feb1dc62800 2 removed watcher, disabling cache 2024-05-15T14:44:49.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.258+0000 7feb1dc62800 20 remove_watcher() i=1 2024-05-15T14:44:49.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.259+0000 7feb1dc62800 20 remove_watcher() i=2 2024-05-15T14:44:49.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.260+0000 7feb1dc62800 20 remove_watcher() i=3 2024-05-15T14:44:49.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.261+0000 7feb1dc62800 20 remove_watcher() i=4 2024-05-15T14:44:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.262+0000 7feb1dc62800 20 remove_watcher() i=5 2024-05-15T14:44:49.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.263+0000 7feb1dc62800 20 remove_watcher() i=6 2024-05-15T14:44:49.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:49.264+0000 7feb1dc62800 20 remove_watcher() i=7 2024-05-15T14:44:50.330 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:50.331 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:50.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.374+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.376+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:50.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.376+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.377+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:50.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.377+0000 7f49e703f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:50.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.377+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.377+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:50.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.377+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.378+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:50.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.378+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.378+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:50.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.378+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.379+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:50.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.379+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.379+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:50.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.379+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.380+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:50.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.380+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:50.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 zone MyZone found 2024-05-15T14:44:50.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:50.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:50.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 started sync module instance, tier type = 2024-05-15T14:44:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.381+0000 7f49e703f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:50.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.392+0000 7f49e703f800 20 add_watcher() i=0 2024-05-15T14:44:50.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.392+0000 7f49e703f800 20 add_watcher() i=1 2024-05-15T14:44:50.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.392+0000 7f49e703f800 20 add_watcher() i=2 2024-05-15T14:44:50.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.392+0000 7f49e703f800 20 add_watcher() i=3 2024-05-15T14:44:50.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.392+0000 7f49e703f800 20 add_watcher() i=4 2024-05-15T14:44:50.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.392+0000 7f49e703f800 20 add_watcher() i=5 2024-05-15T14:44:50.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.392+0000 7f49e703f800 20 add_watcher() i=6 2024-05-15T14:44:50.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.393+0000 7f49e703f800 20 add_watcher() i=7 2024-05-15T14:44:50.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.393+0000 7f49e703f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.395+0000 7f489b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:50.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.396+0000 7f49e703f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:50.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.396+0000 7f49e703f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:50.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.396+0000 7f49e703f800 5 note: GC not initialized 2024-05-15T14:44:50.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.396+0000 7f489a7e4640 20 reqs_thread_entry: start 2024-05-15T14:44:50.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.396+0000 7f49e703f800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:50.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.396+0000 7f49e703f800 20 Filter name: none 2024-05-15T14:44:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.396+0000 7f4893fff640 20 reqs_thread_entry: start 2024-05-15T14:44:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.396+0000 7f49e703f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.397+0000 7f49e703f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:44:50.397+0000 7f49e703f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:44:50.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.397+0000 7f49e703f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:50.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.397+0000 7f49e703f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:50.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.398+0000 7f489b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:50.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.400+0000 7f49e703f800 20 remove_watcher() i=0 2024-05-15T14:44:50.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.400+0000 7f49e703f800 2 removed watcher, disabling cache 2024-05-15T14:44:50.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.401+0000 7f49e703f800 20 remove_watcher() i=1 2024-05-15T14:44:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.402+0000 7f49e703f800 20 remove_watcher() i=2 2024-05-15T14:44:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.404+0000 7f49e703f800 20 remove_watcher() i=3 2024-05-15T14:44:50.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.405+0000 7f49e703f800 20 remove_watcher() i=4 2024-05-15T14:44:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.406+0000 7f49e703f800 20 remove_watcher() i=5 2024-05-15T14:44:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.407+0000 7f49e703f800 20 remove_watcher() i=6 2024-05-15T14:44:50.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:50.408+0000 7f49e703f800 20 remove_watcher() i=7 2024-05-15T14:44:51.474 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:51.474 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.518+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.519+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:51.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.519+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.520+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.520+0000 7febb0b19800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.520+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.521+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.521+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.521+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.521+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.522+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.522+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.522+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.522+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.522+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.522+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.523+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.523+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.524+0000 7febb0b19800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:51.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.524+0000 7febb0b19800 20 zone MyZone found 2024-05-15T14:44:51.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.524+0000 7febb0b19800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:51.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.524+0000 7febb0b19800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:51.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.524+0000 7febb0b19800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:51.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.524+0000 7febb0b19800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.524+0000 7febb0b19800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.524+0000 7febb0b19800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.525+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.525+0000 7febb0b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.525+0000 7febb0b19800 20 rados->read ofs=0 len=0 2024-05-15T14:44:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.525+0000 7febb0b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.525+0000 7febb0b19800 20 started sync module instance, tier type = 2024-05-15T14:44:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.525+0000 7febb0b19800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.536+0000 7febb0b19800 20 add_watcher() i=0 2024-05-15T14:44:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.536+0000 7febb0b19800 20 add_watcher() i=1 2024-05-15T14:44:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.536+0000 7febb0b19800 20 add_watcher() i=2 2024-05-15T14:44:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.536+0000 7febb0b19800 20 add_watcher() i=3 2024-05-15T14:44:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.536+0000 7febb0b19800 20 add_watcher() i=4 2024-05-15T14:44:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.536+0000 7febb0b19800 20 add_watcher() i=5 2024-05-15T14:44:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.536+0000 7febb0b19800 20 add_watcher() i=6 2024-05-15T14:44:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.537+0000 7febb0b19800 20 add_watcher() i=7 2024-05-15T14:44:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.537+0000 7febb0b19800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.539+0000 7fea64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.539+0000 7febb0b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.539+0000 7febb0b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.539+0000 7febb0b19800 5 note: GC not initialized 2024-05-15T14:44:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.540+0000 7fe9df7fe640 20 reqs_thread_entry: start 2024-05-15T14:44:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.540+0000 7febb0b19800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.540+0000 7febb0b19800 20 Filter name: none 2024-05-15T14:44:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.540+0000 7fe9dd7fa640 20 reqs_thread_entry: start 2024-05-15T14:44:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.540+0000 7febb0b19800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.541+0000 7febb0b19800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:44:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.541+0000 7febb0b19800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.541+0000 7febb0b19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.541+0000 7febb0b19800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:51.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.541+0000 7fea64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:51.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.544+0000 7febb0b19800 20 remove_watcher() i=0 2024-05-15T14:44:51.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.544+0000 7febb0b19800 2 removed watcher, disabling cache 2024-05-15T14:44:51.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.545+0000 7febb0b19800 20 remove_watcher() i=1 2024-05-15T14:44:51.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.546+0000 7febb0b19800 20 remove_watcher() i=2 2024-05-15T14:44:51.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.547+0000 7febb0b19800 20 remove_watcher() i=3 2024-05-15T14:44:51.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.548+0000 7febb0b19800 20 remove_watcher() i=4 2024-05-15T14:44:51.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.549+0000 7febb0b19800 20 remove_watcher() i=5 2024-05-15T14:44:51.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.550+0000 7febb0b19800 20 remove_watcher() i=6 2024-05-15T14:44:51.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:51.551+0000 7febb0b19800 20 remove_watcher() i=7 2024-05-15T14:44:52.618 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:52.618 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.662+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.663+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.663+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.664+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.664+0000 7f3f31d29800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.664+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.665+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.665+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.665+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:52.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.665+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.666+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:52.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.666+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.666+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.666+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.666+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.666+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.667+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.667+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:52.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 20 zone MyZone found 2024-05-15T14:44:52.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:52.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:52.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:52.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:52.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:52.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:52.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:52.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.668+0000 7f3f31d29800 20 rados->read ofs=0 len=0 2024-05-15T14:44:52.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.669+0000 7f3f31d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:52.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.669+0000 7f3f31d29800 20 started sync module instance, tier type = 2024-05-15T14:44:52.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.669+0000 7f3f31d29800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.680+0000 7f3f31d29800 20 add_watcher() i=0 2024-05-15T14:44:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.680+0000 7f3f31d29800 20 add_watcher() i=1 2024-05-15T14:44:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.680+0000 7f3f31d29800 20 add_watcher() i=2 2024-05-15T14:44:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.680+0000 7f3f31d29800 20 add_watcher() i=3 2024-05-15T14:44:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.680+0000 7f3f31d29800 20 add_watcher() i=4 2024-05-15T14:44:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.680+0000 7f3f31d29800 20 add_watcher() i=5 2024-05-15T14:44:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.680+0000 7f3f31d29800 20 add_watcher() i=6 2024-05-15T14:44:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.681+0000 7f3f31d29800 20 add_watcher() i=7 2024-05-15T14:44:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.681+0000 7f3f31d29800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.682+0000 7f3ddffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:52.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.683+0000 7f3f31d29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:52.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.683+0000 7f3f31d29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:52.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.683+0000 7f3f31d29800 5 note: GC not initialized 2024-05-15T14:44:52.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.683+0000 7f3ddeffd640 20 reqs_thread_entry: start 2024-05-15T14:44:52.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.683+0000 7f3f31d29800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:52.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.683+0000 7f3f31d29800 20 Filter name: none 2024-05-15T14:44:52.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.683+0000 7f3ddcff9640 20 reqs_thread_entry: start 2024-05-15T14:44:52.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.683+0000 7f3f31d29800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:52.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.684+0000 7f3f31d29800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:52.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.684+0000 7f3f31d29800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:52.685 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:44:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.684+0000 7f3f31d29800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.684+0000 7f3f31d29800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.685+0000 7f3ddffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:52.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.688+0000 7f3f31d29800 20 remove_watcher() i=0 2024-05-15T14:44:52.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.688+0000 7f3f31d29800 2 removed watcher, disabling cache 2024-05-15T14:44:52.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.689+0000 7f3f31d29800 20 remove_watcher() i=1 2024-05-15T14:44:52.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.690+0000 7f3f31d29800 20 remove_watcher() i=2 2024-05-15T14:44:52.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.691+0000 7f3f31d29800 20 remove_watcher() i=3 2024-05-15T14:44:52.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.692+0000 7f3f31d29800 20 remove_watcher() i=4 2024-05-15T14:44:52.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.693+0000 7f3f31d29800 20 remove_watcher() i=5 2024-05-15T14:44:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.694+0000 7f3f31d29800 20 remove_watcher() i=6 2024-05-15T14:44:52.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:52.695+0000 7f3f31d29800 20 remove_watcher() i=7 2024-05-15T14:44:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:53.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.805+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.807+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:53.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.807+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.808+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.808+0000 7f877bf2e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.808+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.808+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.808+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.809+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.809+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.809+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.809+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.809+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.809+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.810+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.810+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.811+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.811+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 zone MyZone found 2024-05-15T14:44:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 rados->read ofs=0 len=0 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 started sync module instance, tier type = 2024-05-15T14:44:53.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.812+0000 7f877bf2e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.824+0000 7f877bf2e800 20 add_watcher() i=0 2024-05-15T14:44:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.824+0000 7f877bf2e800 20 add_watcher() i=1 2024-05-15T14:44:53.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.824+0000 7f877bf2e800 20 add_watcher() i=2 2024-05-15T14:44:53.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.824+0000 7f877bf2e800 20 add_watcher() i=3 2024-05-15T14:44:53.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.824+0000 7f877bf2e800 20 add_watcher() i=4 2024-05-15T14:44:53.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.824+0000 7f877bf2e800 20 add_watcher() i=5 2024-05-15T14:44:53.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.824+0000 7f877bf2e800 20 add_watcher() i=6 2024-05-15T14:44:53.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.825+0000 7f877bf2e800 20 add_watcher() i=7 2024-05-15T14:44:53.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.825+0000 7f877bf2e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:53.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.826+0000 7f862dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:53.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.827+0000 7f877bf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:53.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.827+0000 7f877bf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:53.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.827+0000 7f877bf2e800 5 note: GC not initialized 2024-05-15T14:44:53.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.827+0000 7f862cfe1640 20 reqs_thread_entry: start 2024-05-15T14:44:53.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.827+0000 7f877bf2e800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:53.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.827+0000 7f877bf2e800 20 Filter name: none 2024-05-15T14:44:53.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.828+0000 7f85a67fc640 20 reqs_thread_entry: start 2024-05-15T14:44:53.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.828+0000 7f877bf2e800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:53.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.828+0000 7f877bf2e800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:53.829 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:44:53.828+0000 7f877bf2e800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:53.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.828+0000 7f877bf2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:53.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.828+0000 7f877bf2e800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:53.830 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:44:53.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.829+0000 7f862dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.831+0000 7f877bf2e800 20 remove_watcher() i=0 2024-05-15T14:44:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.831+0000 7f877bf2e800 2 removed watcher, disabling cache 2024-05-15T14:44:53.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.832+0000 7f877bf2e800 20 remove_watcher() i=1 2024-05-15T14:44:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.834+0000 7f877bf2e800 20 remove_watcher() i=2 2024-05-15T14:44:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.835+0000 7f877bf2e800 20 remove_watcher() i=3 2024-05-15T14:44:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.836+0000 7f877bf2e800 20 remove_watcher() i=4 2024-05-15T14:44:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.837+0000 7f877bf2e800 20 remove_watcher() i=5 2024-05-15T14:44:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.838+0000 7f877bf2e800 20 remove_watcher() i=6 2024-05-15T14:44:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:53.839+0000 7f877bf2e800 20 remove_watcher() i=7 2024-05-15T14:44:54.906 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:54.906 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:54.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.950+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.951+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:54.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.951+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.952+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.952+0000 7f67be333800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.952+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.953+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:54.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.953+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.953+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.953+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.954+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.954+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.954+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.954+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.954+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:54.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.954+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.955+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:54.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.955+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:54.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 20 zone MyZone found 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.956+0000 7f67be333800 20 rados->read ofs=0 len=0 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.957+0000 7f67be333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.957+0000 7f67be333800 20 started sync module instance, tier type = 2024-05-15T14:44:54.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.957+0000 7f67be333800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.968+0000 7f67be333800 20 add_watcher() i=0 2024-05-15T14:44:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.968+0000 7f67be333800 20 add_watcher() i=1 2024-05-15T14:44:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.968+0000 7f67be333800 20 add_watcher() i=2 2024-05-15T14:44:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.968+0000 7f67be333800 20 add_watcher() i=3 2024-05-15T14:44:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.968+0000 7f67be333800 20 add_watcher() i=4 2024-05-15T14:44:54.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.968+0000 7f67be333800 20 add_watcher() i=5 2024-05-15T14:44:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.968+0000 7f67be333800 20 add_watcher() i=6 2024-05-15T14:44:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.969+0000 7f67be333800 20 add_watcher() i=7 2024-05-15T14:44:54.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.969+0000 7f67be333800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:54.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.971+0000 7f6670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:54.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.972+0000 7f67be333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:54.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.972+0000 7f67be333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:54.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.972+0000 7f67be333800 5 note: GC not initialized 2024-05-15T14:44:54.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.972+0000 7f65eb7fe640 20 reqs_thread_entry: start 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.972+0000 7f67be333800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.972+0000 7f67be333800 20 Filter name: none 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.972+0000 7f65e97fa640 20 reqs_thread_entry: start 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.972+0000 7f67be333800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.973+0000 7f67be333800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.973+0000 7f67be333800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.973+0000 7f67be333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:54.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.973+0000 7f67be333800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:54.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.974+0000 7f6670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.976+0000 7f67be333800 20 remove_watcher() i=0 2024-05-15T14:44:54.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.976+0000 7f67be333800 2 removed watcher, disabling cache 2024-05-15T14:44:54.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.977+0000 7f67be333800 20 remove_watcher() i=1 2024-05-15T14:44:54.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.978+0000 7f67be333800 20 remove_watcher() i=2 2024-05-15T14:44:54.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.979+0000 7f67be333800 20 remove_watcher() i=3 2024-05-15T14:44:54.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.981+0000 7f67be333800 20 remove_watcher() i=4 2024-05-15T14:44:54.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.981+0000 7f67be333800 20 remove_watcher() i=5 2024-05-15T14:44:54.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.982+0000 7f67be333800 20 remove_watcher() i=6 2024-05-15T14:44:54.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:54.983+0000 7f67be333800 20 remove_watcher() i=7 2024-05-15T14:44:56.049 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:56.049 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.092+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.094+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:56.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.094+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.095+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:56.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.095+0000 7f6959a3a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:56.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.095+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.095+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:56.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.095+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.096+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:56.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.096+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.097+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:56.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.097+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.097+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:56.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.097+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.098+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:56.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.098+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.098+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:56.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.098+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 20 zone MyZone found 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.099+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.100+0000 7f6959a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.100+0000 7f6959a3a800 20 rados->read ofs=0 len=0 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.100+0000 7f6959a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.100+0000 7f6959a3a800 20 started sync module instance, tier type = 2024-05-15T14:44:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.100+0000 7f6959a3a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.111+0000 7f6959a3a800 20 add_watcher() i=0 2024-05-15T14:44:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.111+0000 7f6959a3a800 20 add_watcher() i=1 2024-05-15T14:44:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.111+0000 7f6959a3a800 20 add_watcher() i=2 2024-05-15T14:44:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.111+0000 7f6959a3a800 20 add_watcher() i=3 2024-05-15T14:44:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.111+0000 7f6959a3a800 20 add_watcher() i=4 2024-05-15T14:44:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.111+0000 7f6959a3a800 20 add_watcher() i=5 2024-05-15T14:44:56.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.111+0000 7f6959a3a800 20 add_watcher() i=6 2024-05-15T14:44:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.112+0000 7f6959a3a800 20 add_watcher() i=7 2024-05-15T14:44:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.112+0000 7f6959a3a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:56.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.114+0000 7f680afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:56.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.114+0000 7f6959a3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:56.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.114+0000 7f6959a3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:56.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.114+0000 7f6959a3a800 5 note: GC not initialized 2024-05-15T14:44:56.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.114+0000 7f6809fdb640 20 reqs_thread_entry: start 2024-05-15T14:44:56.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.114+0000 7f6959a3a800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:56.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.114+0000 7f6959a3a800 20 Filter name: none 2024-05-15T14:44:56.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.115+0000 7f677b7fe640 20 reqs_thread_entry: start 2024-05-15T14:44:56.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.115+0000 7f6959a3a800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:56.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.115+0000 7f6959a3a800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:56.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.115+0000 7f6959a3a800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:56.116 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:44:56.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.115+0000 7f6959a3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:56.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.115+0000 7f6959a3a800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:56.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.116+0000 7f680afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.118+0000 7f6959a3a800 20 remove_watcher() i=0 2024-05-15T14:44:56.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.118+0000 7f6959a3a800 2 removed watcher, disabling cache 2024-05-15T14:44:56.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.120+0000 7f6959a3a800 20 remove_watcher() i=1 2024-05-15T14:44:56.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.121+0000 7f6959a3a800 20 remove_watcher() i=2 2024-05-15T14:44:56.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.122+0000 7f6959a3a800 20 remove_watcher() i=3 2024-05-15T14:44:56.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.123+0000 7f6959a3a800 20 remove_watcher() i=4 2024-05-15T14:44:56.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.124+0000 7f6959a3a800 20 remove_watcher() i=5 2024-05-15T14:44:56.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.125+0000 7f6959a3a800 20 remove_watcher() i=6 2024-05-15T14:44:56.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:56.126+0000 7f6959a3a800 20 remove_watcher() i=7 2024-05-15T14:44:57.192 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:57.192 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:57.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.236+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.238+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:57.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.238+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.239+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.239+0000 7fd47563f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.239+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.239+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:57.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.239+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.240+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:57.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.240+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.240+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:57.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.240+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.240+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:57.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.240+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.241+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:57.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.241+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.241+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:57.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.241+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 20 zone MyZone found 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.242+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.243+0000 7fd47563f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.243+0000 7fd47563f800 20 rados->read ofs=0 len=0 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.243+0000 7fd47563f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:57.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.243+0000 7fd47563f800 20 started sync module instance, tier type = 2024-05-15T14:44:57.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.243+0000 7fd47563f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.254+0000 7fd47563f800 20 add_watcher() i=0 2024-05-15T14:44:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.254+0000 7fd47563f800 20 add_watcher() i=1 2024-05-15T14:44:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.254+0000 7fd47563f800 20 add_watcher() i=2 2024-05-15T14:44:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.254+0000 7fd47563f800 20 add_watcher() i=3 2024-05-15T14:44:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.254+0000 7fd47563f800 20 add_watcher() i=4 2024-05-15T14:44:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.254+0000 7fd47563f800 20 add_watcher() i=5 2024-05-15T14:44:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.254+0000 7fd47563f800 20 add_watcher() i=6 2024-05-15T14:44:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.255+0000 7fd47563f800 20 add_watcher() i=7 2024-05-15T14:44:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.255+0000 7fd47563f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.257+0000 7fd329fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.257+0000 7fd47563f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.257+0000 7fd47563f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.257+0000 7fd47563f800 5 note: GC not initialized 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.258+0000 7fd328fe1640 20 reqs_thread_entry: start 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.258+0000 7fd47563f800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.258+0000 7fd47563f800 20 Filter name: none 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.258+0000 7fd2a27fc640 20 reqs_thread_entry: start 2024-05-15T14:44:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.258+0000 7fd47563f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:44:57.258+0000 7fd47563f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:44:57.258+0000 7fd47563f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.258+0000 7fd47563f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:57.260 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:44:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.258+0000 7fd47563f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.259+0000 7fd329fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:57.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.262+0000 7fd47563f800 20 remove_watcher() i=0 2024-05-15T14:44:57.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.262+0000 7fd47563f800 2 removed watcher, disabling cache 2024-05-15T14:44:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.263+0000 7fd47563f800 20 remove_watcher() i=1 2024-05-15T14:44:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.264+0000 7fd47563f800 20 remove_watcher() i=2 2024-05-15T14:44:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.265+0000 7fd47563f800 20 remove_watcher() i=3 2024-05-15T14:44:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.266+0000 7fd47563f800 20 remove_watcher() i=4 2024-05-15T14:44:57.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.267+0000 7fd47563f800 20 remove_watcher() i=5 2024-05-15T14:44:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.268+0000 7fd47563f800 20 remove_watcher() i=6 2024-05-15T14:44:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:57.269+0000 7fd47563f800 20 remove_watcher() i=7 2024-05-15T14:44:58.335 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:58.335 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:58.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.377+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.379+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:58.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.379+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.380+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:58.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.380+0000 7f1b88bdc800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:58.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.380+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.380+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:58.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.380+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.381+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:58.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.381+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.381+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:58.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.382+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.382+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:58.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.382+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.382+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:58.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.382+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.383+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:58.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.383+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:58.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 20 zone MyZone found 2024-05-15T14:44:58.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:58.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.384+0000 7f1b88bdc800 20 rados->read ofs=0 len=0 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.385+0000 7f1b88bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.385+0000 7f1b88bdc800 20 started sync module instance, tier type = 2024-05-15T14:44:58.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.385+0000 7f1b88bdc800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.396+0000 7f1b88bdc800 20 add_watcher() i=0 2024-05-15T14:44:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.396+0000 7f1b88bdc800 20 add_watcher() i=1 2024-05-15T14:44:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.396+0000 7f1b88bdc800 20 add_watcher() i=2 2024-05-15T14:44:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.396+0000 7f1b88bdc800 20 add_watcher() i=3 2024-05-15T14:44:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.396+0000 7f1b88bdc800 20 add_watcher() i=4 2024-05-15T14:44:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.396+0000 7f1b88bdc800 20 add_watcher() i=5 2024-05-15T14:44:58.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.396+0000 7f1b88bdc800 20 add_watcher() i=6 2024-05-15T14:44:58.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.397+0000 7f1b88bdc800 20 add_watcher() i=7 2024-05-15T14:44:58.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.397+0000 7f1b88bdc800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:58.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.399+0000 7f1a3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:58.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.399+0000 7f1b88bdc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.399+0000 7f1b88bdc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.399+0000 7f1b88bdc800 5 note: GC not initialized 2024-05-15T14:44:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.399+0000 7f19b77fe640 20 reqs_thread_entry: start 2024-05-15T14:44:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.399+0000 7f1b88bdc800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.400+0000 7f1b88bdc800 20 Filter name: none 2024-05-15T14:44:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.400+0000 7f19b57fa640 20 reqs_thread_entry: start 2024-05-15T14:44:58.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.400+0000 7f1b88bdc800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:58.403 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:44:58.400+0000 7f1b88bdc800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:58.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.400+0000 7f1b88bdc800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:58.403 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:44:58.400+0000 7f1b88bdc800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:58.403 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:44:58.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.400+0000 7f1b88bdc800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:58.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.401+0000 7f1a3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:58.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.404+0000 7f1b88bdc800 20 remove_watcher() i=0 2024-05-15T14:44:58.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.404+0000 7f1b88bdc800 2 removed watcher, disabling cache 2024-05-15T14:44:58.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.405+0000 7f1b88bdc800 20 remove_watcher() i=1 2024-05-15T14:44:58.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.406+0000 7f1b88bdc800 20 remove_watcher() i=2 2024-05-15T14:44:58.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.407+0000 7f1b88bdc800 20 remove_watcher() i=3 2024-05-15T14:44:58.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.408+0000 7f1b88bdc800 20 remove_watcher() i=4 2024-05-15T14:44:58.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.409+0000 7f1b88bdc800 20 remove_watcher() i=5 2024-05-15T14:44:58.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.410+0000 7f1b88bdc800 20 remove_watcher() i=6 2024-05-15T14:44:58.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:58.411+0000 7f1b88bdc800 20 remove_watcher() i=7 2024-05-15T14:44:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:44:59.478 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:44:59.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.520+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.522+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:59.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.522+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.522+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:59.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.523+0000 7f54ddc08800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:44:59.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.523+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.523+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:59.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.523+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.524+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:44:59.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.524+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.524+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:44:59.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.524+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.524+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:59.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.524+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.525+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:44:59.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.525+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.525+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:44:59.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.525+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 20 zone MyZone found 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 20 period zonegroup name MyZoneGroup 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.526+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.527+0000 7f54ddc08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.527+0000 7f54ddc08800 20 rados->read ofs=0 len=0 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.527+0000 7f54ddc08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:44:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.527+0000 7f54ddc08800 20 started sync module instance, tier type = 2024-05-15T14:44:59.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.527+0000 7f54ddc08800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:44:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 20 add_watcher() i=0 2024-05-15T14:44:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 20 add_watcher() i=1 2024-05-15T14:44:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 20 add_watcher() i=2 2024-05-15T14:44:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 20 add_watcher() i=3 2024-05-15T14:44:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 20 add_watcher() i=4 2024-05-15T14:44:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 20 add_watcher() i=5 2024-05-15T14:44:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 20 add_watcher() i=6 2024-05-15T14:44:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 20 add_watcher() i=7 2024-05-15T14:44:59.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.539+0000 7f54ddc08800 2 all 8 watchers are set, enabling cache 2024-05-15T14:44:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.541+0000 7f5391fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.542+0000 7f54ddc08800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:44:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.542+0000 7f54ddc08800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:44:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.542+0000 7f54ddc08800 5 note: GC not initialized 2024-05-15T14:44:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.542+0000 7f5390fe1640 20 reqs_thread_entry: start 2024-05-15T14:44:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.542+0000 7f54ddc08800 20 init_complete bucket index max shards: 11 2024-05-15T14:44:59.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.542+0000 7f54ddc08800 20 Filter name: none 2024-05-15T14:44:59.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.542+0000 7f530a7fc640 20 reqs_thread_entry: start 2024-05-15T14:44:59.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.542+0000 7f54ddc08800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:44:59.545 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:44:59.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.543+0000 7f54ddc08800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:44:59.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.543+0000 7f54ddc08800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:44:59.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.543+0000 7f54ddc08800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:44:59.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.543+0000 7f54ddc08800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:44:59.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.544+0000 7f5391fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:44:59.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.546+0000 7f54ddc08800 20 remove_watcher() i=0 2024-05-15T14:44:59.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.546+0000 7f54ddc08800 2 removed watcher, disabling cache 2024-05-15T14:44:59.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.547+0000 7f54ddc08800 20 remove_watcher() i=1 2024-05-15T14:44:59.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.548+0000 7f54ddc08800 20 remove_watcher() i=2 2024-05-15T14:44:59.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.549+0000 7f54ddc08800 20 remove_watcher() i=3 2024-05-15T14:44:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.550+0000 7f54ddc08800 20 remove_watcher() i=4 2024-05-15T14:44:59.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.551+0000 7f54ddc08800 20 remove_watcher() i=5 2024-05-15T14:44:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.552+0000 7f54ddc08800 20 remove_watcher() i=6 2024-05-15T14:44:59.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:44:59.553+0000 7f54ddc08800 20 remove_watcher() i=7 2024-05-15T14:45:00.620 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:00.621 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:00.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.663+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.665+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:00.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.665+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.665+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.666+0000 7feb6212b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.666+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.666+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.666+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.667+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:00.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.667+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.667+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:00.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.667+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.667+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:00.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.667+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.668+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:00.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.668+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.668+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:00.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.668+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 20 zone MyZone found 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.669+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.670+0000 7feb6212b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.670+0000 7feb6212b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.670+0000 7feb6212b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:00.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.670+0000 7feb6212b800 20 started sync module instance, tier type = 2024-05-15T14:45:00.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.670+0000 7feb6212b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:00.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.681+0000 7feb6212b800 20 add_watcher() i=0 2024-05-15T14:45:00.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.681+0000 7feb6212b800 20 add_watcher() i=1 2024-05-15T14:45:00.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.681+0000 7feb6212b800 20 add_watcher() i=2 2024-05-15T14:45:00.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.681+0000 7feb6212b800 20 add_watcher() i=3 2024-05-15T14:45:00.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.681+0000 7feb6212b800 20 add_watcher() i=4 2024-05-15T14:45:00.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.681+0000 7feb6212b800 20 add_watcher() i=5 2024-05-15T14:45:00.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.681+0000 7feb6212b800 20 add_watcher() i=6 2024-05-15T14:45:00.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.682+0000 7feb6212b800 20 add_watcher() i=7 2024-05-15T14:45:00.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.682+0000 7feb6212b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:00.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.684+0000 7fea0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:00.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.684+0000 7feb6212b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:00.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.684+0000 7feb6212b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.684+0000 7feb6212b800 5 note: GC not initialized 2024-05-15T14:45:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.684+0000 7fea0e7fc640 20 reqs_thread_entry: start 2024-05-15T14:45:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.684+0000 7feb6212b800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.685+0000 7feb6212b800 20 Filter name: none 2024-05-15T14:45:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.685+0000 7fe97ffff640 20 reqs_thread_entry: start 2024-05-15T14:45:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.685+0000 7feb6212b800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.685+0000 7feb6212b800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:00.687 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:45:00.685+0000 7feb6212b800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:00.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.685+0000 7feb6212b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:00.688 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:45:00.685+0000 7feb6212b800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:00.688 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:45:00.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.686+0000 7fea0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.688+0000 7feb6212b800 20 remove_watcher() i=0 2024-05-15T14:45:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.688+0000 7feb6212b800 2 removed watcher, disabling cache 2024-05-15T14:45:00.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.689+0000 7feb6212b800 20 remove_watcher() i=1 2024-05-15T14:45:00.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.691+0000 7feb6212b800 20 remove_watcher() i=2 2024-05-15T14:45:00.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.692+0000 7feb6212b800 20 remove_watcher() i=3 2024-05-15T14:45:00.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.693+0000 7feb6212b800 20 remove_watcher() i=4 2024-05-15T14:45:00.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.694+0000 7feb6212b800 20 remove_watcher() i=5 2024-05-15T14:45:00.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.695+0000 7feb6212b800 20 remove_watcher() i=6 2024-05-15T14:45:00.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:00.696+0000 7feb6212b800 20 remove_watcher() i=7 2024-05-15T14:45:01.762 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:01.762 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.806+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.807+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.807+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.808+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:01.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.808+0000 7f1d69531800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:01.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.808+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.809+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:01.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.809+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.809+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:01.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.809+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.810+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:01.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.810+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.810+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:01.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.810+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.810+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:01.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.810+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.811+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:01.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.811+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 20 zone MyZone found 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:01.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.812+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.813+0000 7f1d69531800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:01.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.813+0000 7f1d69531800 20 rados->read ofs=0 len=0 2024-05-15T14:45:01.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.813+0000 7f1d69531800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:01.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.813+0000 7f1d69531800 20 started sync module instance, tier type = 2024-05-15T14:45:01.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.813+0000 7f1d69531800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:01.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.824+0000 7f1d69531800 20 add_watcher() i=0 2024-05-15T14:45:01.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.824+0000 7f1d69531800 20 add_watcher() i=1 2024-05-15T14:45:01.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.824+0000 7f1d69531800 20 add_watcher() i=2 2024-05-15T14:45:01.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.824+0000 7f1d69531800 20 add_watcher() i=3 2024-05-15T14:45:01.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.824+0000 7f1d69531800 20 add_watcher() i=4 2024-05-15T14:45:01.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.824+0000 7f1d69531800 20 add_watcher() i=5 2024-05-15T14:45:01.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.824+0000 7f1d69531800 20 add_watcher() i=6 2024-05-15T14:45:01.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.825+0000 7f1d69531800 20 add_watcher() i=7 2024-05-15T14:45:01.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.825+0000 7f1d69531800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:01.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.827+0000 7f1c1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.827+0000 7f1d69531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.827+0000 7f1d69531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.827+0000 7f1d69531800 5 note: GC not initialized 2024-05-15T14:45:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.828+0000 7f1c1a7e4640 20 reqs_thread_entry: start 2024-05-15T14:45:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.828+0000 7f1d69531800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.828+0000 7f1d69531800 20 Filter name: none 2024-05-15T14:45:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.828+0000 7f1b8bfff640 20 reqs_thread_entry: start 2024-05-15T14:45:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.828+0000 7f1d69531800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.829+0000 7f1d69531800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.829+0000 7f1d69531800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.829+0000 7f1d69531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.829+0000 7f1d69531800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.829+0000 7f1c1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.832+0000 7f1d69531800 20 remove_watcher() i=0 2024-05-15T14:45:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.832+0000 7f1d69531800 2 removed watcher, disabling cache 2024-05-15T14:45:01.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.833+0000 7f1d69531800 20 remove_watcher() i=1 2024-05-15T14:45:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.834+0000 7f1d69531800 20 remove_watcher() i=2 2024-05-15T14:45:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.835+0000 7f1d69531800 20 remove_watcher() i=3 2024-05-15T14:45:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.837+0000 7f1d69531800 20 remove_watcher() i=4 2024-05-15T14:45:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.838+0000 7f1d69531800 20 remove_watcher() i=5 2024-05-15T14:45:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.838+0000 7f1d69531800 20 remove_watcher() i=6 2024-05-15T14:45:01.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:01.840+0000 7f1d69531800 20 remove_watcher() i=7 2024-05-15T14:45:02.906 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:02.906 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:02.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.948+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.950+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:02.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.950+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.950+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:02.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.950+0000 7f7d0c136800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:02.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.950+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.951+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:02.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.951+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.952+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:02.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.952+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.952+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:02.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.952+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.952+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:02.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.952+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.953+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:02.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.953+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.953+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:02.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.953+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 20 zone MyZone found 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.954+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.955+0000 7f7d0c136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:02.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.955+0000 7f7d0c136800 20 rados->read ofs=0 len=0 2024-05-15T14:45:02.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.955+0000 7f7d0c136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:02.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.955+0000 7f7d0c136800 20 started sync module instance, tier type = 2024-05-15T14:45:02.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.955+0000 7f7d0c136800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:02.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.966+0000 7f7d0c136800 20 add_watcher() i=0 2024-05-15T14:45:02.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.966+0000 7f7d0c136800 20 add_watcher() i=1 2024-05-15T14:45:02.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.966+0000 7f7d0c136800 20 add_watcher() i=2 2024-05-15T14:45:02.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.966+0000 7f7d0c136800 20 add_watcher() i=3 2024-05-15T14:45:02.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.966+0000 7f7d0c136800 20 add_watcher() i=4 2024-05-15T14:45:02.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.966+0000 7f7d0c136800 20 add_watcher() i=5 2024-05-15T14:45:02.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.966+0000 7f7d0c136800 20 add_watcher() i=6 2024-05-15T14:45:02.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.967+0000 7f7d0c136800 20 add_watcher() i=7 2024-05-15T14:45:02.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.967+0000 7f7d0c136800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:02.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.968+0000 7f7bbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:02.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.969+0000 7f7d0c136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:02.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.969+0000 7f7d0c136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:02.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.969+0000 7f7d0c136800 5 note: GC not initialized 2024-05-15T14:45:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.969+0000 7f7bbcfe1640 20 reqs_thread_entry: start 2024-05-15T14:45:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.970+0000 7f7d0c136800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.970+0000 7f7d0c136800 20 Filter name: none 2024-05-15T14:45:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.970+0000 7f7b367fc640 20 reqs_thread_entry: start 2024-05-15T14:45:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.970+0000 7f7d0c136800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.970+0000 7f7d0c136800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:45:02.970+0000 7f7d0c136800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.970+0000 7f7d0c136800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.970+0000 7f7d0c136800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.971+0000 7f7bbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:02.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.973+0000 7f7d0c136800 20 remove_watcher() i=0 2024-05-15T14:45:02.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.973+0000 7f7d0c136800 2 removed watcher, disabling cache 2024-05-15T14:45:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.975+0000 7f7d0c136800 20 remove_watcher() i=1 2024-05-15T14:45:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.976+0000 7f7d0c136800 20 remove_watcher() i=2 2024-05-15T14:45:02.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.977+0000 7f7d0c136800 20 remove_watcher() i=3 2024-05-15T14:45:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.978+0000 7f7d0c136800 20 remove_watcher() i=4 2024-05-15T14:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.979+0000 7f7d0c136800 20 remove_watcher() i=5 2024-05-15T14:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.980+0000 7f7d0c136800 20 remove_watcher() i=6 2024-05-15T14:45:02.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:02.981+0000 7f7d0c136800 20 remove_watcher() i=7 2024-05-15T14:45:04.050 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:04.050 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:04.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.093+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.095+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.095+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.096+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:04.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.096+0000 7f4f585dc800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:04.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.096+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.096+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.096+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.097+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.097+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.097+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.097+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.098+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.098+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.098+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:04.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.098+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.099+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:04.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.099+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 20 zone MyZone found 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.100+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.101+0000 7f4f585dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.101+0000 7f4f585dc800 20 rados->read ofs=0 len=0 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.101+0000 7f4f585dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.101+0000 7f4f585dc800 20 started sync module instance, tier type = 2024-05-15T14:45:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.101+0000 7f4f585dc800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.112+0000 7f4f585dc800 20 add_watcher() i=0 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.112+0000 7f4f585dc800 20 add_watcher() i=1 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.112+0000 7f4f585dc800 20 add_watcher() i=2 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.112+0000 7f4f585dc800 20 add_watcher() i=3 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.112+0000 7f4f585dc800 20 add_watcher() i=4 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.112+0000 7f4f585dc800 20 add_watcher() i=5 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.112+0000 7f4f585dc800 20 add_watcher() i=6 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.113+0000 7f4f585dc800 20 add_watcher() i=7 2024-05-15T14:45:04.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.113+0000 7f4f585dc800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:04.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.115+0000 7f4e0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:04.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.115+0000 7f4f585dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:04.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.115+0000 7f4f585dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:04.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.115+0000 7f4f585dc800 5 note: GC not initialized 2024-05-15T14:45:04.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.115+0000 7f4d877fe640 20 reqs_thread_entry: start 2024-05-15T14:45:04.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.115+0000 7f4f585dc800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:04.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.115+0000 7f4f585dc800 20 Filter name: none 2024-05-15T14:45:04.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.115+0000 7f4d857fa640 20 reqs_thread_entry: start 2024-05-15T14:45:04.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.116+0000 7f4f585dc800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:04.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.116+0000 7f4f585dc800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:04.119 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:45:04.116+0000 7f4f585dc800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:04.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.116+0000 7f4f585dc800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:04.119 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:45:04.116+0000 7f4f585dc800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:04.119 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:45:04.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.117+0000 7f4e0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.119+0000 7f4f585dc800 20 remove_watcher() i=0 2024-05-15T14:45:04.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.119+0000 7f4f585dc800 2 removed watcher, disabling cache 2024-05-15T14:45:04.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.120+0000 7f4f585dc800 20 remove_watcher() i=1 2024-05-15T14:45:04.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.122+0000 7f4f585dc800 20 remove_watcher() i=2 2024-05-15T14:45:04.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.123+0000 7f4f585dc800 20 remove_watcher() i=3 2024-05-15T14:45:04.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.124+0000 7f4f585dc800 20 remove_watcher() i=4 2024-05-15T14:45:04.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.125+0000 7f4f585dc800 20 remove_watcher() i=5 2024-05-15T14:45:04.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.126+0000 7f4f585dc800 20 remove_watcher() i=6 2024-05-15T14:45:04.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:04.127+0000 7f4f585dc800 20 remove_watcher() i=7 2024-05-15T14:45:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:05.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.236+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.237+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:05.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.237+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.238+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:05.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.238+0000 7f9833062800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:05.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.238+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.238+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:05.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.238+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.239+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:05.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.239+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.239+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:05.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.239+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.240+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:05.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.240+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.240+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:05.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.240+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.241+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.241+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 20 zone MyZone found 2024-05-15T14:45:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.242+0000 7f9833062800 20 rados->read ofs=0 len=0 2024-05-15T14:45:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.243+0000 7f9833062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.243+0000 7f9833062800 20 started sync module instance, tier type = 2024-05-15T14:45:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.243+0000 7f9833062800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.254+0000 7f9833062800 20 add_watcher() i=0 2024-05-15T14:45:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.254+0000 7f9833062800 20 add_watcher() i=1 2024-05-15T14:45:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.254+0000 7f9833062800 20 add_watcher() i=2 2024-05-15T14:45:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.254+0000 7f9833062800 20 add_watcher() i=3 2024-05-15T14:45:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.254+0000 7f9833062800 20 add_watcher() i=4 2024-05-15T14:45:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.254+0000 7f9833062800 20 add_watcher() i=5 2024-05-15T14:45:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.254+0000 7f9833062800 20 add_watcher() i=6 2024-05-15T14:45:05.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.255+0000 7f9833062800 20 add_watcher() i=7 2024-05-15T14:45:05.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.255+0000 7f9833062800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:05.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.257+0000 7f96e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:05.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.257+0000 7f9833062800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.257+0000 7f9833062800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.257+0000 7f9833062800 5 note: GC not initialized 2024-05-15T14:45:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.257+0000 7f96e5fe3640 20 reqs_thread_entry: start 2024-05-15T14:45:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.258+0000 7f9833062800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.258+0000 7f9833062800 20 Filter name: none 2024-05-15T14:45:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.258+0000 7f96577fe640 20 reqs_thread_entry: start 2024-05-15T14:45:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.258+0000 7f9833062800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.258+0000 7f9833062800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:45:05.258+0000 7f9833062800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.258+0000 7f9833062800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:05.261 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:45:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.258+0000 7f9833062800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.259+0000 7f96e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.262+0000 7f9833062800 20 remove_watcher() i=0 2024-05-15T14:45:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.262+0000 7f9833062800 2 removed watcher, disabling cache 2024-05-15T14:45:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.263+0000 7f9833062800 20 remove_watcher() i=1 2024-05-15T14:45:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.264+0000 7f9833062800 20 remove_watcher() i=2 2024-05-15T14:45:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.265+0000 7f9833062800 20 remove_watcher() i=3 2024-05-15T14:45:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.266+0000 7f9833062800 20 remove_watcher() i=4 2024-05-15T14:45:05.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.267+0000 7f9833062800 20 remove_watcher() i=5 2024-05-15T14:45:05.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.268+0000 7f9833062800 20 remove_watcher() i=6 2024-05-15T14:45:05.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:05.269+0000 7f9833062800 20 remove_watcher() i=7 2024-05-15T14:45:06.336 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:06.336 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.380+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.381+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.381+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.382+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.382+0000 7f9dad21f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.382+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.383+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.383+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.383+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.383+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.384+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.384+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.384+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.384+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.385+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.385+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.385+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.385+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 20 zone MyZone found 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.386+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.387+0000 7f9dad21f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:06.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.387+0000 7f9dad21f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:06.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.387+0000 7f9dad21f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:06.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.387+0000 7f9dad21f800 20 started sync module instance, tier type = 2024-05-15T14:45:06.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.387+0000 7f9dad21f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:06.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.398+0000 7f9dad21f800 20 add_watcher() i=0 2024-05-15T14:45:06.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.398+0000 7f9dad21f800 20 add_watcher() i=1 2024-05-15T14:45:06.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.398+0000 7f9dad21f800 20 add_watcher() i=2 2024-05-15T14:45:06.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.398+0000 7f9dad21f800 20 add_watcher() i=3 2024-05-15T14:45:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.398+0000 7f9dad21f800 20 add_watcher() i=4 2024-05-15T14:45:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.398+0000 7f9dad21f800 20 add_watcher() i=5 2024-05-15T14:45:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.398+0000 7f9dad21f800 20 add_watcher() i=6 2024-05-15T14:45:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.399+0000 7f9dad21f800 20 add_watcher() i=7 2024-05-15T14:45:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.399+0000 7f9dad21f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:06.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.401+0000 7f9c617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.402+0000 7f9dad21f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.402+0000 7f9dad21f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.402+0000 7f9dad21f800 5 note: GC not initialized 2024-05-15T14:45:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.402+0000 7f9bdbfff640 20 reqs_thread_entry: start 2024-05-15T14:45:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.402+0000 7f9dad21f800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.402+0000 7f9dad21f800 20 Filter name: none 2024-05-15T14:45:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.402+0000 7f9bd9ffb640 20 reqs_thread_entry: start 2024-05-15T14:45:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.402+0000 7f9dad21f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.403+0000 7f9dad21f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:45:06.403+0000 7f9dad21f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:45:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.403+0000 7f9dad21f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.403+0000 7f9dad21f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.404+0000 7f9c617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:06.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.406+0000 7f9dad21f800 20 remove_watcher() i=0 2024-05-15T14:45:06.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.406+0000 7f9dad21f800 2 removed watcher, disabling cache 2024-05-15T14:45:06.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.407+0000 7f9dad21f800 20 remove_watcher() i=1 2024-05-15T14:45:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.408+0000 7f9dad21f800 20 remove_watcher() i=2 2024-05-15T14:45:06.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.409+0000 7f9dad21f800 20 remove_watcher() i=3 2024-05-15T14:45:06.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.410+0000 7f9dad21f800 20 remove_watcher() i=4 2024-05-15T14:45:06.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.411+0000 7f9dad21f800 20 remove_watcher() i=5 2024-05-15T14:45:06.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.412+0000 7f9dad21f800 20 remove_watcher() i=6 2024-05-15T14:45:06.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:06.413+0000 7f9dad21f800 20 remove_watcher() i=7 2024-05-15T14:45:07.480 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:07.481 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:07.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.524+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.525+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:07.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.525+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.526+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:07.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.526+0000 7f0a38638800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:07.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.526+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.526+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:07.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.526+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.527+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:07.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.527+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.528+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.528+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.528+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.528+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.528+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:07.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.528+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.529+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:07.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.529+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 20 zone MyZone found 2024-05-15T14:45:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.530+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.531+0000 7f0a38638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.531+0000 7f0a38638800 20 rados->read ofs=0 len=0 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.531+0000 7f0a38638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.531+0000 7f0a38638800 20 started sync module instance, tier type = 2024-05-15T14:45:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.531+0000 7f0a38638800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.543+0000 7f0a38638800 20 add_watcher() i=0 2024-05-15T14:45:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.543+0000 7f0a38638800 20 add_watcher() i=1 2024-05-15T14:45:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.543+0000 7f0a38638800 20 add_watcher() i=2 2024-05-15T14:45:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.543+0000 7f0a38638800 20 add_watcher() i=3 2024-05-15T14:45:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.543+0000 7f0a38638800 20 add_watcher() i=4 2024-05-15T14:45:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.543+0000 7f0a38638800 20 add_watcher() i=5 2024-05-15T14:45:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.543+0000 7f0a38638800 20 add_watcher() i=6 2024-05-15T14:45:07.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.544+0000 7f0a38638800 20 add_watcher() i=7 2024-05-15T14:45:07.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.544+0000 7f0a38638800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:07.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.546+0000 7f08ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:07.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.546+0000 7f0a38638800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:07.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.546+0000 7f0a38638800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:07.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.546+0000 7f0a38638800 5 note: GC not initialized 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.546+0000 7f08677fe640 20 reqs_thread_entry: start 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.546+0000 7f0a38638800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.546+0000 7f0a38638800 20 Filter name: none 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.546+0000 7f08657fa640 20 reqs_thread_entry: start 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.547+0000 7f0a38638800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.547+0000 7f0a38638800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.547+0000 7f0a38638800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.547+0000 7f0a38638800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:07.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.547+0000 7f0a38638800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:07.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.548+0000 7f08ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:07.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.550+0000 7f0a38638800 20 remove_watcher() i=0 2024-05-15T14:45:07.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.550+0000 7f0a38638800 2 removed watcher, disabling cache 2024-05-15T14:45:07.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.552+0000 7f0a38638800 20 remove_watcher() i=1 2024-05-15T14:45:07.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.553+0000 7f0a38638800 20 remove_watcher() i=2 2024-05-15T14:45:07.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.554+0000 7f0a38638800 20 remove_watcher() i=3 2024-05-15T14:45:07.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.555+0000 7f0a38638800 20 remove_watcher() i=4 2024-05-15T14:45:07.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.556+0000 7f0a38638800 20 remove_watcher() i=5 2024-05-15T14:45:07.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.557+0000 7f0a38638800 20 remove_watcher() i=6 2024-05-15T14:45:07.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:07.558+0000 7f0a38638800 20 remove_watcher() i=7 2024-05-15T14:45:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.670+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.671+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:08.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.671+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.672+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:08.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.672+0000 7f7083462800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:08.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.672+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.672+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:08.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.672+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.673+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:08.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.673+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.674+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:08.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.674+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.674+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:08.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.674+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.675+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:08.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.675+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.675+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:08.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.675+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:08.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 20 zone MyZone found 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.676+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.677+0000 7f7083462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:08.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.677+0000 7f7083462800 20 rados->read ofs=0 len=0 2024-05-15T14:45:08.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.677+0000 7f7083462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:08.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.677+0000 7f7083462800 20 started sync module instance, tier type = 2024-05-15T14:45:08.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.677+0000 7f7083462800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.688+0000 7f7083462800 20 add_watcher() i=0 2024-05-15T14:45:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.688+0000 7f7083462800 20 add_watcher() i=1 2024-05-15T14:45:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.688+0000 7f7083462800 20 add_watcher() i=2 2024-05-15T14:45:08.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.688+0000 7f7083462800 20 add_watcher() i=3 2024-05-15T14:45:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.688+0000 7f7083462800 20 add_watcher() i=4 2024-05-15T14:45:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.688+0000 7f7083462800 20 add_watcher() i=5 2024-05-15T14:45:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.688+0000 7f7083462800 20 add_watcher() i=6 2024-05-15T14:45:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.689+0000 7f7083462800 20 add_watcher() i=7 2024-05-15T14:45:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.689+0000 7f7083462800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.691+0000 7f6f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.691+0000 7f7083462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.691+0000 7f7083462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.692+0000 7f7083462800 5 note: GC not initialized 2024-05-15T14:45:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.692+0000 7f6f367e4640 20 reqs_thread_entry: start 2024-05-15T14:45:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.692+0000 7f7083462800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.692+0000 7f7083462800 20 Filter name: none 2024-05-15T14:45:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.692+0000 7f6f2f7fe640 20 reqs_thread_entry: start 2024-05-15T14:45:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.692+0000 7f7083462800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:08.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.693+0000 7f7083462800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:08.695 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:45:08.693+0000 7f7083462800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:08.695 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:45:08.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.693+0000 7f7083462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:08.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.693+0000 7f7083462800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:08.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.694+0000 7f6f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:08.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.696+0000 7f7083462800 20 remove_watcher() i=0 2024-05-15T14:45:08.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.696+0000 7f7083462800 2 removed watcher, disabling cache 2024-05-15T14:45:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.697+0000 7f7083462800 20 remove_watcher() i=1 2024-05-15T14:45:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.698+0000 7f7083462800 20 remove_watcher() i=2 2024-05-15T14:45:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.700+0000 7f7083462800 20 remove_watcher() i=3 2024-05-15T14:45:08.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.701+0000 7f7083462800 20 remove_watcher() i=4 2024-05-15T14:45:08.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.702+0000 7f7083462800 20 remove_watcher() i=5 2024-05-15T14:45:08.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.703+0000 7f7083462800 20 remove_watcher() i=6 2024-05-15T14:45:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:08.704+0000 7f7083462800 20 remove_watcher() i=7 2024-05-15T14:45:09.771 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:09.771 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:09.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.813+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.815+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:09.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.815+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.816+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:09.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.816+0000 7f6818533800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:09.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.816+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.816+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:09.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.816+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.817+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.817+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.817+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.817+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.817+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.817+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.818+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.818+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.818+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.818+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 20 zone MyZone found 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.819+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.820+0000 7f6818533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:09.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.820+0000 7f6818533800 20 rados->read ofs=0 len=0 2024-05-15T14:45:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.820+0000 7f6818533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.820+0000 7f6818533800 20 started sync module instance, tier type = 2024-05-15T14:45:09.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.820+0000 7f6818533800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:09.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.831+0000 7f6818533800 20 add_watcher() i=0 2024-05-15T14:45:09.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.831+0000 7f6818533800 20 add_watcher() i=1 2024-05-15T14:45:09.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.831+0000 7f6818533800 20 add_watcher() i=2 2024-05-15T14:45:09.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.831+0000 7f6818533800 20 add_watcher() i=3 2024-05-15T14:45:09.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.831+0000 7f6818533800 20 add_watcher() i=4 2024-05-15T14:45:09.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.831+0000 7f6818533800 20 add_watcher() i=5 2024-05-15T14:45:09.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.831+0000 7f6818533800 20 add_watcher() i=6 2024-05-15T14:45:09.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.832+0000 7f6818533800 20 add_watcher() i=7 2024-05-15T14:45:09.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.832+0000 7f6818533800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:09.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.834+0000 7f66cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:09.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.834+0000 7f6818533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:09.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.834+0000 7f6818533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:09.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.834+0000 7f6818533800 5 note: GC not initialized 2024-05-15T14:45:09.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.835+0000 7f66c9fdb640 20 reqs_thread_entry: start 2024-05-15T14:45:09.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.835+0000 7f6818533800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:09.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.835+0000 7f6818533800 20 Filter name: none 2024-05-15T14:45:09.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.835+0000 7f663b7fe640 20 reqs_thread_entry: start 2024-05-15T14:45:09.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.835+0000 7f6818533800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:09.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.836+0000 7f6818533800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:09.838 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:45:09.836+0000 7f6818533800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:09.838 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:45:09.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.836+0000 7f6818533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:09.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.836+0000 7f6818533800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:09.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.837+0000 7f66cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:09.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.839+0000 7f6818533800 20 remove_watcher() i=0 2024-05-15T14:45:09.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.839+0000 7f6818533800 2 removed watcher, disabling cache 2024-05-15T14:45:09.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.840+0000 7f6818533800 20 remove_watcher() i=1 2024-05-15T14:45:09.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.841+0000 7f6818533800 20 remove_watcher() i=2 2024-05-15T14:45:09.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.842+0000 7f6818533800 20 remove_watcher() i=3 2024-05-15T14:45:09.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.843+0000 7f6818533800 20 remove_watcher() i=4 2024-05-15T14:45:09.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.844+0000 7f6818533800 20 remove_watcher() i=5 2024-05-15T14:45:09.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.845+0000 7f6818533800 20 remove_watcher() i=6 2024-05-15T14:45:09.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:09.846+0000 7f6818533800 20 remove_watcher() i=7 2024-05-15T14:45:10.915 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:10.915 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:10.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.960+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.961+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:10.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.961+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.962+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.962+0000 7f140380c800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.962+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.963+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:10.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.963+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.964+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.964+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.964+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.964+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.964+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.964+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.965+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.965+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.965+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.965+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 20 zone MyZone found 2024-05-15T14:45:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.966+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.967+0000 7f140380c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.967+0000 7f140380c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.967+0000 7f140380c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.967+0000 7f140380c800 20 started sync module instance, tier type = 2024-05-15T14:45:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.967+0000 7f140380c800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:10.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.978+0000 7f140380c800 20 add_watcher() i=0 2024-05-15T14:45:10.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.978+0000 7f140380c800 20 add_watcher() i=1 2024-05-15T14:45:10.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.978+0000 7f140380c800 20 add_watcher() i=2 2024-05-15T14:45:10.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.978+0000 7f140380c800 20 add_watcher() i=3 2024-05-15T14:45:10.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.978+0000 7f140380c800 20 add_watcher() i=4 2024-05-15T14:45:10.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.978+0000 7f140380c800 20 add_watcher() i=5 2024-05-15T14:45:10.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.978+0000 7f140380c800 20 add_watcher() i=6 2024-05-15T14:45:10.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.979+0000 7f140380c800 20 add_watcher() i=7 2024-05-15T14:45:10.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.979+0000 7f140380c800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:10.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.981+0000 7f12b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:10.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.981+0000 7f140380c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:10.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.981+0000 7f140380c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:10.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.982+0000 7f140380c800 5 note: GC not initialized 2024-05-15T14:45:10.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.982+0000 7f12b67e4640 20 reqs_thread_entry: start 2024-05-15T14:45:10.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.982+0000 7f140380c800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:10.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.982+0000 7f140380c800 20 Filter name: none 2024-05-15T14:45:10.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.982+0000 7f1227fff640 20 reqs_thread_entry: start 2024-05-15T14:45:10.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.982+0000 7f140380c800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:10.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.983+0000 7f140380c800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:10.985 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:45:10.983+0000 7f140380c800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:10.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.983+0000 7f140380c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:10.985 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:45:10.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.983+0000 7f140380c800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:10.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.984+0000 7f12b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:10.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.986+0000 7f140380c800 20 remove_watcher() i=0 2024-05-15T14:45:10.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.986+0000 7f140380c800 2 removed watcher, disabling cache 2024-05-15T14:45:10.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.987+0000 7f140380c800 20 remove_watcher() i=1 2024-05-15T14:45:10.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.988+0000 7f140380c800 20 remove_watcher() i=2 2024-05-15T14:45:10.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.990+0000 7f140380c800 20 remove_watcher() i=3 2024-05-15T14:45:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.991+0000 7f140380c800 20 remove_watcher() i=4 2024-05-15T14:45:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.992+0000 7f140380c800 20 remove_watcher() i=5 2024-05-15T14:45:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.993+0000 7f140380c800 20 remove_watcher() i=6 2024-05-15T14:45:10.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:10.994+0000 7f140380c800 20 remove_watcher() i=7 2024-05-15T14:45:12.061 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:12.061 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:12.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.105+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.106+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:12.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.106+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.107+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:12.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.107+0000 7f7eddf33800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:12.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.107+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.107+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:12.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.107+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.108+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:12.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.108+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.108+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:12.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.108+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.108+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:12.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.108+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.109+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:12.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.109+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.110+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:12.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.110+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 20 zone MyZone found 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.111+0000 7f7eddf33800 20 rados->read ofs=0 len=0 2024-05-15T14:45:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.112+0000 7f7eddf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.112+0000 7f7eddf33800 20 started sync module instance, tier type = 2024-05-15T14:45:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.112+0000 7f7eddf33800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.123+0000 7f7eddf33800 20 add_watcher() i=0 2024-05-15T14:45:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.123+0000 7f7eddf33800 20 add_watcher() i=1 2024-05-15T14:45:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.123+0000 7f7eddf33800 20 add_watcher() i=2 2024-05-15T14:45:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.123+0000 7f7eddf33800 20 add_watcher() i=3 2024-05-15T14:45:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.123+0000 7f7eddf33800 20 add_watcher() i=4 2024-05-15T14:45:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.123+0000 7f7eddf33800 20 add_watcher() i=5 2024-05-15T14:45:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.123+0000 7f7eddf33800 20 add_watcher() i=6 2024-05-15T14:45:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.124+0000 7f7eddf33800 20 add_watcher() i=7 2024-05-15T14:45:12.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.124+0000 7f7eddf33800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:12.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.125+0000 7f7d8bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:12.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.126+0000 7f7eddf33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:12.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.126+0000 7f7eddf33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:12.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.126+0000 7f7eddf33800 5 note: GC not initialized 2024-05-15T14:45:12.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.126+0000 7f7d8affd640 20 reqs_thread_entry: start 2024-05-15T14:45:12.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.126+0000 7f7eddf33800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:12.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.126+0000 7f7eddf33800 20 Filter name: none 2024-05-15T14:45:12.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.126+0000 7f7d88ff9640 20 reqs_thread_entry: start 2024-05-15T14:45:12.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.126+0000 7f7eddf33800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:12.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.127+0000 7f7eddf33800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:12.129 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:45:12.127+0000 7f7eddf33800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:12.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.127+0000 7f7eddf33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:12.129 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:45:12.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.127+0000 7f7eddf33800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:12.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.128+0000 7f7d8bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:12.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.131+0000 7f7eddf33800 20 remove_watcher() i=0 2024-05-15T14:45:12.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.131+0000 7f7eddf33800 2 removed watcher, disabling cache 2024-05-15T14:45:12.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.132+0000 7f7eddf33800 20 remove_watcher() i=1 2024-05-15T14:45:12.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.133+0000 7f7eddf33800 20 remove_watcher() i=2 2024-05-15T14:45:12.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.134+0000 7f7eddf33800 20 remove_watcher() i=3 2024-05-15T14:45:12.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.136+0000 7f7eddf33800 20 remove_watcher() i=4 2024-05-15T14:45:12.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.136+0000 7f7eddf33800 20 remove_watcher() i=5 2024-05-15T14:45:12.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.137+0000 7f7eddf33800 20 remove_watcher() i=6 2024-05-15T14:45:12.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:12.138+0000 7f7eddf33800 20 remove_watcher() i=7 2024-05-15T14:45:13.205 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:13.206 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:13.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.250+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.252+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:13.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.252+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.253+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.253+0000 7f3e1b487800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.253+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.253+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.253+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.254+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.254+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.254+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.254+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.254+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:13.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.254+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.255+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:13.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.255+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.256+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:13.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.256+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 20 zone MyZone found 2024-05-15T14:45:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.257+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.258+0000 7f3e1b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.258+0000 7f3e1b487800 20 rados->read ofs=0 len=0 2024-05-15T14:45:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.258+0000 7f3e1b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.258+0000 7f3e1b487800 20 started sync module instance, tier type = 2024-05-15T14:45:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.258+0000 7f3e1b487800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:13.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.269+0000 7f3e1b487800 20 add_watcher() i=0 2024-05-15T14:45:13.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.269+0000 7f3e1b487800 20 add_watcher() i=1 2024-05-15T14:45:13.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.269+0000 7f3e1b487800 20 add_watcher() i=2 2024-05-15T14:45:13.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.269+0000 7f3e1b487800 20 add_watcher() i=3 2024-05-15T14:45:13.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.269+0000 7f3e1b487800 20 add_watcher() i=4 2024-05-15T14:45:13.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.269+0000 7f3e1b487800 20 add_watcher() i=5 2024-05-15T14:45:13.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.269+0000 7f3e1b487800 20 add_watcher() i=6 2024-05-15T14:45:13.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.270+0000 7f3e1b487800 20 add_watcher() i=7 2024-05-15T14:45:13.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.270+0000 7f3e1b487800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:13.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.272+0000 7f3ccf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:13.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.273+0000 7f3e1b487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:13.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.273+0000 7f3e1b487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.273+0000 7f3e1b487800 5 note: GC not initialized 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.273+0000 7f3cce7e4640 20 reqs_thread_entry: start 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.273+0000 7f3e1b487800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.273+0000 7f3e1b487800 20 Filter name: none 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.273+0000 7f3cc77fe640 20 reqs_thread_entry: start 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.273+0000 7f3e1b487800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.274+0000 7f3e1b487800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.274+0000 7f3e1b487800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.274+0000 7f3e1b487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:13.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.274+0000 7f3e1b487800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:13.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.275+0000 7f3ccf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.278+0000 7f3e1b487800 20 remove_watcher() i=0 2024-05-15T14:45:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.278+0000 7f3e1b487800 2 removed watcher, disabling cache 2024-05-15T14:45:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.279+0000 7f3e1b487800 20 remove_watcher() i=1 2024-05-15T14:45:13.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.280+0000 7f3e1b487800 20 remove_watcher() i=2 2024-05-15T14:45:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.281+0000 7f3e1b487800 20 remove_watcher() i=3 2024-05-15T14:45:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.282+0000 7f3e1b487800 20 remove_watcher() i=4 2024-05-15T14:45:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.284+0000 7f3e1b487800 20 remove_watcher() i=5 2024-05-15T14:45:13.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.285+0000 7f3e1b487800 20 remove_watcher() i=6 2024-05-15T14:45:13.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:13.286+0000 7f3e1b487800 20 remove_watcher() i=7 2024-05-15T14:45:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.396+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.397+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.397+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.398+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.398+0000 7f030b12e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.398+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.399+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:14.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.399+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.399+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:14.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.400+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.400+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:14.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.400+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.400+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.400+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.401+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.401+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.401+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.401+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 20 zone MyZone found 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.402+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.403+0000 7f030b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.403+0000 7f030b12e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.403+0000 7f030b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.403+0000 7f030b12e800 20 started sync module instance, tier type = 2024-05-15T14:45:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.403+0000 7f030b12e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:14.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.414+0000 7f030b12e800 20 add_watcher() i=0 2024-05-15T14:45:14.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.414+0000 7f030b12e800 20 add_watcher() i=1 2024-05-15T14:45:14.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.414+0000 7f030b12e800 20 add_watcher() i=2 2024-05-15T14:45:14.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.414+0000 7f030b12e800 20 add_watcher() i=3 2024-05-15T14:45:14.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.414+0000 7f030b12e800 20 add_watcher() i=4 2024-05-15T14:45:14.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.414+0000 7f030b12e800 20 add_watcher() i=5 2024-05-15T14:45:14.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.414+0000 7f030b12e800 20 add_watcher() i=6 2024-05-15T14:45:14.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.415+0000 7f030b12e800 20 add_watcher() i=7 2024-05-15T14:45:14.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.415+0000 7f030b12e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.417+0000 7f01bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.417+0000 7f030b12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.417+0000 7f030b12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.417+0000 7f030b12e800 5 note: GC not initialized 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.417+0000 7f0137fff640 20 reqs_thread_entry: start 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.417+0000 7f030b12e800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.418+0000 7f030b12e800 20 Filter name: none 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.418+0000 7f0135ffb640 20 reqs_thread_entry: start 2024-05-15T14:45:14.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.418+0000 7f030b12e800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:14.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.418+0000 7f030b12e800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:14.420 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:45:14.418+0000 7f030b12e800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:14.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.418+0000 7f030b12e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:14.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.418+0000 7f030b12e800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:14.421 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:45:14.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.419+0000 7f01bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:14.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.422+0000 7f030b12e800 20 remove_watcher() i=0 2024-05-15T14:45:14.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.422+0000 7f030b12e800 2 removed watcher, disabling cache 2024-05-15T14:45:14.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.423+0000 7f030b12e800 20 remove_watcher() i=1 2024-05-15T14:45:14.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.424+0000 7f030b12e800 20 remove_watcher() i=2 2024-05-15T14:45:14.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.425+0000 7f030b12e800 20 remove_watcher() i=3 2024-05-15T14:45:14.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.426+0000 7f030b12e800 20 remove_watcher() i=4 2024-05-15T14:45:14.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.428+0000 7f030b12e800 20 remove_watcher() i=5 2024-05-15T14:45:14.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.429+0000 7f030b12e800 20 remove_watcher() i=6 2024-05-15T14:45:14.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:14.430+0000 7f030b12e800 20 remove_watcher() i=7 2024-05-15T14:45:15.496 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:15.496 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:15.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.541+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.542+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:15.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.542+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.543+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:15.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.543+0000 7f6585013800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:15.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.543+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.543+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:15.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.543+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.544+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:15.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.544+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.545+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:15.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.545+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.545+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:15.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.545+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.545+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:15.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.545+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.546+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:15.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.546+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 20 zone MyZone found 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.547+0000 7f6585013800 20 rados->read ofs=0 len=0 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.548+0000 7f6585013800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:15.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.548+0000 7f6585013800 20 started sync module instance, tier type = 2024-05-15T14:45:15.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.548+0000 7f6585013800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.560+0000 7f6585013800 20 add_watcher() i=0 2024-05-15T14:45:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.560+0000 7f6585013800 20 add_watcher() i=1 2024-05-15T14:45:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.560+0000 7f6585013800 20 add_watcher() i=2 2024-05-15T14:45:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.560+0000 7f6585013800 20 add_watcher() i=3 2024-05-15T14:45:15.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.560+0000 7f6585013800 20 add_watcher() i=4 2024-05-15T14:45:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.560+0000 7f6585013800 20 add_watcher() i=5 2024-05-15T14:45:15.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.560+0000 7f6585013800 20 add_watcher() i=6 2024-05-15T14:45:15.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.562+0000 7f6585013800 20 add_watcher() i=7 2024-05-15T14:45:15.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.562+0000 7f6585013800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:15.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.564+0000 7f6436fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.564+0000 7f6585013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.564+0000 7f6585013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.564+0000 7f6585013800 5 note: GC not initialized 2024-05-15T14:45:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f6435fdb640 20 reqs_thread_entry: start 2024-05-15T14:45:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f6585013800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f6585013800 20 Filter name: none 2024-05-15T14:45:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f63a77fe640 20 reqs_thread_entry: start 2024-05-15T14:45:15.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f6585013800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:15.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f6585013800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:15.567 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:15.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f6585013800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:15.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f6585013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:15.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.565+0000 7f6585013800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:15.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.566+0000 7f6436fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:15.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.568+0000 7f6585013800 20 remove_watcher() i=0 2024-05-15T14:45:15.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.568+0000 7f6585013800 2 removed watcher, disabling cache 2024-05-15T14:45:15.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.570+0000 7f6585013800 20 remove_watcher() i=1 2024-05-15T14:45:15.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.571+0000 7f6585013800 20 remove_watcher() i=2 2024-05-15T14:45:15.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.572+0000 7f6585013800 20 remove_watcher() i=3 2024-05-15T14:45:15.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.573+0000 7f6585013800 20 remove_watcher() i=4 2024-05-15T14:45:15.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.574+0000 7f6585013800 20 remove_watcher() i=5 2024-05-15T14:45:15.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.575+0000 7f6585013800 20 remove_watcher() i=6 2024-05-15T14:45:15.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:15.576+0000 7f6585013800 20 remove_watcher() i=7 2024-05-15T14:45:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:16.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.686+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.688+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.688+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.689+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.689+0000 7f97b4719800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.689+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.689+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.690+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.690+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.690+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.691+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.691+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.691+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.691+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.691+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:16.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.691+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.692+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:16.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.692+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:16.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 20 zone MyZone found 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.693+0000 7f97b4719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.694+0000 7f97b4719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.694+0000 7f97b4719800 20 started sync module instance, tier type = 2024-05-15T14:45:16.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.694+0000 7f97b4719800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:16.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.705+0000 7f97b4719800 20 add_watcher() i=0 2024-05-15T14:45:16.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.705+0000 7f97b4719800 20 add_watcher() i=1 2024-05-15T14:45:16.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.705+0000 7f97b4719800 20 add_watcher() i=2 2024-05-15T14:45:16.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.705+0000 7f97b4719800 20 add_watcher() i=3 2024-05-15T14:45:16.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.705+0000 7f97b4719800 20 add_watcher() i=4 2024-05-15T14:45:16.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.705+0000 7f97b4719800 20 add_watcher() i=5 2024-05-15T14:45:16.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.705+0000 7f97b4719800 20 add_watcher() i=6 2024-05-15T14:45:16.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.706+0000 7f97b4719800 20 add_watcher() i=7 2024-05-15T14:45:16.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.706+0000 7f97b4719800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:16.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.708+0000 7f9668fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.708+0000 7f97b4719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:16.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.708+0000 7f97b4719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:16.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.708+0000 7f97b4719800 5 note: GC not initialized 2024-05-15T14:45:16.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.708+0000 7f95e37fe640 20 reqs_thread_entry: start 2024-05-15T14:45:16.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.709+0000 7f97b4719800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:16.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.709+0000 7f97b4719800 20 Filter name: none 2024-05-15T14:45:16.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.709+0000 7f95e17fa640 20 reqs_thread_entry: start 2024-05-15T14:45:16.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.709+0000 7f97b4719800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:16.711 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:16.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.709+0000 7f97b4719800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:16.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.709+0000 7f97b4719800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:16.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.709+0000 7f97b4719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:16.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.709+0000 7f97b4719800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:16.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.710+0000 7f9668fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:16.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.712+0000 7f97b4719800 20 remove_watcher() i=0 2024-05-15T14:45:16.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.712+0000 7f97b4719800 2 removed watcher, disabling cache 2024-05-15T14:45:16.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.713+0000 7f97b4719800 20 remove_watcher() i=1 2024-05-15T14:45:16.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.714+0000 7f97b4719800 20 remove_watcher() i=2 2024-05-15T14:45:16.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.715+0000 7f97b4719800 20 remove_watcher() i=3 2024-05-15T14:45:16.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.716+0000 7f97b4719800 20 remove_watcher() i=4 2024-05-15T14:45:16.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.717+0000 7f97b4719800 20 remove_watcher() i=5 2024-05-15T14:45:16.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.718+0000 7f97b4719800 20 remove_watcher() i=6 2024-05-15T14:45:16.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:16.719+0000 7f97b4719800 20 remove_watcher() i=7 2024-05-15T14:45:17.471 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:45:17.470+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:45:17.472 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:45:17.470+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:45:17.472 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:45:17.470+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:45:17.472 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:45:17.470+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:45:17.783 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:17.794 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:45:17.793+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:45:17.794 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:45:17.793+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:45:17.794 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:45:17.793+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:45:17.794 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:45:17.793+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:45:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.839+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.840+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.840+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.841+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.841+0000 7fe3c1087800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.841+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.841+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.841+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.842+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.842+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.842+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.842+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.842+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.842+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.843+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.843+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.844+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.844+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 20 zone MyZone found 2024-05-15T14:45:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.845+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.846+0000 7fe3c1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.846+0000 7fe3c1087800 20 started sync module instance, tier type = 2024-05-15T14:45:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.846+0000 7fe3c1087800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.857+0000 7fe3c1087800 20 add_watcher() i=0 2024-05-15T14:45:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.857+0000 7fe3c1087800 20 add_watcher() i=1 2024-05-15T14:45:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.857+0000 7fe3c1087800 20 add_watcher() i=2 2024-05-15T14:45:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.857+0000 7fe3c1087800 20 add_watcher() i=3 2024-05-15T14:45:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.857+0000 7fe3c1087800 20 add_watcher() i=4 2024-05-15T14:45:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.857+0000 7fe3c1087800 20 add_watcher() i=5 2024-05-15T14:45:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.857+0000 7fe3c1087800 20 add_watcher() i=6 2024-05-15T14:45:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.858+0000 7fe3c1087800 20 add_watcher() i=7 2024-05-15T14:45:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.858+0000 7fe3c1087800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.860+0000 7fe2757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.860+0000 7fe3c1087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.860+0000 7fe3c1087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.860+0000 7fe3c1087800 5 note: GC not initialized 2024-05-15T14:45:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.860+0000 7fe1effff640 20 reqs_thread_entry: start 2024-05-15T14:45:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.860+0000 7fe3c1087800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 20 Filter name: none 2024-05-15T14:45:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe1edffb640 20 reqs_thread_entry: start 2024-05-15T14:45:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:45:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 10 cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:45:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 10 cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-24_topic_1 : miss 2024-05-15T14:45:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 20 rados->read ofs=0 len=0 2024-05-15T14:45:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 10 cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-24_topic_1 info.flags=0x0 2024-05-15T14:45:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 10 adding MyZone.rgw.meta+topics+topic.:vwwrqh-24_topic_1 to cache LRU end 2024-05-15T14:45:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 1 failed to read topic info for name: vwwrqh-24_topic_1 tenant: , ret=-2 2024-05-15T14:45:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.861+0000 7fe3c1087800 10 WARNING: topic name:vwwrqh-24_topic_1 does not exist, deletion is a no-op: ret=-2 2024-05-15T14:45:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.863+0000 7fe2757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.865+0000 7fe3c1087800 20 remove_watcher() i=0 2024-05-15T14:45:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.865+0000 7fe3c1087800 2 removed watcher, disabling cache 2024-05-15T14:45:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.866+0000 7fe3c1087800 20 remove_watcher() i=1 2024-05-15T14:45:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.867+0000 7fe3c1087800 20 remove_watcher() i=2 2024-05-15T14:45:17.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.869+0000 7fe3c1087800 20 remove_watcher() i=3 2024-05-15T14:45:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.870+0000 7fe3c1087800 20 remove_watcher() i=4 2024-05-15T14:45:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.871+0000 7fe3c1087800 20 remove_watcher() i=5 2024-05-15T14:45:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.872+0000 7fe3c1087800 20 remove_watcher() i=6 2024-05-15T14:45:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:17.873+0000 7fe3c1087800 20 remove_watcher() i=7 2024-05-15T14:45:18.067 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.122 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.164 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:127.0.0.1 - - [15/May/2024 14:45:18] "POST / HTTP/1.1" 200 - 2024-05-15T14:45:18.668 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:45:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:test data path v2 large migration ... ignoring --setuser ceph since I am not root 2024-05-15T14:45:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:18.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.756+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.758+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:18.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.758+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.759+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.759+0000 7fbd0cb19800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.759+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.759+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:18.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.759+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.760+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.760+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.760+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.760+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.761+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.761+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.761+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.761+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 20 zone MyZone found 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.762+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.763+0000 7fbd0cb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.763+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.763+0000 7fbd0cb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.763+0000 7fbd0cb19800 20 started sync module instance, tier type = 2024-05-15T14:45:18.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.763+0000 7fbd0cb19800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:18.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.773+0000 7fbd0cb19800 20 add_watcher() i=0 2024-05-15T14:45:18.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.773+0000 7fbd0cb19800 20 add_watcher() i=1 2024-05-15T14:45:18.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.773+0000 7fbd0cb19800 20 add_watcher() i=2 2024-05-15T14:45:18.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.773+0000 7fbd0cb19800 20 add_watcher() i=3 2024-05-15T14:45:18.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.773+0000 7fbd0cb19800 20 add_watcher() i=4 2024-05-15T14:45:18.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.773+0000 7fbd0cb19800 20 add_watcher() i=5 2024-05-15T14:45:18.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.773+0000 7fbd0cb19800 20 add_watcher() i=6 2024-05-15T14:45:18.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.774+0000 7fbd0cb19800 20 add_watcher() i=7 2024-05-15T14:45:18.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.774+0000 7fbd0cb19800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:18.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.776+0000 7fbbc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:18.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.776+0000 7fbd0cb19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:18.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.776+0000 7fbd0cb19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:18.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.776+0000 7fbd0cb19800 5 note: GC not initialized 2024-05-15T14:45:18.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.776+0000 7fbb3b7fe640 20 reqs_thread_entry: start 2024-05-15T14:45:18.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.776+0000 7fbd0cb19800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:18.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.777+0000 7fbd0cb19800 20 Filter name: none 2024-05-15T14:45:18.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.777+0000 7fbb397fa640 20 reqs_thread_entry: start 2024-05-15T14:45:18.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.785+0000 7fbd0cb19800 20 RGWRados::pool_iterate: got topic.:vwwrqh-22_topic_1 2024-05-15T14:45:18.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.785+0000 7fbd0cb19800 20 RGWRados::pool_iterate: got topic.:vwwrqh-22_topic_2 2024-05-15T14:45:18.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.785+0000 7fbd0cb19800 20 RGWRados::pool_iterate: got buckets.:vwwrqh-22_topic_1 2024-05-15T14:45:18.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.786+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.786+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:45:18.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.786+0000 7fbd0cb19800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.787+0000 7fbd0cb19800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:45:18.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.789+0000 7fbbc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:18.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.791+0000 7fbd0cb19800 20 remove_watcher() i=0 2024-05-15T14:45:18.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.791+0000 7fbd0cb19800 2 removed watcher, disabling cache 2024-05-15T14:45:18.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.792+0000 7fbd0cb19800 20 remove_watcher() i=1 2024-05-15T14:45:18.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.793+0000 7fbd0cb19800 20 remove_watcher() i=2 2024-05-15T14:45:18.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.794+0000 7fbd0cb19800 20 remove_watcher() i=3 2024-05-15T14:45:18.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.795+0000 7fbd0cb19800 20 remove_watcher() i=4 2024-05-15T14:45:18.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.796+0000 7fbd0cb19800 20 remove_watcher() i=5 2024-05-15T14:45:18.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.797+0000 7fbd0cb19800 20 remove_watcher() i=6 2024-05-15T14:45:18.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.798+0000 7fbd0cb19800 20 remove_watcher() i=7 2024-05-15T14:45:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:18.854 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:18.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.895+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.897+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:18.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.897+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.898+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.898+0000 7f9b61331800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.898+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.898+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.898+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.899+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:18.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.899+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.899+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:18.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.899+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.899+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:18.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.899+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.900+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:18.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.900+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.900+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:18.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.900+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:18.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 20 zone MyZone found 2024-05-15T14:45:18.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:18.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:18.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:18.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:18.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:18.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:18.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.901+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.902+0000 7f9b61331800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:18.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.902+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.902+0000 7f9b61331800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:18.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.902+0000 7f9b61331800 20 started sync module instance, tier type = 2024-05-15T14:45:18.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.902+0000 7f9b61331800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:18.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 20 add_watcher() i=0 2024-05-15T14:45:18.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 20 add_watcher() i=1 2024-05-15T14:45:18.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 20 add_watcher() i=2 2024-05-15T14:45:18.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 20 add_watcher() i=3 2024-05-15T14:45:18.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 20 add_watcher() i=4 2024-05-15T14:45:18.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 20 add_watcher() i=5 2024-05-15T14:45:18.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 20 add_watcher() i=6 2024-05-15T14:45:18.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 20 add_watcher() i=7 2024-05-15T14:45:18.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.913+0000 7f9b61331800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:18.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.915+0000 7f9a137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:18.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.915+0000 7f9b61331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:18.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.915+0000 7f9b61331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.915+0000 7f9b61331800 5 note: GC not initialized 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9a127e4640 20 reqs_thread_entry: start 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9b61331800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9b61331800 20 Filter name: none 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9a0b7fe640 20 reqs_thread_entry: start 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9b61331800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9b61331800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9b61331800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9b61331800 10 cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9b61331800 10 cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_1 : miss 2024-05-15T14:45:18.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.916+0000 7f9b61331800 20 rados->read ofs=0 len=0 2024-05-15T14:45:18.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.917+0000 7f9b61331800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:45:18.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.917+0000 7f9b61331800 10 cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_1 info.flags=0x15 2024-05-15T14:45:18.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.917+0000 7f9b61331800 10 adding MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_1 to cache LRU end 2024-05-15T14:45:18.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.917+0000 7f9b61331800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_1 2024-05-15T14:45:18.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.918+0000 7f9b61331800 10 removing MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_1 from cache 2024-05-15T14:45:18.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.918+0000 7f9b61331800 10 distributing notification oid=MyZone.rgw.control:notify.5 cni=[op: 1, obj: MyZone.rgw.meta:topics:topic.:vwwrqh-22_topic_1, ofs0, ns] 2024-05-15T14:45:18.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.918+0000 7f9a33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724627 cookie 94054529091232 notifier 8198 bl.length()=169 2024-05-15T14:45:18.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.920+0000 7f9b61331800 10 distributing notification oid=MyZone.rgw.control:notify.2 cni=[op: 1, obj: MyZone.rgw.meta:topics:buckets.:vwwrqh-22_topic_1, ofs0, ns] 2024-05-15T14:45:18.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.920+0000 7f9a337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724571 cookie 94054529074800 notifier 8198 bl.length()=171 2024-05-15T14:45:18.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.923+0000 7f9b61331800 20 INFO: queue: :vwwrqh-22_topic_1 removed from queue list 2024-05-15T14:45:18.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.923+0000 7f9a137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:18.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.925+0000 7f9b61331800 20 remove_watcher() i=0 2024-05-15T14:45:18.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.925+0000 7f9b61331800 2 removed watcher, disabling cache 2024-05-15T14:45:18.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.926+0000 7f9b61331800 20 remove_watcher() i=1 2024-05-15T14:45:18.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.927+0000 7f9b61331800 20 remove_watcher() i=2 2024-05-15T14:45:18.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.928+0000 7f9b61331800 20 remove_watcher() i=3 2024-05-15T14:45:18.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.929+0000 7f9b61331800 20 remove_watcher() i=4 2024-05-15T14:45:18.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.930+0000 7f9b61331800 20 remove_watcher() i=5 2024-05-15T14:45:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.931+0000 7f9b61331800 20 remove_watcher() i=6 2024-05-15T14:45:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:18.932+0000 7f9b61331800 20 remove_watcher() i=7 2024-05-15T14:45:18.988 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:18.989 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:19.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.028+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.030+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.030+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.031+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.031+0000 7f96a092a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.031+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.031+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.031+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.031+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:19.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.031+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.032+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:19.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.032+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.032+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.032+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.032+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.032+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.033+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.033+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 zone MyZone found 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:19.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 started sync module instance, tier type = 2024-05-15T14:45:19.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.034+0000 7f96a092a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:19.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.044+0000 7f96a092a800 20 add_watcher() i=0 2024-05-15T14:45:19.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.044+0000 7f96a092a800 20 add_watcher() i=1 2024-05-15T14:45:19.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.044+0000 7f96a092a800 20 add_watcher() i=2 2024-05-15T14:45:19.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.044+0000 7f96a092a800 20 add_watcher() i=3 2024-05-15T14:45:19.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.044+0000 7f96a092a800 20 add_watcher() i=4 2024-05-15T14:45:19.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.044+0000 7f96a092a800 20 add_watcher() i=5 2024-05-15T14:45:19.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.044+0000 7f96a092a800 20 add_watcher() i=6 2024-05-15T14:45:19.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.045+0000 7f96a092a800 20 add_watcher() i=7 2024-05-15T14:45:19.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.045+0000 7f96a092a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:19.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.047+0000 7f9552fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.047+0000 7f96a092a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.047+0000 7f96a092a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.047+0000 7f96a092a800 5 note: GC not initialized 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.047+0000 7f9551fdb640 20 reqs_thread_entry: start 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 20 Filter name: none 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f94c37fe640 20 reqs_thread_entry: start 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:19.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 10 cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:45:19.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 10 cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_2 : miss 2024-05-15T14:45:19.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 20 rados_obj.operate() r=0 bl.length=230 2024-05-15T14:45:19.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 10 cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_2 info.flags=0x15 2024-05-15T14:45:19.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 10 adding MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_2 to cache LRU end 2024-05-15T14:45:19.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.048+0000 7f96a092a800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_2 2024-05-15T14:45:19.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.049+0000 7f96a092a800 10 removing MyZone.rgw.meta+topics+topic.:vwwrqh-22_topic_2 from cache 2024-05-15T14:45:19.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.049+0000 7f96a092a800 10 distributing notification oid=MyZone.rgw.control:notify.5 cni=[op: 1, obj: MyZone.rgw.meta:topics:topic.:vwwrqh-22_topic_2, ofs0, ns] 2024-05-15T14:45:19.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.050+0000 7f95737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724628 cookie 94215260925952 notifier 8625 bl.length()=169 2024-05-15T14:45:19.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.052+0000 7f96a092a800 20 WARNING: failed to remove topic buckets obj buckets.:vwwrqh-22_topic_2 with: (2) No such file or directory 2024-05-15T14:45:19.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.055+0000 7f96a092a800 20 INFO: queue: :vwwrqh-22_topic_2 removed from queue list 2024-05-15T14:45:19.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.056+0000 7f9552fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.058+0000 7f96a092a800 20 remove_watcher() i=0 2024-05-15T14:45:19.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.058+0000 7f96a092a800 2 removed watcher, disabling cache 2024-05-15T14:45:19.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.059+0000 7f96a092a800 20 remove_watcher() i=1 2024-05-15T14:45:19.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.060+0000 7f96a092a800 20 remove_watcher() i=2 2024-05-15T14:45:19.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.061+0000 7f96a092a800 20 remove_watcher() i=3 2024-05-15T14:45:19.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.062+0000 7f96a092a800 20 remove_watcher() i=4 2024-05-15T14:45:19.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.063+0000 7f96a092a800 20 remove_watcher() i=5 2024-05-15T14:45:19.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.064+0000 7f96a092a800 20 remove_watcher() i=6 2024-05-15T14:45:19.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.065+0000 7f96a092a800 20 remove_watcher() i=7 2024-05-15T14:45:19.129 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:19.129 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:19.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.168+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.170+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.170+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.171+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.171+0000 7fcd7f098800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:19.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.171+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.171+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.171+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.172+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:19.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.172+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.172+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:19.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.172+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.172+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.172+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.172+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.172+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.173+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.173+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 20 zone MyZone found 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.174+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.175+0000 7fcd7f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.175+0000 7fcd7f098800 20 started sync module instance, tier type = 2024-05-15T14:45:19.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.175+0000 7fcd7f098800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 20 add_watcher() i=0 2024-05-15T14:45:19.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 20 add_watcher() i=1 2024-05-15T14:45:19.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 20 add_watcher() i=2 2024-05-15T14:45:19.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 20 add_watcher() i=3 2024-05-15T14:45:19.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 20 add_watcher() i=4 2024-05-15T14:45:19.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 20 add_watcher() i=5 2024-05-15T14:45:19.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 20 add_watcher() i=6 2024-05-15T14:45:19.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 20 add_watcher() i=7 2024-05-15T14:45:19.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.185+0000 7fcd7f098800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:19.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.187+0000 7fcc32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.187+0000 7fcd7f098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.187+0000 7fcd7f098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.187+0000 7fcd7f098800 5 note: GC not initialized 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcc31fe3640 20 reqs_thread_entry: start 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 20 Filter name: none 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcba37fe640 20 reqs_thread_entry: start 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 10 cache get: name=MyZone.rgw.meta+users.uid+kaboom_1$superman1715784319.0773282 : miss 2024-05-15T14:45:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom_1$superman1715784319.0773282 info.flags=0x0 2024-05-15T14:45:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 10 adding MyZone.rgw.meta+users.uid+kaboom_1$superman1715784319.0773282 to cache LRU end 2024-05-15T14:45:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784319.077319 : miss 2024-05-15T14:45:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 10 cache put: name=MyZone.rgw.meta+users.keys+1715784319.077319 info.flags=0x0 2024-05-15T14:45:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.188+0000 7fcd7f098800 10 adding MyZone.rgw.meta+users.keys+1715784319.077319 to cache LRU end 2024-05-15T14:45:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.189+0000 7fcd7f098800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784319.077319 : hit (negative entry) 2024-05-15T14:45:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.189+0000 7fcd7f098800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784319.077319 : hit (negative entry) 2024-05-15T14:45:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.190+0000 7fcd7f098800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom_1$superman1715784319.0773282 info.flags=0x17 2024-05-15T14:45:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.190+0000 7fcd7f098800 10 moving MyZone.rgw.meta+users.uid+kaboom_1$superman1715784319.0773282 to cache LRU end 2024-05-15T14:45:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.190+0000 7fcd7f098800 10 distributing notification oid=MyZone.rgw.control:notify.3 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:kaboom_1$superman1715784319.0773282, ofs0, ns] 2024-05-15T14:45:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.190+0000 7fcc53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724560 cookie 93930625719936 notifier 8643 bl.length()=603 2024-05-15T14:45:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.190+0000 7fcc53fff640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+kaboom_1$superman1715784319.0773282 info.flags=0x17 2024-05-15T14:45:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.190+0000 7fcc53fff640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+kaboom_1$superman1715784319.0773282 to cache LRU end 2024-05-15T14:45:19.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.192+0000 7fcd7f098800 10 cache put: name=MyZone.rgw.meta+users.keys+1715784319.077319 info.flags=0x7 2024-05-15T14:45:19.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.192+0000 7fcd7f098800 10 moving MyZone.rgw.meta+users.keys+1715784319.077319 to cache LRU end 2024-05-15T14:45:19.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.192+0000 7fcd7f098800 10 distributing notification oid=MyZone.rgw.control:notify.5 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715784319.077319, ofs0, ns] 2024-05-15T14:45:19.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.192+0000 7fcc53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724629 cookie 93930625726464 notifier 8643 bl.length()=205 2024-05-15T14:45:19.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.192+0000 7fcc53fff640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715784319.077319 info.flags=0x7 2024-05-15T14:45:19.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.192+0000 7fcc53fff640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715784319.077319 to cache LRU end 2024-05-15T14:45:19.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.194+0000 7fcc32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.196+0000 7fcd7f098800 20 remove_watcher() i=0 2024-05-15T14:45:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.196+0000 7fcd7f098800 2 removed watcher, disabling cache 2024-05-15T14:45:19.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.197+0000 7fcd7f098800 20 remove_watcher() i=1 2024-05-15T14:45:19.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.198+0000 7fcd7f098800 20 remove_watcher() i=2 2024-05-15T14:45:19.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.199+0000 7fcd7f098800 20 remove_watcher() i=3 2024-05-15T14:45:19.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.200+0000 7fcd7f098800 20 remove_watcher() i=4 2024-05-15T14:45:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.201+0000 7fcd7f098800 20 remove_watcher() i=5 2024-05-15T14:45:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.202+0000 7fcd7f098800 20 remove_watcher() i=6 2024-05-15T14:45:19.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.203+0000 7fcd7f098800 20 remove_watcher() i=7 2024-05-15T14:45:19.261 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:19.261 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:19.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.300+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.302+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.302+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.302+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.302+0000 7f58f9613800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.302+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.303+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.303+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.303+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.303+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.304+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.304+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.304+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.304+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.304+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.304+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.305+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.305+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 20 zone MyZone found 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.306+0000 7f58f9613800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.307+0000 7f58f9613800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.307+0000 7f58f9613800 20 started sync module instance, tier type = 2024-05-15T14:45:19.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.307+0000 7f58f9613800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:19.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.316+0000 7f58f9613800 20 add_watcher() i=0 2024-05-15T14:45:19.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.316+0000 7f58f9613800 20 add_watcher() i=1 2024-05-15T14:45:19.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.316+0000 7f58f9613800 20 add_watcher() i=2 2024-05-15T14:45:19.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.316+0000 7f58f9613800 20 add_watcher() i=3 2024-05-15T14:45:19.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.316+0000 7f58f9613800 20 add_watcher() i=4 2024-05-15T14:45:19.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.316+0000 7f58f9613800 20 add_watcher() i=5 2024-05-15T14:45:19.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.316+0000 7f58f9613800 20 add_watcher() i=6 2024-05-15T14:45:19.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.317+0000 7f58f9613800 20 add_watcher() i=7 2024-05-15T14:45:19.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.317+0000 7f58f9613800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:19.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.318+0000 7f57ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.319+0000 7f58f9613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:19.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.319+0000 7f58f9613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:19.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.319+0000 7f58f9613800 5 note: GC not initialized 2024-05-15T14:45:19.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.319+0000 7f57aa7e4640 20 reqs_thread_entry: start 2024-05-15T14:45:19.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.319+0000 7f58f9613800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:19.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.319+0000 7f58f9613800 20 Filter name: none 2024-05-15T14:45:19.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.319+0000 7f57a37fe640 20 reqs_thread_entry: start 2024-05-15T14:45:19.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.329+0000 7f57ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.331+0000 7f58f9613800 20 remove_watcher() i=0 2024-05-15T14:45:19.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.331+0000 7f58f9613800 2 removed watcher, disabling cache 2024-05-15T14:45:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.332+0000 7f58f9613800 20 remove_watcher() i=1 2024-05-15T14:45:19.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.333+0000 7f58f9613800 20 remove_watcher() i=2 2024-05-15T14:45:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.334+0000 7f58f9613800 20 remove_watcher() i=3 2024-05-15T14:45:19.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.335+0000 7f58f9613800 20 remove_watcher() i=4 2024-05-15T14:45:19.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.336+0000 7f58f9613800 20 remove_watcher() i=5 2024-05-15T14:45:19.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.337+0000 7f58f9613800 20 remove_watcher() i=6 2024-05-15T14:45:19.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.338+0000 7f58f9613800 20 remove_watcher() i=7 2024-05-15T14:45:19.403 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:19.403 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:19.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.442+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.443+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.443+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.444+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.444+0000 7f27c572e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.444+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.444+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.444+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.445+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.445+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.445+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.445+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.445+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.445+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.446+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.446+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.446+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.446+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:19.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 20 zone MyZone found 2024-05-15T14:45:19.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:19.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:19.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:19.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.447+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.448+0000 7f27c572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.448+0000 7f27c572e800 20 started sync module instance, tier type = 2024-05-15T14:45:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.448+0000 7f27c572e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:19.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.458+0000 7f27c572e800 20 add_watcher() i=0 2024-05-15T14:45:19.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.458+0000 7f27c572e800 20 add_watcher() i=1 2024-05-15T14:45:19.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.458+0000 7f27c572e800 20 add_watcher() i=2 2024-05-15T14:45:19.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.458+0000 7f27c572e800 20 add_watcher() i=3 2024-05-15T14:45:19.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.458+0000 7f27c572e800 20 add_watcher() i=4 2024-05-15T14:45:19.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.458+0000 7f27c572e800 20 add_watcher() i=5 2024-05-15T14:45:19.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.458+0000 7f27c572e800 20 add_watcher() i=6 2024-05-15T14:45:19.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.459+0000 7f27c572e800 20 add_watcher() i=7 2024-05-15T14:45:19.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.459+0000 7f27c572e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:19.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.460+0000 7f26777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f27c572e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:19.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f27c572e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:19.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f27c572e800 5 note: GC not initialized 2024-05-15T14:45:19.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f26767e4640 20 reqs_thread_entry: start 2024-05-15T14:45:19.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f27c572e800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:19.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f27c572e800 20 Filter name: none 2024-05-15T14:45:19.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f25e7fff640 20 reqs_thread_entry: start 2024-05-15T14:45:19.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f27c572e800 10 cache get: name=MyZone.rgw.meta+users.uid+kaboom_2$superman1715784319.3502483 : miss 2024-05-15T14:45:19.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.461+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom_2$superman1715784319.3502483 info.flags=0x0 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 10 adding MyZone.rgw.meta+users.uid+kaboom_2$superman1715784319.3502483 to cache LRU end 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784319.3502338 : miss 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 10 cache put: name=MyZone.rgw.meta+users.keys+1715784319.3502338 info.flags=0x0 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 10 adding MyZone.rgw.meta+users.keys+1715784319.3502338 to cache LRU end 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784319.3502338 : hit (negative entry) 2024-05-15T14:45:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.462+0000 7f27c572e800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784319.3502338 : hit (negative entry) 2024-05-15T14:45:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.463+0000 7f27c572e800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom_2$superman1715784319.3502483 info.flags=0x17 2024-05-15T14:45:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.463+0000 7f27c572e800 10 moving MyZone.rgw.meta+users.uid+kaboom_2$superman1715784319.3502483 to cache LRU end 2024-05-15T14:45:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.463+0000 7f27c572e800 10 distributing notification oid=MyZone.rgw.control:notify.3 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:kaboom_2$superman1715784319.3502483, ofs0, ns] 2024-05-15T14:45:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.463+0000 7f26a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724561 cookie 94098292371712 notifier 8679 bl.length()=606 2024-05-15T14:45:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.463+0000 7f26a4ff9640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+kaboom_2$superman1715784319.3502483 info.flags=0x17 2024-05-15T14:45:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.463+0000 7f26a4ff9640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+kaboom_2$superman1715784319.3502483 to cache LRU end 2024-05-15T14:45:19.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.465+0000 7f27c572e800 10 cache put: name=MyZone.rgw.meta+users.keys+1715784319.3502338 info.flags=0x7 2024-05-15T14:45:19.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.465+0000 7f27c572e800 10 moving MyZone.rgw.meta+users.keys+1715784319.3502338 to cache LRU end 2024-05-15T14:45:19.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.465+0000 7f27c572e800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715784319.3502338, ofs0, ns] 2024-05-15T14:45:19.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.466+0000 7f26a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724611 cookie 94098292331808 notifier 8679 bl.length()=206 2024-05-15T14:45:19.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.466+0000 7f26a4ff9640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715784319.3502338 info.flags=0x7 2024-05-15T14:45:19.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.466+0000 7f26a4ff9640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715784319.3502338 to cache LRU end 2024-05-15T14:45:19.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.467+0000 7f26777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.469+0000 7f27c572e800 20 remove_watcher() i=0 2024-05-15T14:45:19.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.469+0000 7f27c572e800 2 removed watcher, disabling cache 2024-05-15T14:45:19.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.470+0000 7f27c572e800 20 remove_watcher() i=1 2024-05-15T14:45:19.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.471+0000 7f27c572e800 20 remove_watcher() i=2 2024-05-15T14:45:19.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.472+0000 7f27c572e800 20 remove_watcher() i=3 2024-05-15T14:45:19.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.473+0000 7f27c572e800 20 remove_watcher() i=4 2024-05-15T14:45:19.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.474+0000 7f27c572e800 20 remove_watcher() i=5 2024-05-15T14:45:19.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.475+0000 7f27c572e800 20 remove_watcher() i=6 2024-05-15T14:45:19.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.476+0000 7f27c572e800 20 remove_watcher() i=7 2024-05-15T14:45:19.533 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:19.533 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:19.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.572+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.574+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.574+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.575+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.575+0000 7fc478b2c800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:19.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.575+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.575+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.575+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.576+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:19.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.576+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.576+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:19.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.576+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.576+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.576+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.577+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.577+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.577+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.577+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 20 zone MyZone found 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.578+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.579+0000 7fc478b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.579+0000 7fc478b2c800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.579+0000 7fc478b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.579+0000 7fc478b2c800 20 started sync module instance, tier type = 2024-05-15T14:45:19.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.579+0000 7fc478b2c800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:19.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 20 add_watcher() i=0 2024-05-15T14:45:19.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 20 add_watcher() i=1 2024-05-15T14:45:19.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 20 add_watcher() i=2 2024-05-15T14:45:19.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 20 add_watcher() i=3 2024-05-15T14:45:19.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 20 add_watcher() i=4 2024-05-15T14:45:19.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 20 add_watcher() i=5 2024-05-15T14:45:19.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 20 add_watcher() i=6 2024-05-15T14:45:19.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 20 add_watcher() i=7 2024-05-15T14:45:19.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.589+0000 7fc478b2c800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:19.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.591+0000 7fc32afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.592+0000 7fc478b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:19.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.592+0000 7fc478b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:19.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.592+0000 7fc478b2c800 5 note: GC not initialized 2024-05-15T14:45:19.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.592+0000 7fc329fe3640 20 reqs_thread_entry: start 2024-05-15T14:45:19.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.592+0000 7fc478b2c800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:19.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.592+0000 7fc478b2c800 20 Filter name: none 2024-05-15T14:45:19.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.592+0000 7fc29b7fe640 20 reqs_thread_entry: start 2024-05-15T14:45:19.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.602+0000 7fc32afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.603+0000 7fc478b2c800 20 remove_watcher() i=0 2024-05-15T14:45:19.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.603+0000 7fc478b2c800 2 removed watcher, disabling cache 2024-05-15T14:45:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.605+0000 7fc478b2c800 20 remove_watcher() i=1 2024-05-15T14:45:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.605+0000 7fc478b2c800 20 remove_watcher() i=2 2024-05-15T14:45:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.606+0000 7fc478b2c800 20 remove_watcher() i=3 2024-05-15T14:45:19.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.607+0000 7fc478b2c800 20 remove_watcher() i=4 2024-05-15T14:45:19.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.608+0000 7fc478b2c800 20 remove_watcher() i=5 2024-05-15T14:45:19.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.609+0000 7fc478b2c800 20 remove_watcher() i=6 2024-05-15T14:45:19.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.610+0000 7fc478b2c800 20 remove_watcher() i=7 2024-05-15T14:45:19.666 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:19.667 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:19.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.696+0000 7fb42e135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:19.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.696+0000 7fb42e135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:19.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.700+0000 7fb25ffff640 20 reqs_thread_entry: start 2024-05-15T14:45:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.788+0000 7f851d536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.788+0000 7f851d536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.792+0000 7f83dc7e0640 20 reqs_thread_entry: start 2024-05-15T14:45:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.795+0000 7f851d536800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:45:19.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.808+0000 7f851d536800 20 updating latest_epoch from 4 -> 5 on period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:45:19.864 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.904+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.906+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.906+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.906+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.906+0000 7f1c21f2f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.906+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.907+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.907+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.907+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.907+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.908+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.908+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.908+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.908+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.908+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.908+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.909+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.909+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 zone MyZone found 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:5 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 rados->read ofs=0 len=0 2024-05-15T14:45:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 started sync module instance, tier type = 2024-05-15T14:45:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.910+0000 7f1c21f2f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:19.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.920+0000 7f1c21f2f800 20 add_watcher() i=0 2024-05-15T14:45:19.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.920+0000 7f1c21f2f800 20 add_watcher() i=1 2024-05-15T14:45:19.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.920+0000 7f1c21f2f800 20 add_watcher() i=2 2024-05-15T14:45:19.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.920+0000 7f1c21f2f800 20 add_watcher() i=3 2024-05-15T14:45:19.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.920+0000 7f1c21f2f800 20 add_watcher() i=4 2024-05-15T14:45:19.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.920+0000 7f1c21f2f800 20 add_watcher() i=5 2024-05-15T14:45:19.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.920+0000 7f1c21f2f800 20 add_watcher() i=6 2024-05-15T14:45:19.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.921+0000 7f1c21f2f800 20 add_watcher() i=7 2024-05-15T14:45:19.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.921+0000 7f1c21f2f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:19.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.922+0000 7f1acf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.923+0000 7f1c21f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:19.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.923+0000 7f1c21f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:19.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.923+0000 7f1c21f2f800 5 note: GC not initialized 2024-05-15T14:45:19.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.923+0000 7f1ace7fc640 20 reqs_thread_entry: start 2024-05-15T14:45:19.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.923+0000 7f1c21f2f800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:19.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.923+0000 7f1c21f2f800 20 Filter name: none 2024-05-15T14:45:19.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.923+0000 7f1a3ffff640 20 reqs_thread_entry: start 2024-05-15T14:45:19.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.925+0000 7f1c21f2f800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:45:19.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.927+0000 7f1c21f2f800 20 updating latest_epoch from 5 -> 6 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:45:19.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.932+0000 7f1c21f2f800 4 Committed new epoch 6 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:45:19.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.934+0000 7f1acf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:19.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.936+0000 7f1c21f2f800 20 remove_watcher() i=0 2024-05-15T14:45:19.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.936+0000 7f1c21f2f800 2 removed watcher, disabling cache 2024-05-15T14:45:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.937+0000 7f1c21f2f800 20 remove_watcher() i=1 2024-05-15T14:45:19.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.938+0000 7f1c21f2f800 20 remove_watcher() i=2 2024-05-15T14:45:19.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.939+0000 7f1c21f2f800 20 remove_watcher() i=3 2024-05-15T14:45:19.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.940+0000 7f1c21f2f800 20 remove_watcher() i=4 2024-05-15T14:45:19.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.941+0000 7f1c21f2f800 20 remove_watcher() i=5 2024-05-15T14:45:19.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.942+0000 7f1c21f2f800 20 remove_watcher() i=6 2024-05-15T14:45:19.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:19.943+0000 7f1c21f2f800 20 remove_watcher() i=7 2024-05-15T14:45:47.821 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:45:47.818+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:45:47.821 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:45:47.818+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:45:47.822 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:45:47.818+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:45:47.822 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:45:47.818+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:45:48.072 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:45:48.071+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:45:48.072 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:45:48.071+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:45:48.073 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:45:48.071+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:45:48.073 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:45:48.071+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:45:49.729 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:49.729 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.758+0000 7fcbf9d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.758+0000 7fcbf9d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:49.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.762+0000 7fca2bfff640 20 reqs_thread_entry: start 2024-05-15T14:45:49.820 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:49.820 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:49.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.849+0000 7f7df392e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:49.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.849+0000 7f7df392e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:49.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.853+0000 7f7c35ffb640 20 reqs_thread_entry: start 2024-05-15T14:45:49.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.856+0000 7f7df392e800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:45:49.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.870+0000 7f7df392e800 20 updating latest_epoch from 5 -> 6 on period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:45:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.965+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.966+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.966+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.967+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:49.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.967+0000 7fd1cdb23800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:49.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.967+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.967+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:49.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.967+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.968+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.968+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.968+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=1107 2024-05-15T14:45:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.968+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.969+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:49.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.969+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.969+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:49.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.969+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:49.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 20 zone MyZone found 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:6 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.970+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.971+0000 7fd1cdb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:49.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.971+0000 7fd1cdb23800 20 rados->read ofs=0 len=0 2024-05-15T14:45:49.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.971+0000 7fd1cdb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:49.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.971+0000 7fd1cdb23800 20 started sync module instance, tier type = 2024-05-15T14:45:49.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.971+0000 7fd1cdb23800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:49.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.981+0000 7fd1cdb23800 20 add_watcher() i=0 2024-05-15T14:45:49.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.981+0000 7fd1cdb23800 20 add_watcher() i=1 2024-05-15T14:45:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.981+0000 7fd1cdb23800 20 add_watcher() i=2 2024-05-15T14:45:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.981+0000 7fd1cdb23800 20 add_watcher() i=3 2024-05-15T14:45:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.981+0000 7fd1cdb23800 20 add_watcher() i=4 2024-05-15T14:45:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.981+0000 7fd1cdb23800 20 add_watcher() i=5 2024-05-15T14:45:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.981+0000 7fd1cdb23800 20 add_watcher() i=6 2024-05-15T14:45:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.982+0000 7fd1cdb23800 20 add_watcher() i=7 2024-05-15T14:45:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.982+0000 7fd1cdb23800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:49.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.983+0000 7fd07f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.984+0000 7fd1cdb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.984+0000 7fd1cdb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.984+0000 7fd1cdb23800 5 note: GC not initialized 2024-05-15T14:45:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.984+0000 7fd07e7e4640 20 reqs_thread_entry: start 2024-05-15T14:45:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.984+0000 7fd1cdb23800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.984+0000 7fd1cdb23800 20 Filter name: none 2024-05-15T14:45:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.984+0000 7fcfeffff640 20 reqs_thread_entry: start 2024-05-15T14:45:49.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.986+0000 7fd1cdb23800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:45:49.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.988+0000 7fd1cdb23800 20 updating latest_epoch from 6 -> 7 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:45:49.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.993+0000 7fd1cdb23800 4 Committed new epoch 7 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:45:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.997+0000 7fd07f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:50.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.999+0000 7fd1cdb23800 20 remove_watcher() i=0 2024-05-15T14:45:50.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:49.999+0000 7fd1cdb23800 2 removed watcher, disabling cache 2024-05-15T14:45:50.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.000+0000 7fd1cdb23800 20 remove_watcher() i=1 2024-05-15T14:45:50.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.001+0000 7fd1cdb23800 20 remove_watcher() i=2 2024-05-15T14:45:50.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.002+0000 7fd1cdb23800 20 remove_watcher() i=3 2024-05-15T14:45:50.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.003+0000 7fd1cdb23800 20 remove_watcher() i=4 2024-05-15T14:45:50.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.004+0000 7fd1cdb23800 20 remove_watcher() i=5 2024-05-15T14:45:50.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.005+0000 7fd1cdb23800 20 remove_watcher() i=6 2024-05-15T14:45:50.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.006+0000 7fd1cdb23800 20 remove_watcher() i=7 2024-05-15T14:45:50.064 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:50.064 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.106+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.107+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.107+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.108+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.108+0000 7f0309a12800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.108+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.108+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.108+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.109+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:50.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.109+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.110+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.110+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.110+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.110+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.110+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.110+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.111+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.111+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 zone MyZone found 2024-05-15T14:45:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 rados->read ofs=0 len=0 2024-05-15T14:45:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 started sync module instance, tier type = 2024-05-15T14:45:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.112+0000 7f0309a12800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:50.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.121+0000 7f0309a12800 20 add_watcher() i=0 2024-05-15T14:45:50.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.121+0000 7f0309a12800 20 add_watcher() i=1 2024-05-15T14:45:50.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.121+0000 7f0309a12800 20 add_watcher() i=2 2024-05-15T14:45:50.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.121+0000 7f0309a12800 20 add_watcher() i=3 2024-05-15T14:45:50.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.121+0000 7f0309a12800 20 add_watcher() i=4 2024-05-15T14:45:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.121+0000 7f0309a12800 20 add_watcher() i=5 2024-05-15T14:45:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.121+0000 7f0309a12800 20 add_watcher() i=6 2024-05-15T14:45:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.122+0000 7f0309a12800 20 add_watcher() i=7 2024-05-15T14:45:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.122+0000 7f0309a12800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.124+0000 7f01bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.124+0000 7f0309a12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.124+0000 7f0309a12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.124+0000 7f0309a12800 5 note: GC not initialized 2024-05-15T14:45:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.124+0000 7f01bafe5640 20 reqs_thread_entry: start 2024-05-15T14:45:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.125+0000 7f0309a12800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.125+0000 7f0309a12800 20 Filter name: none 2024-05-15T14:45:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.125+0000 7f01b8fe1640 20 reqs_thread_entry: start 2024-05-15T14:45:50.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.125+0000 7f0309a12800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:45:50.125+0000 7f0309a12800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:50.127 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:45:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.125+0000 7f0309a12800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.125+0000 7f0309a12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.125+0000 7f0309a12800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:50.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.126+0000 7f01bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.128+0000 7f0309a12800 20 remove_watcher() i=0 2024-05-15T14:45:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.128+0000 7f0309a12800 2 removed watcher, disabling cache 2024-05-15T14:45:50.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.129+0000 7f0309a12800 20 remove_watcher() i=1 2024-05-15T14:45:50.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.130+0000 7f0309a12800 20 remove_watcher() i=2 2024-05-15T14:45:50.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.131+0000 7f0309a12800 20 remove_watcher() i=3 2024-05-15T14:45:50.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.132+0000 7f0309a12800 20 remove_watcher() i=4 2024-05-15T14:45:50.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.133+0000 7f0309a12800 20 remove_watcher() i=5 2024-05-15T14:45:50.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.134+0000 7f0309a12800 20 remove_watcher() i=6 2024-05-15T14:45:50.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:50.135+0000 7f0309a12800 20 remove_watcher() i=7 2024-05-15T14:45:51.200 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:51.200 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:51.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.244+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.246+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:51.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.246+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.247+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:51.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.247+0000 7fab7e719800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:51.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.247+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.247+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:51.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.248+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.248+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:51.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.248+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.249+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:51.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.249+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.249+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:51.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.249+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.250+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:51.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.250+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.250+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:51.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.250+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 20 zone MyZone found 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.251+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.252+0000 7fab7e719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.252+0000 7fab7e719800 20 rados->read ofs=0 len=0 2024-05-15T14:45:51.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.252+0000 7fab7e719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:51.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.252+0000 7fab7e719800 20 started sync module instance, tier type = 2024-05-15T14:45:51.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.252+0000 7fab7e719800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:51.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.263+0000 7fab7e719800 20 add_watcher() i=0 2024-05-15T14:45:51.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.263+0000 7fab7e719800 20 add_watcher() i=1 2024-05-15T14:45:51.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.263+0000 7fab7e719800 20 add_watcher() i=2 2024-05-15T14:45:51.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.263+0000 7fab7e719800 20 add_watcher() i=3 2024-05-15T14:45:51.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.263+0000 7fab7e719800 20 add_watcher() i=4 2024-05-15T14:45:51.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.263+0000 7fab7e719800 20 add_watcher() i=5 2024-05-15T14:45:51.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.263+0000 7fab7e719800 20 add_watcher() i=6 2024-05-15T14:45:51.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.264+0000 7fab7e719800 20 add_watcher() i=7 2024-05-15T14:45:51.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.264+0000 7fab7e719800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:51.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.265+0000 7faa32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.266+0000 7fab7e719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.266+0000 7fab7e719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.266+0000 7fab7e719800 5 note: GC not initialized 2024-05-15T14:45:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.266+0000 7faa31fdb640 20 reqs_thread_entry: start 2024-05-15T14:45:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.266+0000 7fab7e719800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.266+0000 7fab7e719800 20 Filter name: none 2024-05-15T14:45:51.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.266+0000 7fa9a37fe640 20 reqs_thread_entry: start 2024-05-15T14:45:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.266+0000 7fab7e719800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.267+0000 7fab7e719800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:51.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.267+0000 7fab7e719800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:51.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.267+0000 7fab7e719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:51.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.267+0000 7fab7e719800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:51.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.268+0000 7faa32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:51.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.270+0000 7fab7e719800 20 remove_watcher() i=0 2024-05-15T14:45:51.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.270+0000 7fab7e719800 2 removed watcher, disabling cache 2024-05-15T14:45:51.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.271+0000 7fab7e719800 20 remove_watcher() i=1 2024-05-15T14:45:51.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.272+0000 7fab7e719800 20 remove_watcher() i=2 2024-05-15T14:45:51.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.273+0000 7fab7e719800 20 remove_watcher() i=3 2024-05-15T14:45:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.274+0000 7fab7e719800 20 remove_watcher() i=4 2024-05-15T14:45:51.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.275+0000 7fab7e719800 20 remove_watcher() i=5 2024-05-15T14:45:51.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.276+0000 7fab7e719800 20 remove_watcher() i=6 2024-05-15T14:45:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:51.277+0000 7fab7e719800 20 remove_watcher() i=7 2024-05-15T14:45:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.387+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.389+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:52.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.389+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.390+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:52.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.390+0000 7f6d6ad2d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:52.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.390+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.390+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:52.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.390+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.391+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:52.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.391+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.392+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:52.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.392+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.392+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:52.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.392+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.393+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:52.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.393+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.393+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:52.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.393+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 zone MyZone found 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 rados->read ofs=0 len=0 2024-05-15T14:45:52.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:52.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 started sync module instance, tier type = 2024-05-15T14:45:52.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.395+0000 7f6d6ad2d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:52.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.406+0000 7f6d6ad2d800 20 add_watcher() i=0 2024-05-15T14:45:52.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.406+0000 7f6d6ad2d800 20 add_watcher() i=1 2024-05-15T14:45:52.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.406+0000 7f6d6ad2d800 20 add_watcher() i=2 2024-05-15T14:45:52.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.406+0000 7f6d6ad2d800 20 add_watcher() i=3 2024-05-15T14:45:52.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.406+0000 7f6d6ad2d800 20 add_watcher() i=4 2024-05-15T14:45:52.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.406+0000 7f6d6ad2d800 20 add_watcher() i=5 2024-05-15T14:45:52.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.406+0000 7f6d6ad2d800 20 add_watcher() i=6 2024-05-15T14:45:52.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.407+0000 7f6d6ad2d800 20 add_watcher() i=7 2024-05-15T14:45:52.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.407+0000 7f6d6ad2d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:52.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.409+0000 7f6c1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.409+0000 7f6d6ad2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.409+0000 7f6d6ad2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.409+0000 7f6d6ad2d800 5 note: GC not initialized 2024-05-15T14:45:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6b97fff640 20 reqs_thread_entry: start 2024-05-15T14:45:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6d6ad2d800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6d6ad2d800 20 Filter name: none 2024-05-15T14:45:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6b95ffb640 20 reqs_thread_entry: start 2024-05-15T14:45:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6d6ad2d800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:52.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6d6ad2d800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:52.412 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:52.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6d6ad2d800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:52.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6d6ad2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:52.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.410+0000 7f6d6ad2d800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:52.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.411+0000 7f6c1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:52.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.414+0000 7f6d6ad2d800 20 remove_watcher() i=0 2024-05-15T14:45:52.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.414+0000 7f6d6ad2d800 2 removed watcher, disabling cache 2024-05-15T14:45:52.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.415+0000 7f6d6ad2d800 20 remove_watcher() i=1 2024-05-15T14:45:52.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.416+0000 7f6d6ad2d800 20 remove_watcher() i=2 2024-05-15T14:45:52.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.417+0000 7f6d6ad2d800 20 remove_watcher() i=3 2024-05-15T14:45:52.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.418+0000 7f6d6ad2d800 20 remove_watcher() i=4 2024-05-15T14:45:52.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.419+0000 7f6d6ad2d800 20 remove_watcher() i=5 2024-05-15T14:45:52.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.420+0000 7f6d6ad2d800 20 remove_watcher() i=6 2024-05-15T14:45:52.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:52.421+0000 7f6d6ad2d800 20 remove_watcher() i=7 2024-05-15T14:45:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:53.490 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.534+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.536+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.536+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.537+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.537+0000 7fc74b434800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.537+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.538+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.538+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.538+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.538+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.539+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.539+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.539+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.540+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.540+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.540+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.541+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.541+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.541+0000 7fc74b434800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.541+0000 7fc74b434800 20 zone MyZone found 2024-05-15T14:45:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.541+0000 7fc74b434800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.541+0000 7fc74b434800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.541+0000 7fc74b434800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 20 rados->read ofs=0 len=0 2024-05-15T14:45:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 20 started sync module instance, tier type = 2024-05-15T14:45:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.542+0000 7fc74b434800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 20 add_watcher() i=0 2024-05-15T14:45:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 20 add_watcher() i=1 2024-05-15T14:45:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 20 add_watcher() i=2 2024-05-15T14:45:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 20 add_watcher() i=3 2024-05-15T14:45:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 20 add_watcher() i=4 2024-05-15T14:45:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 20 add_watcher() i=5 2024-05-15T14:45:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 20 add_watcher() i=6 2024-05-15T14:45:53.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 20 add_watcher() i=7 2024-05-15T14:45:53.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.553+0000 7fc74b434800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.555+0000 7fc5fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.556+0000 7fc74b434800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.556+0000 7fc74b434800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.556+0000 7fc74b434800 5 note: GC not initialized 2024-05-15T14:45:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.556+0000 7fc5fdfe3640 20 reqs_thread_entry: start 2024-05-15T14:45:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.556+0000 7fc74b434800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.556+0000 7fc74b434800 20 Filter name: none 2024-05-15T14:45:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.556+0000 7fc56f7fe640 20 reqs_thread_entry: start 2024-05-15T14:45:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.557+0000 7fc74b434800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.557+0000 7fc74b434800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.557+0000 7fc74b434800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.557+0000 7fc74b434800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.557+0000 7fc74b434800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.558+0000 7fc5fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.560+0000 7fc74b434800 20 remove_watcher() i=0 2024-05-15T14:45:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.560+0000 7fc74b434800 2 removed watcher, disabling cache 2024-05-15T14:45:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.561+0000 7fc74b434800 20 remove_watcher() i=1 2024-05-15T14:45:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.562+0000 7fc74b434800 20 remove_watcher() i=2 2024-05-15T14:45:53.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.564+0000 7fc74b434800 20 remove_watcher() i=3 2024-05-15T14:45:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.565+0000 7fc74b434800 20 remove_watcher() i=4 2024-05-15T14:45:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.566+0000 7fc74b434800 20 remove_watcher() i=5 2024-05-15T14:45:53.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.567+0000 7fc74b434800 20 remove_watcher() i=6 2024-05-15T14:45:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:53.568+0000 7fc74b434800 20 remove_watcher() i=7 2024-05-15T14:45:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:54.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.678+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.680+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:54.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.680+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.681+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:54.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.681+0000 7f111f52b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:54.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.681+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.682+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:54.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.682+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.682+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:54.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.682+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.683+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:54.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.683+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.684+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:54.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.684+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.684+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:54.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.684+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.685+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:54.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.685+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:54.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 zone MyZone found 2024-05-15T14:45:54.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:54.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:54.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 rados->read ofs=0 len=0 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 started sync module instance, tier type = 2024-05-15T14:45:54.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.686+0000 7f111f52b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:54.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.697+0000 7f111f52b800 20 add_watcher() i=0 2024-05-15T14:45:54.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.697+0000 7f111f52b800 20 add_watcher() i=1 2024-05-15T14:45:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.697+0000 7f111f52b800 20 add_watcher() i=2 2024-05-15T14:45:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.697+0000 7f111f52b800 20 add_watcher() i=3 2024-05-15T14:45:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.697+0000 7f111f52b800 20 add_watcher() i=4 2024-05-15T14:45:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.697+0000 7f111f52b800 20 add_watcher() i=5 2024-05-15T14:45:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.697+0000 7f111f52b800 20 add_watcher() i=6 2024-05-15T14:45:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.698+0000 7f111f52b800 20 add_watcher() i=7 2024-05-15T14:45:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.698+0000 7f111f52b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.700+0000 7f0fd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.700+0000 7f111f52b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.700+0000 7f111f52b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.700+0000 7f111f52b800 5 note: GC not initialized 2024-05-15T14:45:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.701+0000 7f0fd0fe1640 20 reqs_thread_entry: start 2024-05-15T14:45:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.701+0000 7f111f52b800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.701+0000 7f111f52b800 20 Filter name: none 2024-05-15T14:45:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.701+0000 7f0f4a7fc640 20 reqs_thread_entry: start 2024-05-15T14:45:54.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.701+0000 7f111f52b800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:54.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.701+0000 7f111f52b800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:54.703 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:45:54.701+0000 7f111f52b800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:54.703 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:45:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.701+0000 7f111f52b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.701+0000 7f111f52b800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.702+0000 7f0fd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:54.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.705+0000 7f111f52b800 20 remove_watcher() i=0 2024-05-15T14:45:54.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.705+0000 7f111f52b800 2 removed watcher, disabling cache 2024-05-15T14:45:54.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.706+0000 7f111f52b800 20 remove_watcher() i=1 2024-05-15T14:45:54.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.707+0000 7f111f52b800 20 remove_watcher() i=2 2024-05-15T14:45:54.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.708+0000 7f111f52b800 20 remove_watcher() i=3 2024-05-15T14:45:54.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.709+0000 7f111f52b800 20 remove_watcher() i=4 2024-05-15T14:45:54.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.711+0000 7f111f52b800 20 remove_watcher() i=5 2024-05-15T14:45:54.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.712+0000 7f111f52b800 20 remove_watcher() i=6 2024-05-15T14:45:54.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:54.713+0000 7f111f52b800 20 remove_watcher() i=7 2024-05-15T14:45:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:55.778 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:55.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.824+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.826+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:55.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.826+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.827+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.827+0000 7f1103e3a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:55.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.827+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.827+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:55.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.827+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.828+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:55.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.828+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.829+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:55.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.829+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.829+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:55.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.829+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.829+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.830+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.830+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:55.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.830+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 20 zone MyZone found 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.831+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.832+0000 7f1103e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:55.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.832+0000 7f1103e3a800 20 rados->read ofs=0 len=0 2024-05-15T14:45:55.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.832+0000 7f1103e3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:55.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.832+0000 7f1103e3a800 20 started sync module instance, tier type = 2024-05-15T14:45:55.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.832+0000 7f1103e3a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:55.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 20 add_watcher() i=0 2024-05-15T14:45:55.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 20 add_watcher() i=1 2024-05-15T14:45:55.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 20 add_watcher() i=2 2024-05-15T14:45:55.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 20 add_watcher() i=3 2024-05-15T14:45:55.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 20 add_watcher() i=4 2024-05-15T14:45:55.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 20 add_watcher() i=5 2024-05-15T14:45:55.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 20 add_watcher() i=6 2024-05-15T14:45:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 20 add_watcher() i=7 2024-05-15T14:45:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.843+0000 7f1103e3a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:55.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.845+0000 7f0fb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:55.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.846+0000 7f1103e3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:55.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.846+0000 7f1103e3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:55.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.846+0000 7f1103e3a800 5 note: GC not initialized 2024-05-15T14:45:55.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.846+0000 7f0f2ffff640 20 reqs_thread_entry: start 2024-05-15T14:45:55.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.846+0000 7f1103e3a800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:55.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.846+0000 7f1103e3a800 20 Filter name: none 2024-05-15T14:45:55.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.846+0000 7f0f2dffb640 20 reqs_thread_entry: start 2024-05-15T14:45:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.846+0000 7f1103e3a800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.847+0000 7f1103e3a800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.847+0000 7f1103e3a800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.847+0000 7f1103e3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.847+0000 7f1103e3a800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:55.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.848+0000 7f0fb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.850+0000 7f1103e3a800 20 remove_watcher() i=0 2024-05-15T14:45:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.850+0000 7f1103e3a800 2 removed watcher, disabling cache 2024-05-15T14:45:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.851+0000 7f1103e3a800 20 remove_watcher() i=1 2024-05-15T14:45:55.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.852+0000 7f1103e3a800 20 remove_watcher() i=2 2024-05-15T14:45:55.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.853+0000 7f1103e3a800 20 remove_watcher() i=3 2024-05-15T14:45:55.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.854+0000 7f1103e3a800 20 remove_watcher() i=4 2024-05-15T14:45:55.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.855+0000 7f1103e3a800 20 remove_watcher() i=5 2024-05-15T14:45:55.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.856+0000 7f1103e3a800 20 remove_watcher() i=6 2024-05-15T14:45:55.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:55.857+0000 7f1103e3a800 20 remove_watcher() i=7 2024-05-15T14:45:56.924 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:56.924 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.968+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.969+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:56.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.969+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.970+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:56.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.970+0000 7fec04d3e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:56.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.970+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.971+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:56.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.971+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.971+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:56.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.971+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.972+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.972+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.973+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.973+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.973+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:56.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.973+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.974+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:56.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.974+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 zone MyZone found 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 rados->read ofs=0 len=0 2024-05-15T14:45:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 started sync module instance, tier type = 2024-05-15T14:45:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.975+0000 7fec04d3e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.986+0000 7fec04d3e800 20 add_watcher() i=0 2024-05-15T14:45:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.986+0000 7fec04d3e800 20 add_watcher() i=1 2024-05-15T14:45:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.986+0000 7fec04d3e800 20 add_watcher() i=2 2024-05-15T14:45:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.986+0000 7fec04d3e800 20 add_watcher() i=3 2024-05-15T14:45:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.986+0000 7fec04d3e800 20 add_watcher() i=4 2024-05-15T14:45:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.986+0000 7fec04d3e800 20 add_watcher() i=5 2024-05-15T14:45:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.986+0000 7fec04d3e800 20 add_watcher() i=6 2024-05-15T14:45:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.987+0000 7fec04d3e800 20 add_watcher() i=7 2024-05-15T14:45:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.987+0000 7fec04d3e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:56.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.989+0000 7feab97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.989+0000 7fec04d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.989+0000 7fec04d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.989+0000 7fec04d3e800 5 note: GC not initialized 2024-05-15T14:45:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.989+0000 7fea33fff640 20 reqs_thread_entry: start 2024-05-15T14:45:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.989+0000 7fec04d3e800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.989+0000 7fec04d3e800 20 Filter name: none 2024-05-15T14:45:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.990+0000 7fea31ffb640 20 reqs_thread_entry: start 2024-05-15T14:45:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.990+0000 7fec04d3e800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:56.992 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:45:56.990+0000 7fec04d3e800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:56.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.990+0000 7fec04d3e800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:56.992 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:45:56.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.990+0000 7fec04d3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:56.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.990+0000 7fec04d3e800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:56.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.991+0000 7feab97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:56.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.994+0000 7fec04d3e800 20 remove_watcher() i=0 2024-05-15T14:45:56.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.994+0000 7fec04d3e800 2 removed watcher, disabling cache 2024-05-15T14:45:56.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.995+0000 7fec04d3e800 20 remove_watcher() i=1 2024-05-15T14:45:56.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.996+0000 7fec04d3e800 20 remove_watcher() i=2 2024-05-15T14:45:56.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.997+0000 7fec04d3e800 20 remove_watcher() i=3 2024-05-15T14:45:56.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.998+0000 7fec04d3e800 20 remove_watcher() i=4 2024-05-15T14:45:57.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:56.999+0000 7fec04d3e800 20 remove_watcher() i=5 2024-05-15T14:45:57.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:57.000+0000 7fec04d3e800 20 remove_watcher() i=6 2024-05-15T14:45:57.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:57.001+0000 7fec04d3e800 20 remove_watcher() i=7 2024-05-15T14:45:58.068 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:58.069 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:58.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.113+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.114+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:58.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.114+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.115+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:58.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.115+0000 7f4d83940800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:58.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.115+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.116+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:58.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.116+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.116+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.117+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.117+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.118+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.118+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.118+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.118+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.118+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.119+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.119+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 20 zone MyZone found 2024-05-15T14:45:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.120+0000 7f4d83940800 20 rados->read ofs=0 len=0 2024-05-15T14:45:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.121+0000 7f4d83940800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.121+0000 7f4d83940800 20 started sync module instance, tier type = 2024-05-15T14:45:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.121+0000 7f4d83940800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:58.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.132+0000 7f4d83940800 20 add_watcher() i=0 2024-05-15T14:45:58.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.132+0000 7f4d83940800 20 add_watcher() i=1 2024-05-15T14:45:58.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.132+0000 7f4d83940800 20 add_watcher() i=2 2024-05-15T14:45:58.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.132+0000 7f4d83940800 20 add_watcher() i=3 2024-05-15T14:45:58.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.132+0000 7f4d83940800 20 add_watcher() i=4 2024-05-15T14:45:58.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.132+0000 7f4d83940800 20 add_watcher() i=5 2024-05-15T14:45:58.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.132+0000 7f4d83940800 20 add_watcher() i=6 2024-05-15T14:45:58.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.133+0000 7f4d83940800 20 add_watcher() i=7 2024-05-15T14:45:58.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.133+0000 7f4d83940800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:58.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.134+0000 7f4c377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:58.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.135+0000 7f4d83940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:58.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.135+0000 7f4d83940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:58.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.135+0000 7f4d83940800 5 note: GC not initialized 2024-05-15T14:45:58.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.135+0000 7f4c367e4640 20 reqs_thread_entry: start 2024-05-15T14:45:58.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.135+0000 7f4d83940800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:58.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.135+0000 7f4d83940800 20 Filter name: none 2024-05-15T14:45:58.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.135+0000 7f4ba7fff640 20 reqs_thread_entry: start 2024-05-15T14:45:58.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.135+0000 7f4d83940800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:58.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.136+0000 7f4d83940800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:58.139 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:58.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.136+0000 7f4d83940800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:58.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.136+0000 7f4d83940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:58.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.136+0000 7f4d83940800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:58.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.137+0000 7f4c377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:58.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.139+0000 7f4d83940800 20 remove_watcher() i=0 2024-05-15T14:45:58.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.139+0000 7f4d83940800 2 removed watcher, disabling cache 2024-05-15T14:45:58.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.140+0000 7f4d83940800 20 remove_watcher() i=1 2024-05-15T14:45:58.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.141+0000 7f4d83940800 20 remove_watcher() i=2 2024-05-15T14:45:58.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.142+0000 7f4d83940800 20 remove_watcher() i=3 2024-05-15T14:45:58.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.143+0000 7f4d83940800 20 remove_watcher() i=4 2024-05-15T14:45:58.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.144+0000 7f4d83940800 20 remove_watcher() i=5 2024-05-15T14:45:58.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.145+0000 7f4d83940800 20 remove_watcher() i=6 2024-05-15T14:45:58.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:58.147+0000 7f4d83940800 20 remove_watcher() i=7 2024-05-15T14:45:59.213 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:45:59.213 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:45:59.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.258+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.260+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:59.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.260+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.261+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.261+0000 7f2701d35800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:45:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.261+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.261+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.261+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.262+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:45:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.262+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.263+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:45:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.263+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.263+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.263+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.263+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:45:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.263+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.264+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:45:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.264+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 20 zone MyZone found 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 20 period zonegroup name MyZoneGroup 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.265+0000 7f2701d35800 20 rados->read ofs=0 len=0 2024-05-15T14:45:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.266+0000 7f2701d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:45:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.266+0000 7f2701d35800 20 started sync module instance, tier type = 2024-05-15T14:45:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.266+0000 7f2701d35800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:45:59.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.276+0000 7f2701d35800 20 add_watcher() i=0 2024-05-15T14:45:59.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.276+0000 7f2701d35800 20 add_watcher() i=1 2024-05-15T14:45:59.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.277+0000 7f2701d35800 20 add_watcher() i=2 2024-05-15T14:45:59.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.277+0000 7f2701d35800 20 add_watcher() i=3 2024-05-15T14:45:59.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.277+0000 7f2701d35800 20 add_watcher() i=4 2024-05-15T14:45:59.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.277+0000 7f2701d35800 20 add_watcher() i=5 2024-05-15T14:45:59.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.277+0000 7f2701d35800 20 add_watcher() i=6 2024-05-15T14:45:59.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.278+0000 7f2701d35800 20 add_watcher() i=7 2024-05-15T14:45:59.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.278+0000 7f2701d35800 2 all 8 watchers are set, enabling cache 2024-05-15T14:45:59.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.279+0000 7f25af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:59.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.280+0000 7f2701d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:45:59.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.280+0000 7f2701d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:45:59.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.280+0000 7f2701d35800 5 note: GC not initialized 2024-05-15T14:45:59.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.280+0000 7f25ae7fc640 20 reqs_thread_entry: start 2024-05-15T14:45:59.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.280+0000 7f2701d35800 20 init_complete bucket index max shards: 11 2024-05-15T14:45:59.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.280+0000 7f2701d35800 20 Filter name: none 2024-05-15T14:45:59.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.280+0000 7f251ffff640 20 reqs_thread_entry: start 2024-05-15T14:45:59.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.280+0000 7f2701d35800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:45:59.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.281+0000 7f2701d35800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:45:59.282 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:45:59.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.281+0000 7f2701d35800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:45:59.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.281+0000 7f2701d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:45:59.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.281+0000 7f2701d35800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:45:59.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.282+0000 7f25af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:45:59.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.284+0000 7f2701d35800 20 remove_watcher() i=0 2024-05-15T14:45:59.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.284+0000 7f2701d35800 2 removed watcher, disabling cache 2024-05-15T14:45:59.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.285+0000 7f2701d35800 20 remove_watcher() i=1 2024-05-15T14:45:59.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.286+0000 7f2701d35800 20 remove_watcher() i=2 2024-05-15T14:45:59.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.287+0000 7f2701d35800 20 remove_watcher() i=3 2024-05-15T14:45:59.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.288+0000 7f2701d35800 20 remove_watcher() i=4 2024-05-15T14:45:59.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.289+0000 7f2701d35800 20 remove_watcher() i=5 2024-05-15T14:45:59.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.290+0000 7f2701d35800 20 remove_watcher() i=6 2024-05-15T14:45:59.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:45:59.291+0000 7f2701d35800 20 remove_watcher() i=7 2024-05-15T14:46:00.358 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:00.358 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:00.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.403+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.404+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.404+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.405+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.405+0000 7f1131b46800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.405+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.406+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.406+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.406+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.406+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.407+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:00.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.407+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.408+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.408+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.408+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.408+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.409+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.409+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 zone MyZone found 2024-05-15T14:46:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 rados->read ofs=0 len=0 2024-05-15T14:46:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 started sync module instance, tier type = 2024-05-15T14:46:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.410+0000 7f1131b46800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:00.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.421+0000 7f1131b46800 20 add_watcher() i=0 2024-05-15T14:46:00.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.421+0000 7f1131b46800 20 add_watcher() i=1 2024-05-15T14:46:00.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.421+0000 7f1131b46800 20 add_watcher() i=2 2024-05-15T14:46:00.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.421+0000 7f1131b46800 20 add_watcher() i=3 2024-05-15T14:46:00.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.421+0000 7f1131b46800 20 add_watcher() i=4 2024-05-15T14:46:00.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.421+0000 7f1131b46800 20 add_watcher() i=5 2024-05-15T14:46:00.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.421+0000 7f1131b46800 20 add_watcher() i=6 2024-05-15T14:46:00.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.422+0000 7f1131b46800 20 add_watcher() i=7 2024-05-15T14:46:00.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.422+0000 7f1131b46800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:00.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.424+0000 7f0fe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:00.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.424+0000 7f1131b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:00.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.424+0000 7f1131b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:00.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.424+0000 7f1131b46800 5 note: GC not initialized 2024-05-15T14:46:00.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.424+0000 7f0fe4fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:00.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.424+0000 7f1131b46800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:00.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.424+0000 7f1131b46800 20 Filter name: none 2024-05-15T14:46:00.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.425+0000 7f0f5e7fc640 20 reqs_thread_entry: start 2024-05-15T14:46:00.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.425+0000 7f1131b46800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:00.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.425+0000 7f1131b46800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:00.427 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:00.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.425+0000 7f1131b46800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:00.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.425+0000 7f1131b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:00.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.425+0000 7f1131b46800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:00.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.426+0000 7f0fe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.428+0000 7f1131b46800 20 remove_watcher() i=0 2024-05-15T14:46:00.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.428+0000 7f1131b46800 2 removed watcher, disabling cache 2024-05-15T14:46:00.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.430+0000 7f1131b46800 20 remove_watcher() i=1 2024-05-15T14:46:00.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.431+0000 7f1131b46800 20 remove_watcher() i=2 2024-05-15T14:46:00.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.432+0000 7f1131b46800 20 remove_watcher() i=3 2024-05-15T14:46:00.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.433+0000 7f1131b46800 20 remove_watcher() i=4 2024-05-15T14:46:00.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.434+0000 7f1131b46800 20 remove_watcher() i=5 2024-05-15T14:46:00.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.435+0000 7f1131b46800 20 remove_watcher() i=6 2024-05-15T14:46:00.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:00.436+0000 7f1131b46800 20 remove_watcher() i=7 2024-05-15T14:46:01.502 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:01.502 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:01.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.546+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.548+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:01.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.548+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.549+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:01.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.549+0000 7f7d73340800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:01.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.549+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.549+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:01.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.549+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.550+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:01.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.550+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.551+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:01.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.551+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.552+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:01.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.552+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.552+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:01.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.552+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.553+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:01.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.553+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 zone MyZone found 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 rados->read ofs=0 len=0 2024-05-15T14:46:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 started sync module instance, tier type = 2024-05-15T14:46:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.554+0000 7f7d73340800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.565+0000 7f7d73340800 20 add_watcher() i=0 2024-05-15T14:46:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.565+0000 7f7d73340800 20 add_watcher() i=1 2024-05-15T14:46:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.565+0000 7f7d73340800 20 add_watcher() i=2 2024-05-15T14:46:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.565+0000 7f7d73340800 20 add_watcher() i=3 2024-05-15T14:46:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.565+0000 7f7d73340800 20 add_watcher() i=4 2024-05-15T14:46:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.565+0000 7f7d73340800 20 add_watcher() i=5 2024-05-15T14:46:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.565+0000 7f7d73340800 20 add_watcher() i=6 2024-05-15T14:46:01.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.566+0000 7f7d73340800 20 add_watcher() i=7 2024-05-15T14:46:01.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.566+0000 7f7d73340800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:01.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.567+0000 7f7c277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:01.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.568+0000 7f7d73340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:01.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.568+0000 7f7d73340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:01.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.568+0000 7f7d73340800 5 note: GC not initialized 2024-05-15T14:46:01.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.568+0000 7f7c267e4640 20 reqs_thread_entry: start 2024-05-15T14:46:01.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.568+0000 7f7d73340800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:01.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.568+0000 7f7d73340800 20 Filter name: none 2024-05-15T14:46:01.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.568+0000 7f7c1f7fe640 20 reqs_thread_entry: start 2024-05-15T14:46:01.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.568+0000 7f7d73340800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:01.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.569+0000 7f7d73340800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:01.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.569+0000 7f7d73340800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:01.570 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:01.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.569+0000 7f7d73340800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:01.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.569+0000 7f7d73340800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:01.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.570+0000 7f7c277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:01.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.572+0000 7f7d73340800 20 remove_watcher() i=0 2024-05-15T14:46:01.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.572+0000 7f7d73340800 2 removed watcher, disabling cache 2024-05-15T14:46:01.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.573+0000 7f7d73340800 20 remove_watcher() i=1 2024-05-15T14:46:01.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.574+0000 7f7d73340800 20 remove_watcher() i=2 2024-05-15T14:46:01.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.575+0000 7f7d73340800 20 remove_watcher() i=3 2024-05-15T14:46:01.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.576+0000 7f7d73340800 20 remove_watcher() i=4 2024-05-15T14:46:01.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.578+0000 7f7d73340800 20 remove_watcher() i=5 2024-05-15T14:46:01.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.579+0000 7f7d73340800 20 remove_watcher() i=6 2024-05-15T14:46:01.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:01.580+0000 7f7d73340800 20 remove_watcher() i=7 2024-05-15T14:46:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.691+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.692+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:02.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.693+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.693+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.693+0000 7f932d63f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.693+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.694+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.694+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.694+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.694+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.695+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.695+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.696+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.696+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.696+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.696+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.697+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:02.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.697+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 20 zone MyZone found 2024-05-15T14:46:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:02.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.698+0000 7f932d63f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.699+0000 7f932d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.699+0000 7f932d63f800 20 started sync module instance, tier type = 2024-05-15T14:46:02.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.699+0000 7f932d63f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:02.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 20 add_watcher() i=0 2024-05-15T14:46:02.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 20 add_watcher() i=1 2024-05-15T14:46:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 20 add_watcher() i=2 2024-05-15T14:46:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 20 add_watcher() i=3 2024-05-15T14:46:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 20 add_watcher() i=4 2024-05-15T14:46:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 20 add_watcher() i=5 2024-05-15T14:46:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 20 add_watcher() i=6 2024-05-15T14:46:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 20 add_watcher() i=7 2024-05-15T14:46:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.710+0000 7f932d63f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.712+0000 7f91e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.713+0000 7f932d63f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.713+0000 7f932d63f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.713+0000 7f932d63f800 5 note: GC not initialized 2024-05-15T14:46:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.713+0000 7f91e0fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.713+0000 7f932d63f800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.713+0000 7f932d63f800 20 Filter name: none 2024-05-15T14:46:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.713+0000 7f915a7fc640 20 reqs_thread_entry: start 2024-05-15T14:46:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.713+0000 7f932d63f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.714+0000 7f932d63f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.714+0000 7f932d63f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:02.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.714+0000 7f932d63f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:02.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.714+0000 7f932d63f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:02.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.715+0000 7f91e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.717+0000 7f932d63f800 20 remove_watcher() i=0 2024-05-15T14:46:02.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.717+0000 7f932d63f800 2 removed watcher, disabling cache 2024-05-15T14:46:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.718+0000 7f932d63f800 20 remove_watcher() i=1 2024-05-15T14:46:02.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.719+0000 7f932d63f800 20 remove_watcher() i=2 2024-05-15T14:46:02.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.720+0000 7f932d63f800 20 remove_watcher() i=3 2024-05-15T14:46:02.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.721+0000 7f932d63f800 20 remove_watcher() i=4 2024-05-15T14:46:02.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.722+0000 7f932d63f800 20 remove_watcher() i=5 2024-05-15T14:46:02.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.723+0000 7f932d63f800 20 remove_watcher() i=6 2024-05-15T14:46:02.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:02.724+0000 7f932d63f800 20 remove_watcher() i=7 2024-05-15T14:46:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:03.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.836+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.837+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:03.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.837+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.838+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.838+0000 7efc657a2800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.838+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.839+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.839+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.839+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.839+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.840+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.840+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.841+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.841+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.841+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.841+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.842+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:03.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.842+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:03.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 20 zone MyZone found 2024-05-15T14:46:03.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:03.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.843+0000 7efc657a2800 20 rados->read ofs=0 len=0 2024-05-15T14:46:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.844+0000 7efc657a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.844+0000 7efc657a2800 20 started sync module instance, tier type = 2024-05-15T14:46:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.844+0000 7efc657a2800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:03.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.854+0000 7efc657a2800 20 add_watcher() i=0 2024-05-15T14:46:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.854+0000 7efc657a2800 20 add_watcher() i=1 2024-05-15T14:46:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.854+0000 7efc657a2800 20 add_watcher() i=2 2024-05-15T14:46:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.854+0000 7efc657a2800 20 add_watcher() i=3 2024-05-15T14:46:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.854+0000 7efc657a2800 20 add_watcher() i=4 2024-05-15T14:46:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.854+0000 7efc657a2800 20 add_watcher() i=5 2024-05-15T14:46:03.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.854+0000 7efc657a2800 20 add_watcher() i=6 2024-05-15T14:46:03.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.855+0000 7efc657a2800 20 add_watcher() i=7 2024-05-15T14:46:03.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.855+0000 7efc657a2800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:03.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.857+0000 7efb19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:03.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.857+0000 7efc657a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:03.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.857+0000 7efc657a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.857+0000 7efc657a2800 5 note: GC not initialized 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.858+0000 7efb18fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.858+0000 7efc657a2800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.858+0000 7efc657a2800 20 Filter name: none 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.858+0000 7efa927fc640 20 reqs_thread_entry: start 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.858+0000 7efc657a2800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.858+0000 7efc657a2800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:46:03.858+0000 7efc657a2800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:46:03.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.858+0000 7efc657a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.858+0000 7efc657a2800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:03.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.859+0000 7efb19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:03.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.862+0000 7efc657a2800 20 remove_watcher() i=0 2024-05-15T14:46:03.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.862+0000 7efc657a2800 2 removed watcher, disabling cache 2024-05-15T14:46:03.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.863+0000 7efc657a2800 20 remove_watcher() i=1 2024-05-15T14:46:03.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.864+0000 7efc657a2800 20 remove_watcher() i=2 2024-05-15T14:46:03.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.865+0000 7efc657a2800 20 remove_watcher() i=3 2024-05-15T14:46:03.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.866+0000 7efc657a2800 20 remove_watcher() i=4 2024-05-15T14:46:03.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.867+0000 7efc657a2800 20 remove_watcher() i=5 2024-05-15T14:46:03.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.868+0000 7efc657a2800 20 remove_watcher() i=6 2024-05-15T14:46:03.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:03.869+0000 7efc657a2800 20 remove_watcher() i=7 2024-05-15T14:46:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:04.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.983+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.984+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:04.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.984+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.985+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:04.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.985+0000 7f288e1af800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:04.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.985+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.986+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.986+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.986+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:04.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.986+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.987+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:04.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.987+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.988+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.988+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.988+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.988+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.989+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:04.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.989+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 zone MyZone found 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:04.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:04.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:04.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:04.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 started sync module instance, tier type = 2024-05-15T14:46:04.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:04.990+0000 7f288e1af800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:05.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.001+0000 7f288e1af800 20 add_watcher() i=0 2024-05-15T14:46:05.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.001+0000 7f288e1af800 20 add_watcher() i=1 2024-05-15T14:46:05.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.001+0000 7f288e1af800 20 add_watcher() i=2 2024-05-15T14:46:05.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.001+0000 7f288e1af800 20 add_watcher() i=3 2024-05-15T14:46:05.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.001+0000 7f288e1af800 20 add_watcher() i=4 2024-05-15T14:46:05.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.001+0000 7f288e1af800 20 add_watcher() i=5 2024-05-15T14:46:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.001+0000 7f288e1af800 20 add_watcher() i=6 2024-05-15T14:46:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.002+0000 7f288e1af800 20 add_watcher() i=7 2024-05-15T14:46:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.002+0000 7f288e1af800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:05.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.004+0000 7f2741fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:05.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.004+0000 7f288e1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:05.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.004+0000 7f288e1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:05.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.004+0000 7f288e1af800 5 note: GC not initialized 2024-05-15T14:46:05.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.004+0000 7f2740fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:05.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.005+0000 7f288e1af800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:05.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.005+0000 7f288e1af800 20 Filter name: none 2024-05-15T14:46:05.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.005+0000 7f26ba7fc640 20 reqs_thread_entry: start 2024-05-15T14:46:05.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.005+0000 7f288e1af800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:05.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.005+0000 7f288e1af800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:05.008 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:46:05.005+0000 7f288e1af800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.005+0000 7f288e1af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.005+0000 7f288e1af800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:46:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.006+0000 7f2741fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.009+0000 7f288e1af800 20 remove_watcher() i=0 2024-05-15T14:46:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.009+0000 7f288e1af800 2 removed watcher, disabling cache 2024-05-15T14:46:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.010+0000 7f288e1af800 20 remove_watcher() i=1 2024-05-15T14:46:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.011+0000 7f288e1af800 20 remove_watcher() i=2 2024-05-15T14:46:05.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.012+0000 7f288e1af800 20 remove_watcher() i=3 2024-05-15T14:46:05.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.013+0000 7f288e1af800 20 remove_watcher() i=4 2024-05-15T14:46:05.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.014+0000 7f288e1af800 20 remove_watcher() i=5 2024-05-15T14:46:05.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.015+0000 7f288e1af800 20 remove_watcher() i=6 2024-05-15T14:46:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:05.016+0000 7f288e1af800 20 remove_watcher() i=7 2024-05-15T14:46:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.129+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.130+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.130+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.131+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.131+0000 7f8b3d810800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.131+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.131+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.131+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.132+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.132+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.133+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.133+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.133+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.133+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.134+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.134+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.135+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.135+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 zone MyZone found 2024-05-15T14:46:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:06.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 rados->read ofs=0 len=0 2024-05-15T14:46:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 started sync module instance, tier type = 2024-05-15T14:46:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.136+0000 7f8b3d810800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.147+0000 7f8b3d810800 20 add_watcher() i=0 2024-05-15T14:46:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.147+0000 7f8b3d810800 20 add_watcher() i=1 2024-05-15T14:46:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.147+0000 7f8b3d810800 20 add_watcher() i=2 2024-05-15T14:46:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.147+0000 7f8b3d810800 20 add_watcher() i=3 2024-05-15T14:46:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.147+0000 7f8b3d810800 20 add_watcher() i=4 2024-05-15T14:46:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.147+0000 7f8b3d810800 20 add_watcher() i=5 2024-05-15T14:46:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.147+0000 7f8b3d810800 20 add_watcher() i=6 2024-05-15T14:46:06.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.148+0000 7f8b3d810800 20 add_watcher() i=7 2024-05-15T14:46:06.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.148+0000 7f8b3d810800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:06.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.150+0000 7f89eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:06.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.150+0000 7f8b3d810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:06.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.150+0000 7f8b3d810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.150+0000 7f8b3d810800 5 note: GC not initialized 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.150+0000 7f89edfe3640 20 reqs_thread_entry: start 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.150+0000 7f8b3d810800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.150+0000 7f8b3d810800 20 Filter name: none 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.151+0000 7f895f7fe640 20 reqs_thread_entry: start 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.151+0000 7f8b3d810800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.151+0000 7f8b3d810800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:46:06.151+0000 7f8b3d810800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:46:06.151+0000 7f8b3d810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:06.153 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:46:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.151+0000 7f8b3d810800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.152+0000 7f89eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.154+0000 7f8b3d810800 20 remove_watcher() i=0 2024-05-15T14:46:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.154+0000 7f8b3d810800 2 removed watcher, disabling cache 2024-05-15T14:46:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.156+0000 7f8b3d810800 20 remove_watcher() i=1 2024-05-15T14:46:06.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.157+0000 7f8b3d810800 20 remove_watcher() i=2 2024-05-15T14:46:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.158+0000 7f8b3d810800 20 remove_watcher() i=3 2024-05-15T14:46:06.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.159+0000 7f8b3d810800 20 remove_watcher() i=4 2024-05-15T14:46:06.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.160+0000 7f8b3d810800 20 remove_watcher() i=5 2024-05-15T14:46:06.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.161+0000 7f8b3d810800 20 remove_watcher() i=6 2024-05-15T14:46:06.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:06.162+0000 7f8b3d810800 20 remove_watcher() i=7 2024-05-15T14:46:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:07.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.273+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.275+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:07.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.275+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.276+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:07.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.276+0000 7f15aa533800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:07.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.276+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.276+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.276+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.277+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:07.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.277+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.278+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:07.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.278+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.279+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:07.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.279+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.279+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:07.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.279+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.280+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:07.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.280+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 zone MyZone found 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:07.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:07.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:07.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 started sync module instance, tier type = 2024-05-15T14:46:07.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.281+0000 7f15aa533800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:07.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.293+0000 7f15aa533800 20 add_watcher() i=0 2024-05-15T14:46:07.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.293+0000 7f15aa533800 20 add_watcher() i=1 2024-05-15T14:46:07.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.293+0000 7f15aa533800 20 add_watcher() i=2 2024-05-15T14:46:07.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.293+0000 7f15aa533800 20 add_watcher() i=3 2024-05-15T14:46:07.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.293+0000 7f15aa533800 20 add_watcher() i=4 2024-05-15T14:46:07.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.293+0000 7f15aa533800 20 add_watcher() i=5 2024-05-15T14:46:07.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.293+0000 7f15aa533800 20 add_watcher() i=6 2024-05-15T14:46:07.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.295+0000 7f15aa533800 20 add_watcher() i=7 2024-05-15T14:46:07.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.295+0000 7f15aa533800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:07.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.297+0000 7f145cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:07.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.297+0000 7f15aa533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:07.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.297+0000 7f15aa533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:07.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.297+0000 7f15aa533800 5 note: GC not initialized 2024-05-15T14:46:07.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.298+0000 7f13d77fe640 20 reqs_thread_entry: start 2024-05-15T14:46:07.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.298+0000 7f15aa533800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:07.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.298+0000 7f15aa533800 20 Filter name: none 2024-05-15T14:46:07.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.298+0000 7f13d57fa640 20 reqs_thread_entry: start 2024-05-15T14:46:07.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.298+0000 7f15aa533800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:07.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.299+0000 7f15aa533800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:07.300 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:46:07.299+0000 7f15aa533800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:07.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.299+0000 7f15aa533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:07.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.299+0000 7f15aa533800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:07.300 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:46:07.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.299+0000 7f145cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:07.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.302+0000 7f15aa533800 20 remove_watcher() i=0 2024-05-15T14:46:07.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.302+0000 7f15aa533800 2 removed watcher, disabling cache 2024-05-15T14:46:07.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.303+0000 7f15aa533800 20 remove_watcher() i=1 2024-05-15T14:46:07.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.305+0000 7f15aa533800 20 remove_watcher() i=2 2024-05-15T14:46:07.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.306+0000 7f15aa533800 20 remove_watcher() i=3 2024-05-15T14:46:07.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.307+0000 7f15aa533800 20 remove_watcher() i=4 2024-05-15T14:46:07.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.308+0000 7f15aa533800 20 remove_watcher() i=5 2024-05-15T14:46:07.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.309+0000 7f15aa533800 20 remove_watcher() i=6 2024-05-15T14:46:07.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:07.311+0000 7f15aa533800 20 remove_watcher() i=7 2024-05-15T14:46:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.421+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.423+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:08.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.423+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.424+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:08.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.424+0000 7f97bcf1f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:08.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.424+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.424+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:08.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.424+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.425+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:08.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.425+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.426+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:08.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.426+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.426+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:08.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.426+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.427+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:08.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.427+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.427+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:08.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.427+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 zone MyZone found 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 started sync module instance, tier type = 2024-05-15T14:46:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.429+0000 7f97bcf1f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.440+0000 7f97bcf1f800 20 add_watcher() i=0 2024-05-15T14:46:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.440+0000 7f97bcf1f800 20 add_watcher() i=1 2024-05-15T14:46:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.440+0000 7f97bcf1f800 20 add_watcher() i=2 2024-05-15T14:46:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.440+0000 7f97bcf1f800 20 add_watcher() i=3 2024-05-15T14:46:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.440+0000 7f97bcf1f800 20 add_watcher() i=4 2024-05-15T14:46:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.440+0000 7f97bcf1f800 20 add_watcher() i=5 2024-05-15T14:46:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.440+0000 7f97bcf1f800 20 add_watcher() i=6 2024-05-15T14:46:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.441+0000 7f97bcf1f800 20 add_watcher() i=7 2024-05-15T14:46:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.441+0000 7f97bcf1f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.443+0000 7f966efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.443+0000 7f97bcf1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.443+0000 7f97bcf1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.443+0000 7f97bcf1f800 5 note: GC not initialized 2024-05-15T14:46:08.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.443+0000 7f966dfe3640 20 reqs_thread_entry: start 2024-05-15T14:46:08.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.444+0000 7f97bcf1f800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:08.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.444+0000 7f97bcf1f800 20 Filter name: none 2024-05-15T14:46:08.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.444+0000 7f95df7fe640 20 reqs_thread_entry: start 2024-05-15T14:46:08.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.444+0000 7f97bcf1f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:08.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.444+0000 7f97bcf1f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:08.446 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:08.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.444+0000 7f97bcf1f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:08.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.444+0000 7f97bcf1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:08.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.444+0000 7f97bcf1f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:08.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.445+0000 7f966efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:08.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.447+0000 7f97bcf1f800 20 remove_watcher() i=0 2024-05-15T14:46:08.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.447+0000 7f97bcf1f800 2 removed watcher, disabling cache 2024-05-15T14:46:08.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.449+0000 7f97bcf1f800 20 remove_watcher() i=1 2024-05-15T14:46:08.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.450+0000 7f97bcf1f800 20 remove_watcher() i=2 2024-05-15T14:46:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.451+0000 7f97bcf1f800 20 remove_watcher() i=3 2024-05-15T14:46:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.452+0000 7f97bcf1f800 20 remove_watcher() i=4 2024-05-15T14:46:08.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.453+0000 7f97bcf1f800 20 remove_watcher() i=5 2024-05-15T14:46:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.454+0000 7f97bcf1f800 20 remove_watcher() i=6 2024-05-15T14:46:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:08.455+0000 7f97bcf1f800 20 remove_watcher() i=7 2024-05-15T14:46:09.521 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:09.521 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.565+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.567+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.567+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.568+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:09.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.568+0000 7efe5f80e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:09.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.568+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.568+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:09.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.568+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.569+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.569+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.570+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:09.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.570+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.570+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:09.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.570+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.570+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:09.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.570+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.571+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:09.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.571+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:09.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 20 zone MyZone found 2024-05-15T14:46:09.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:09.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:09.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:09.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:09.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:09.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:09.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:09.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.572+0000 7efe5f80e800 20 rados->read ofs=0 len=0 2024-05-15T14:46:09.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.573+0000 7efe5f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:09.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.573+0000 7efe5f80e800 20 started sync module instance, tier type = 2024-05-15T14:46:09.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.573+0000 7efe5f80e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.584+0000 7efe5f80e800 20 add_watcher() i=0 2024-05-15T14:46:09.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.584+0000 7efe5f80e800 20 add_watcher() i=1 2024-05-15T14:46:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.584+0000 7efe5f80e800 20 add_watcher() i=2 2024-05-15T14:46:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.584+0000 7efe5f80e800 20 add_watcher() i=3 2024-05-15T14:46:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.584+0000 7efe5f80e800 20 add_watcher() i=4 2024-05-15T14:46:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.584+0000 7efe5f80e800 20 add_watcher() i=5 2024-05-15T14:46:09.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.584+0000 7efe5f80e800 20 add_watcher() i=6 2024-05-15T14:46:09.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.585+0000 7efe5f80e800 20 add_watcher() i=7 2024-05-15T14:46:09.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.585+0000 7efe5f80e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:09.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.587+0000 7efd13fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:09.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.587+0000 7efe5f80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:09.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.587+0000 7efe5f80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:09.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.587+0000 7efe5f80e800 5 note: GC not initialized 2024-05-15T14:46:09.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.587+0000 7efd12fe5640 20 reqs_thread_entry: start 2024-05-15T14:46:09.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.587+0000 7efe5f80e800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:09.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.587+0000 7efe5f80e800 20 Filter name: none 2024-05-15T14:46:09.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.587+0000 7efd10fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:09.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.588+0000 7efe5f80e800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:09.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.588+0000 7efe5f80e800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:09.591 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:46:09.588+0000 7efe5f80e800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:46:09.588+0000 7efe5f80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:09.592 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:46:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.588+0000 7efe5f80e800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.589+0000 7efd13fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.592+0000 7efe5f80e800 20 remove_watcher() i=0 2024-05-15T14:46:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.592+0000 7efe5f80e800 2 removed watcher, disabling cache 2024-05-15T14:46:09.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.594+0000 7efe5f80e800 20 remove_watcher() i=1 2024-05-15T14:46:09.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.596+0000 7efe5f80e800 20 remove_watcher() i=2 2024-05-15T14:46:09.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.598+0000 7efe5f80e800 20 remove_watcher() i=3 2024-05-15T14:46:09.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.599+0000 7efe5f80e800 20 remove_watcher() i=4 2024-05-15T14:46:09.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.601+0000 7efe5f80e800 20 remove_watcher() i=5 2024-05-15T14:46:09.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.603+0000 7efe5f80e800 20 remove_watcher() i=6 2024-05-15T14:46:09.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:09.605+0000 7efe5f80e800 20 remove_watcher() i=7 2024-05-15T14:46:10.671 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:10.671 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.714+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.717+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:10.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.717+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.717+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:10.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.718+0000 7f503a133800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:10.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.718+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.718+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:10.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.718+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.719+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.719+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.720+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.720+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.720+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.720+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.721+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.721+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.721+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.721+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 20 zone MyZone found 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.722+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.723+0000 7f503a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.723+0000 7f503a133800 20 rados->read ofs=0 len=0 2024-05-15T14:46:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.723+0000 7f503a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.723+0000 7f503a133800 20 started sync module instance, tier type = 2024-05-15T14:46:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.723+0000 7f503a133800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:10.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.734+0000 7f503a133800 20 add_watcher() i=0 2024-05-15T14:46:10.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.734+0000 7f503a133800 20 add_watcher() i=1 2024-05-15T14:46:10.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.734+0000 7f503a133800 20 add_watcher() i=2 2024-05-15T14:46:10.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.734+0000 7f503a133800 20 add_watcher() i=3 2024-05-15T14:46:10.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.734+0000 7f503a133800 20 add_watcher() i=4 2024-05-15T14:46:10.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.734+0000 7f503a133800 20 add_watcher() i=5 2024-05-15T14:46:10.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.734+0000 7f503a133800 20 add_watcher() i=6 2024-05-15T14:46:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.735+0000 7f503a133800 20 add_watcher() i=7 2024-05-15T14:46:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.735+0000 7f503a133800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.737+0000 7f4ee77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.737+0000 7f503a133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.737+0000 7f503a133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.737+0000 7f503a133800 5 note: GC not initialized 2024-05-15T14:46:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.737+0000 7f4ee67fc640 20 reqs_thread_entry: start 2024-05-15T14:46:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.737+0000 7f503a133800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.737+0000 7f503a133800 20 Filter name: none 2024-05-15T14:46:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.737+0000 7f4e57fff640 20 reqs_thread_entry: start 2024-05-15T14:46:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.738+0000 7f503a133800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.738+0000 7f503a133800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.738+0000 7f503a133800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:10.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.738+0000 7f503a133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:10.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.738+0000 7f503a133800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:10.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.739+0000 7f4ee77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:10.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.741+0000 7f503a133800 20 remove_watcher() i=0 2024-05-15T14:46:10.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.741+0000 7f503a133800 2 removed watcher, disabling cache 2024-05-15T14:46:10.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.742+0000 7f503a133800 20 remove_watcher() i=1 2024-05-15T14:46:10.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.743+0000 7f503a133800 20 remove_watcher() i=2 2024-05-15T14:46:10.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.745+0000 7f503a133800 20 remove_watcher() i=3 2024-05-15T14:46:10.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.746+0000 7f503a133800 20 remove_watcher() i=4 2024-05-15T14:46:10.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.747+0000 7f503a133800 20 remove_watcher() i=5 2024-05-15T14:46:10.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.748+0000 7f503a133800 20 remove_watcher() i=6 2024-05-15T14:46:10.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:10.749+0000 7f503a133800 20 remove_watcher() i=7 2024-05-15T14:46:11.815 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:11.815 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:11.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.860+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.861+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:11.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.862+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.862+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:11.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.862+0000 7f799c336800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:11.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.862+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.863+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:11.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.863+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.863+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:11.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.864+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.864+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:11.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.865+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.865+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:11.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.865+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.865+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:11.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.865+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.866+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:11.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.866+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:11.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 zone MyZone found 2024-05-15T14:46:11.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:11.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:11.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:11.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:11.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:11.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:11.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:11.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 rados->read ofs=0 len=0 2024-05-15T14:46:11.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:11.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 started sync module instance, tier type = 2024-05-15T14:46:11.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.867+0000 7f799c336800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:11.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.878+0000 7f799c336800 20 add_watcher() i=0 2024-05-15T14:46:11.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.878+0000 7f799c336800 20 add_watcher() i=1 2024-05-15T14:46:11.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.878+0000 7f799c336800 20 add_watcher() i=2 2024-05-15T14:46:11.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.878+0000 7f799c336800 20 add_watcher() i=3 2024-05-15T14:46:11.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.878+0000 7f799c336800 20 add_watcher() i=4 2024-05-15T14:46:11.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.878+0000 7f799c336800 20 add_watcher() i=5 2024-05-15T14:46:11.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.878+0000 7f799c336800 20 add_watcher() i=6 2024-05-15T14:46:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.879+0000 7f799c336800 20 add_watcher() i=7 2024-05-15T14:46:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.879+0000 7f799c336800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.881+0000 7f784efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.881+0000 7f799c336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.881+0000 7f799c336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.881+0000 7f799c336800 5 note: GC not initialized 2024-05-15T14:46:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.882+0000 7f784dfdb640 20 reqs_thread_entry: start 2024-05-15T14:46:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.882+0000 7f799c336800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.882+0000 7f799c336800 20 Filter name: none 2024-05-15T14:46:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.882+0000 7f77bf7fe640 20 reqs_thread_entry: start 2024-05-15T14:46:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.882+0000 7f799c336800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.882+0000 7f799c336800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:46:11.883+0000 7f799c336800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.883+0000 7f799c336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.883+0000 7f799c336800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:11.887 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:46:11.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.883+0000 7f784efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.886+0000 7f799c336800 20 remove_watcher() i=0 2024-05-15T14:46:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.886+0000 7f799c336800 2 removed watcher, disabling cache 2024-05-15T14:46:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.887+0000 7f799c336800 20 remove_watcher() i=1 2024-05-15T14:46:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.888+0000 7f799c336800 20 remove_watcher() i=2 2024-05-15T14:46:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.889+0000 7f799c336800 20 remove_watcher() i=3 2024-05-15T14:46:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.890+0000 7f799c336800 20 remove_watcher() i=4 2024-05-15T14:46:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.891+0000 7f799c336800 20 remove_watcher() i=5 2024-05-15T14:46:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.892+0000 7f799c336800 20 remove_watcher() i=6 2024-05-15T14:46:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:11.893+0000 7f799c336800 20 remove_watcher() i=7 2024-05-15T14:46:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:13.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.002+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.004+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.004+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.005+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.005+0000 7f1826534800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.005+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.005+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.005+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.006+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:13.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.006+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.007+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.007+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.007+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.007+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.007+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.007+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.008+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:13.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.008+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:13.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 20 zone MyZone found 2024-05-15T14:46:13.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:13.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:13.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:13.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:13.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:13.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:13.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:13.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.009+0000 7f1826534800 20 rados->read ofs=0 len=0 2024-05-15T14:46:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.010+0000 7f1826534800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.010+0000 7f1826534800 20 started sync module instance, tier type = 2024-05-15T14:46:13.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.010+0000 7f1826534800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:13.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.020+0000 7f1826534800 20 add_watcher() i=0 2024-05-15T14:46:13.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.020+0000 7f1826534800 20 add_watcher() i=1 2024-05-15T14:46:13.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.020+0000 7f1826534800 20 add_watcher() i=2 2024-05-15T14:46:13.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.020+0000 7f1826534800 20 add_watcher() i=3 2024-05-15T14:46:13.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.020+0000 7f1826534800 20 add_watcher() i=4 2024-05-15T14:46:13.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.020+0000 7f1826534800 20 add_watcher() i=5 2024-05-15T14:46:13.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.020+0000 7f1826534800 20 add_watcher() i=6 2024-05-15T14:46:13.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.021+0000 7f1826534800 20 add_watcher() i=7 2024-05-15T14:46:13.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.021+0000 7f1826534800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:13.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.023+0000 7f16d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.024+0000 7f1826534800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.024+0000 7f1826534800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.024+0000 7f1826534800 5 note: GC not initialized 2024-05-15T14:46:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.024+0000 7f16537fe640 20 reqs_thread_entry: start 2024-05-15T14:46:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.024+0000 7f1826534800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.024+0000 7f1826534800 20 Filter name: none 2024-05-15T14:46:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.024+0000 7f16517fa640 20 reqs_thread_entry: start 2024-05-15T14:46:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.024+0000 7f1826534800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.025+0000 7f1826534800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.025+0000 7f1826534800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.025+0000 7f1826534800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.025+0000 7f1826534800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.026+0000 7f16d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:13.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.028+0000 7f1826534800 20 remove_watcher() i=0 2024-05-15T14:46:13.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.028+0000 7f1826534800 2 removed watcher, disabling cache 2024-05-15T14:46:13.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.029+0000 7f1826534800 20 remove_watcher() i=1 2024-05-15T14:46:13.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.030+0000 7f1826534800 20 remove_watcher() i=2 2024-05-15T14:46:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.031+0000 7f1826534800 20 remove_watcher() i=3 2024-05-15T14:46:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.032+0000 7f1826534800 20 remove_watcher() i=4 2024-05-15T14:46:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.033+0000 7f1826534800 20 remove_watcher() i=5 2024-05-15T14:46:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.034+0000 7f1826534800 20 remove_watcher() i=6 2024-05-15T14:46:13.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:13.035+0000 7f1826534800 20 remove_watcher() i=7 2024-05-15T14:46:14.099 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:14.099 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.142+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.144+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.144+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.145+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.145+0000 7f0228f2d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.145+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.145+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:14.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.145+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.146+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:14.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.146+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.147+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.147+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.147+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.147+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.147+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.147+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.148+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:14.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.148+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:14.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 20 zone MyZone found 2024-05-15T14:46:14.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:14.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:14.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:14.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:14.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:14.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:14.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:14.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.149+0000 7f0228f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:14.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.150+0000 7f0228f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:14.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.150+0000 7f0228f2d800 20 started sync module instance, tier type = 2024-05-15T14:46:14.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.150+0000 7f0228f2d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.160+0000 7f0228f2d800 20 add_watcher() i=0 2024-05-15T14:46:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.160+0000 7f0228f2d800 20 add_watcher() i=1 2024-05-15T14:46:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.160+0000 7f0228f2d800 20 add_watcher() i=2 2024-05-15T14:46:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.160+0000 7f0228f2d800 20 add_watcher() i=3 2024-05-15T14:46:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.160+0000 7f0228f2d800 20 add_watcher() i=4 2024-05-15T14:46:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.160+0000 7f0228f2d800 20 add_watcher() i=5 2024-05-15T14:46:14.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.160+0000 7f0228f2d800 20 add_watcher() i=6 2024-05-15T14:46:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.161+0000 7f0228f2d800 20 add_watcher() i=7 2024-05-15T14:46:14.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.161+0000 7f0228f2d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:14.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.163+0000 7f00db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:14.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.163+0000 7f0228f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:14.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.163+0000 7f0228f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:14.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.163+0000 7f0228f2d800 5 note: GC not initialized 2024-05-15T14:46:14.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.163+0000 7f00da7e4640 20 reqs_thread_entry: start 2024-05-15T14:46:14.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.163+0000 7f0228f2d800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:14.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.164+0000 7f0228f2d800 20 Filter name: none 2024-05-15T14:46:14.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.164+0000 7f00d3fff640 20 reqs_thread_entry: start 2024-05-15T14:46:14.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.164+0000 7f0228f2d800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:14.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.164+0000 7f0228f2d800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:14.166 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:14.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.164+0000 7f0228f2d800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:14.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.164+0000 7f0228f2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:14.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.164+0000 7f0228f2d800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:14.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.165+0000 7f00db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:14.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.167+0000 7f0228f2d800 20 remove_watcher() i=0 2024-05-15T14:46:14.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.167+0000 7f0228f2d800 2 removed watcher, disabling cache 2024-05-15T14:46:14.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.168+0000 7f0228f2d800 20 remove_watcher() i=1 2024-05-15T14:46:14.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.169+0000 7f0228f2d800 20 remove_watcher() i=2 2024-05-15T14:46:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.170+0000 7f0228f2d800 20 remove_watcher() i=3 2024-05-15T14:46:14.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.171+0000 7f0228f2d800 20 remove_watcher() i=4 2024-05-15T14:46:14.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.172+0000 7f0228f2d800 20 remove_watcher() i=5 2024-05-15T14:46:14.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.173+0000 7f0228f2d800 20 remove_watcher() i=6 2024-05-15T14:46:14.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:14.174+0000 7f0228f2d800 20 remove_watcher() i=7 2024-05-15T14:46:15.240 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:15.240 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:15.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.285+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.287+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:15.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.287+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.288+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.288+0000 7fd8c4533800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.288+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.288+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.288+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.289+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:15.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.289+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.290+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.290+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.290+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.290+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.291+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.291+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.291+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.291+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 20 zone MyZone found 2024-05-15T14:46:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.292+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.293+0000 7fd8c4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:15.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.293+0000 7fd8c4533800 20 rados->read ofs=0 len=0 2024-05-15T14:46:15.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.293+0000 7fd8c4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:15.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.293+0000 7fd8c4533800 20 started sync module instance, tier type = 2024-05-15T14:46:15.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.293+0000 7fd8c4533800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.303+0000 7fd8c4533800 20 add_watcher() i=0 2024-05-15T14:46:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.303+0000 7fd8c4533800 20 add_watcher() i=1 2024-05-15T14:46:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.303+0000 7fd8c4533800 20 add_watcher() i=2 2024-05-15T14:46:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.303+0000 7fd8c4533800 20 add_watcher() i=3 2024-05-15T14:46:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.303+0000 7fd8c4533800 20 add_watcher() i=4 2024-05-15T14:46:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.303+0000 7fd8c4533800 20 add_watcher() i=5 2024-05-15T14:46:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.303+0000 7fd8c4533800 20 add_watcher() i=6 2024-05-15T14:46:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.304+0000 7fd8c4533800 20 add_watcher() i=7 2024-05-15T14:46:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.304+0000 7fd8c4533800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:15.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.306+0000 7fd776fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:15.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.307+0000 7fd8c4533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:15.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.307+0000 7fd8c4533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:15.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.307+0000 7fd8c4533800 5 note: GC not initialized 2024-05-15T14:46:15.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.307+0000 7fd775fdb640 20 reqs_thread_entry: start 2024-05-15T14:46:15.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.307+0000 7fd8c4533800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:15.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.307+0000 7fd8c4533800 20 Filter name: none 2024-05-15T14:46:15.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.307+0000 7fd6e77fe640 20 reqs_thread_entry: start 2024-05-15T14:46:15.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.307+0000 7fd8c4533800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:15.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.308+0000 7fd8c4533800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:15.309 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:15.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.308+0000 7fd8c4533800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:15.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.308+0000 7fd8c4533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:15.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.308+0000 7fd8c4533800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:15.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.309+0000 7fd776fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:15.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.311+0000 7fd8c4533800 20 remove_watcher() i=0 2024-05-15T14:46:15.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.311+0000 7fd8c4533800 2 removed watcher, disabling cache 2024-05-15T14:46:15.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.312+0000 7fd8c4533800 20 remove_watcher() i=1 2024-05-15T14:46:15.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.313+0000 7fd8c4533800 20 remove_watcher() i=2 2024-05-15T14:46:15.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.314+0000 7fd8c4533800 20 remove_watcher() i=3 2024-05-15T14:46:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.315+0000 7fd8c4533800 20 remove_watcher() i=4 2024-05-15T14:46:15.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.316+0000 7fd8c4533800 20 remove_watcher() i=5 2024-05-15T14:46:15.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.317+0000 7fd8c4533800 20 remove_watcher() i=6 2024-05-15T14:46:15.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:15.318+0000 7fd8c4533800 20 remove_watcher() i=7 2024-05-15T14:46:16.383 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.428+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.430+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:16.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.430+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.431+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.431+0000 7ffb9c813800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.431+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.431+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.431+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.432+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:16.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.432+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.433+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.433+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.433+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.433+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.433+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:16.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.433+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.434+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:16.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.434+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 20 zone MyZone found 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:16.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.435+0000 7ffb9c813800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:16.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.436+0000 7ffb9c813800 20 rados->read ofs=0 len=0 2024-05-15T14:46:16.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.436+0000 7ffb9c813800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:16.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.436+0000 7ffb9c813800 20 started sync module instance, tier type = 2024-05-15T14:46:16.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.436+0000 7ffb9c813800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:16.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.446+0000 7ffb9c813800 20 add_watcher() i=0 2024-05-15T14:46:16.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.446+0000 7ffb9c813800 20 add_watcher() i=1 2024-05-15T14:46:16.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.446+0000 7ffb9c813800 20 add_watcher() i=2 2024-05-15T14:46:16.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.446+0000 7ffb9c813800 20 add_watcher() i=3 2024-05-15T14:46:16.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.446+0000 7ffb9c813800 20 add_watcher() i=4 2024-05-15T14:46:16.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.446+0000 7ffb9c813800 20 add_watcher() i=5 2024-05-15T14:46:16.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.446+0000 7ffb9c813800 20 add_watcher() i=6 2024-05-15T14:46:16.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.447+0000 7ffb9c813800 20 add_watcher() i=7 2024-05-15T14:46:16.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.447+0000 7ffb9c813800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:16.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.449+0000 7ffa4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:16.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.449+0000 7ffb9c813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:16.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.449+0000 7ffb9c813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:16.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.449+0000 7ffb9c813800 5 note: GC not initialized 2024-05-15T14:46:16.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.449+0000 7ffa4cfe1640 20 reqs_thread_entry: start 2024-05-15T14:46:16.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.449+0000 7ffb9c813800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:16.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.449+0000 7ffb9c813800 20 Filter name: none 2024-05-15T14:46:16.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.450+0000 7ff9c67fc640 20 reqs_thread_entry: start 2024-05-15T14:46:16.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.450+0000 7ffb9c813800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:16.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.450+0000 7ffb9c813800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:16.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.450+0000 7ffb9c813800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:16.452 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:16.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.450+0000 7ffb9c813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:16.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.450+0000 7ffb9c813800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:16.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.451+0000 7ffa4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:16.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.453+0000 7ffb9c813800 20 remove_watcher() i=0 2024-05-15T14:46:16.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.453+0000 7ffb9c813800 2 removed watcher, disabling cache 2024-05-15T14:46:16.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.454+0000 7ffb9c813800 20 remove_watcher() i=1 2024-05-15T14:46:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.456+0000 7ffb9c813800 20 remove_watcher() i=2 2024-05-15T14:46:16.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.457+0000 7ffb9c813800 20 remove_watcher() i=3 2024-05-15T14:46:16.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.458+0000 7ffb9c813800 20 remove_watcher() i=4 2024-05-15T14:46:16.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.459+0000 7ffb9c813800 20 remove_watcher() i=5 2024-05-15T14:46:16.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.460+0000 7ffb9c813800 20 remove_watcher() i=6 2024-05-15T14:46:16.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:16.461+0000 7ffb9c813800 20 remove_watcher() i=7 2024-05-15T14:46:17.527 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:17.527 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:17.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.572+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.573+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:17.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.573+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.574+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.574+0000 7ffa80b29800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.574+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.575+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:17.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.575+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.575+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:17.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.575+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.576+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:17.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.576+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.577+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:17.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.577+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.577+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:17.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.577+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.578+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:17.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.578+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 zone MyZone found 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:17.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:17.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 started sync module instance, tier type = 2024-05-15T14:46:17.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.579+0000 7ffa80b29800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.590+0000 7ffa80b29800 20 add_watcher() i=0 2024-05-15T14:46:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.590+0000 7ffa80b29800 20 add_watcher() i=1 2024-05-15T14:46:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.590+0000 7ffa80b29800 20 add_watcher() i=2 2024-05-15T14:46:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.590+0000 7ffa80b29800 20 add_watcher() i=3 2024-05-15T14:46:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.590+0000 7ffa80b29800 20 add_watcher() i=4 2024-05-15T14:46:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.590+0000 7ffa80b29800 20 add_watcher() i=5 2024-05-15T14:46:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.590+0000 7ffa80b29800 20 add_watcher() i=6 2024-05-15T14:46:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.591+0000 7ffa80b29800 20 add_watcher() i=7 2024-05-15T14:46:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.591+0000 7ffa80b29800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.593+0000 7ff932fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.593+0000 7ffa80b29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.593+0000 7ffa80b29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.593+0000 7ffa80b29800 5 note: GC not initialized 2024-05-15T14:46:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.593+0000 7ff931fdb640 20 reqs_thread_entry: start 2024-05-15T14:46:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.594+0000 7ffa80b29800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.594+0000 7ffa80b29800 20 Filter name: none 2024-05-15T14:46:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.594+0000 7ff8a37fe640 20 reqs_thread_entry: start 2024-05-15T14:46:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.594+0000 7ffa80b29800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:46:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.594+0000 7ffa80b29800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.594+0000 7ffa80b29800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.594+0000 7ffa80b29800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.594+0000 7ffa80b29800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.595+0000 7ff932fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.598+0000 7ffa80b29800 20 remove_watcher() i=0 2024-05-15T14:46:17.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.598+0000 7ffa80b29800 2 removed watcher, disabling cache 2024-05-15T14:46:17.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.599+0000 7ffa80b29800 20 remove_watcher() i=1 2024-05-15T14:46:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.600+0000 7ffa80b29800 20 remove_watcher() i=2 2024-05-15T14:46:17.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.601+0000 7ffa80b29800 20 remove_watcher() i=3 2024-05-15T14:46:17.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.602+0000 7ffa80b29800 20 remove_watcher() i=4 2024-05-15T14:46:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.603+0000 7ffa80b29800 20 remove_watcher() i=5 2024-05-15T14:46:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.604+0000 7ffa80b29800 20 remove_watcher() i=6 2024-05-15T14:46:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:17.605+0000 7ffa80b29800 20 remove_watcher() i=7 2024-05-15T14:46:18.671 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:18.671 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:18.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.715+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.717+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.717+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.718+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.718+0000 7f7880216800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.718+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.718+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.718+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.719+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:18.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.719+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.720+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.720+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.720+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.720+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.720+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.720+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.721+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:18.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.721+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 20 zone MyZone found 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.722+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.723+0000 7f7880216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.723+0000 7f7880216800 20 rados->read ofs=0 len=0 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.723+0000 7f7880216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.723+0000 7f7880216800 20 started sync module instance, tier type = 2024-05-15T14:46:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.723+0000 7f7880216800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.733+0000 7f7880216800 20 add_watcher() i=0 2024-05-15T14:46:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.733+0000 7f7880216800 20 add_watcher() i=1 2024-05-15T14:46:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.733+0000 7f7880216800 20 add_watcher() i=2 2024-05-15T14:46:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.733+0000 7f7880216800 20 add_watcher() i=3 2024-05-15T14:46:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.733+0000 7f7880216800 20 add_watcher() i=4 2024-05-15T14:46:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.733+0000 7f7880216800 20 add_watcher() i=5 2024-05-15T14:46:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.733+0000 7f7880216800 20 add_watcher() i=6 2024-05-15T14:46:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.734+0000 7f7880216800 20 add_watcher() i=7 2024-05-15T14:46:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.734+0000 7f7880216800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:18.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.736+0000 7f7731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:18.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.736+0000 7f7880216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:18.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.736+0000 7f7880216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:18.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.736+0000 7f7880216800 5 note: GC not initialized 2024-05-15T14:46:18.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.736+0000 7f7730fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:18.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.737+0000 7f7880216800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:18.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.737+0000 7f7880216800 20 Filter name: none 2024-05-15T14:46:18.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.737+0000 7f76aa7fc640 20 reqs_thread_entry: start 2024-05-15T14:46:18.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.737+0000 7f7880216800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:18.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.737+0000 7f7880216800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:46:18.739 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:46:18.737+0000 7f7880216800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:18.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.737+0000 7f7880216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:46:18.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.737+0000 7f7880216800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:46:18.739 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:46:18.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.738+0000 7f7731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:18.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.741+0000 7f7880216800 20 remove_watcher() i=0 2024-05-15T14:46:18.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.741+0000 7f7880216800 2 removed watcher, disabling cache 2024-05-15T14:46:18.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.742+0000 7f7880216800 20 remove_watcher() i=1 2024-05-15T14:46:18.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.743+0000 7f7880216800 20 remove_watcher() i=2 2024-05-15T14:46:18.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.744+0000 7f7880216800 20 remove_watcher() i=3 2024-05-15T14:46:18.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.745+0000 7f7880216800 20 remove_watcher() i=4 2024-05-15T14:46:18.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.746+0000 7f7880216800 20 remove_watcher() i=5 2024-05-15T14:46:18.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.747+0000 7f7880216800 20 remove_watcher() i=6 2024-05-15T14:46:18.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:18.748+0000 7f7880216800 20 remove_watcher() i=7 2024-05-15T14:46:19.206 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:46:19.204+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:46:19.206 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:46:19.204+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:46:19.206 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:46:19.204+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:46:19.206 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:46:19.204+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:46:19.302 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:46:19.301+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:46:19.302 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:46:19.301+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:46:19.302 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:46:19.301+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:46:19.302 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:46:19.301+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:46:19.809 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:19.810 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:19.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.848+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.849+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:19.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.849+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.850+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:19.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.850+0000 7f049752b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:19.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.850+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.850+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.850+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.851+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.851+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.852+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.852+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.852+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.852+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.853+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:19.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.853+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.853+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:19.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.853+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 20 zone MyZone found 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.854+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.855+0000 7f049752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.855+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.855+0000 7f049752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.855+0000 7f049752b800 20 started sync module instance, tier type = 2024-05-15T14:46:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.855+0000 7f049752b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.864+0000 7f049752b800 20 add_watcher() i=0 2024-05-15T14:46:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.864+0000 7f049752b800 20 add_watcher() i=1 2024-05-15T14:46:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.864+0000 7f049752b800 20 add_watcher() i=2 2024-05-15T14:46:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.864+0000 7f049752b800 20 add_watcher() i=3 2024-05-15T14:46:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.864+0000 7f049752b800 20 add_watcher() i=4 2024-05-15T14:46:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.864+0000 7f049752b800 20 add_watcher() i=5 2024-05-15T14:46:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.864+0000 7f049752b800 20 add_watcher() i=6 2024-05-15T14:46:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.865+0000 7f049752b800 20 add_watcher() i=7 2024-05-15T14:46:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.865+0000 7f049752b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.867+0000 7f0349fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 5 note: GC not initialized 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f0348fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 20 Filter name: none 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f02c27fc640 20 reqs_thread_entry: start 2024-05-15T14:46:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:46:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:46:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 10 cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 10 cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-25_topic_1 : miss 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.868+0000 7f049752b800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.869+0000 7f049752b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.869+0000 7f049752b800 10 cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-25_topic_1 info.flags=0x0 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.869+0000 7f049752b800 10 adding MyZone.rgw.meta+topics+topic.:vwwrqh-25_topic_1 to cache LRU end 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.869+0000 7f049752b800 1 failed to read topic info for name: vwwrqh-25_topic_1 tenant: , ret=-2 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.869+0000 7f049752b800 10 WARNING: topic name:vwwrqh-25_topic_1 does not exist, deletion is a no-op: ret=-2 2024-05-15T14:46:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.870+0000 7f0349fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.872+0000 7f049752b800 20 remove_watcher() i=0 2024-05-15T14:46:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.872+0000 7f049752b800 2 removed watcher, disabling cache 2024-05-15T14:46:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.872+0000 7f049752b800 20 remove_watcher() i=1 2024-05-15T14:46:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.873+0000 7f049752b800 20 remove_watcher() i=2 2024-05-15T14:46:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.875+0000 7f049752b800 20 remove_watcher() i=3 2024-05-15T14:46:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.876+0000 7f049752b800 20 remove_watcher() i=4 2024-05-15T14:46:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.877+0000 7f049752b800 20 remove_watcher() i=5 2024-05-15T14:46:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.878+0000 7f049752b800 20 remove_watcher() i=6 2024-05-15T14:46:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.879+0000 7f049752b800 20 remove_watcher() i=7 2024-05-15T14:46:19.937 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:19.960 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:19.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.976+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.978+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:19.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.978+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.978+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:19.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.979+0000 7f6af4c62800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:19.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.979+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.979+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:19.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.979+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.979+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:19.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.979+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.980+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:19.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.980+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.980+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.980+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.981+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.981+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.981+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:19.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.981+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:19.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 20 zone MyZone found 2024-05-15T14:46:19.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:19.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:19.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:19.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:19.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:19.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:19.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.982+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.983+0000 7f6af4c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:19.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.983+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.983+0000 7f6af4c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:19.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.983+0000 7f6af4c62800 20 started sync module instance, tier type = 2024-05-15T14:46:19.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.983+0000 7f6af4c62800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:19.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.992+0000 7f6af4c62800 20 add_watcher() i=0 2024-05-15T14:46:19.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.992+0000 7f6af4c62800 20 add_watcher() i=1 2024-05-15T14:46:19.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.992+0000 7f6af4c62800 20 add_watcher() i=2 2024-05-15T14:46:19.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.992+0000 7f6af4c62800 20 add_watcher() i=3 2024-05-15T14:46:19.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.992+0000 7f6af4c62800 20 add_watcher() i=4 2024-05-15T14:46:19.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.992+0000 7f6af4c62800 20 add_watcher() i=5 2024-05-15T14:46:19.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.992+0000 7f6af4c62800 20 add_watcher() i=6 2024-05-15T14:46:19.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.993+0000 7f6af4c62800 20 add_watcher() i=7 2024-05-15T14:46:19.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.993+0000 7f6af4c62800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:19.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.994+0000 7f69a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:19.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.995+0000 7f6af4c62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.995+0000 7f6af4c62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.995+0000 7f6af4c62800 5 note: GC not initialized 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.995+0000 7f69237fe640 20 reqs_thread_entry: start 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.995+0000 7f6af4c62800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.995+0000 7f6af4c62800 20 Filter name: none 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.995+0000 7f69217fa640 20 reqs_thread_entry: start 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.995+0000 7f6af4c62800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom_1 : miss 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 10 cache put: name=MyZone.rgw.log++pubsub.kaboom_1 info.flags=0x0 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 10 adding MyZone.rgw.log++pubsub.kaboom_1 to cache LRU end 2024-05-15T14:46:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom_1 : hit (negative entry) 2024-05-15T14:46:19.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 10 cache get: name=MyZone.rgw.meta+topics+topic.kaboom_1:vwwrqh-26_topic_1 : miss 2024-05-15T14:46:19.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 20 rados->read ofs=0 len=0 2024-05-15T14:46:19.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:19.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 10 cache put: name=MyZone.rgw.meta+topics+topic.kaboom_1:vwwrqh-26_topic_1 info.flags=0x0 2024-05-15T14:46:19.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 10 adding MyZone.rgw.meta+topics+topic.kaboom_1:vwwrqh-26_topic_1 to cache LRU end 2024-05-15T14:46:19.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 1 failed to read topic info for name: vwwrqh-26_topic_1 tenant: kaboom_1, ret=-2 2024-05-15T14:46:19.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.996+0000 7f6af4c62800 10 WARNING: topic name:vwwrqh-26_topic_1 does not exist, deletion is a no-op: ret=-2 2024-05-15T14:46:19.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.997+0000 7f69a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.999+0000 7f6af4c62800 20 remove_watcher() i=0 2024-05-15T14:46:20.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:19.999+0000 7f6af4c62800 2 removed watcher, disabling cache 2024-05-15T14:46:20.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.000+0000 7f6af4c62800 20 remove_watcher() i=1 2024-05-15T14:46:20.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.002+0000 7f6af4c62800 20 remove_watcher() i=2 2024-05-15T14:46:20.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.002+0000 7f6af4c62800 20 remove_watcher() i=3 2024-05-15T14:46:20.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.004+0000 7f6af4c62800 20 remove_watcher() i=4 2024-05-15T14:46:20.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.004+0000 7f6af4c62800 20 remove_watcher() i=5 2024-05-15T14:46:20.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.005+0000 7f6af4c62800 20 remove_watcher() i=6 2024-05-15T14:46:20.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.006+0000 7f6af4c62800 20 remove_watcher() i=7 2024-05-15T14:46:20.065 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:20.065 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:20.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.105+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.107+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.107+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.107+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.107+0000 7fdb15498800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:20.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.107+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.108+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.108+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.108+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.109+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.109+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.109+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.110+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.110+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.110+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.110+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.110+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.110+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 20 zone MyZone found 2024-05-15T14:46:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:20.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:20.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:20.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.111+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.112+0000 7fdb15498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.112+0000 7fdb15498800 20 started sync module instance, tier type = 2024-05-15T14:46:20.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.112+0000 7fdb15498800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.121+0000 7fdb15498800 20 add_watcher() i=0 2024-05-15T14:46:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.121+0000 7fdb15498800 20 add_watcher() i=1 2024-05-15T14:46:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.121+0000 7fdb15498800 20 add_watcher() i=2 2024-05-15T14:46:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.121+0000 7fdb15498800 20 add_watcher() i=3 2024-05-15T14:46:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.121+0000 7fdb15498800 20 add_watcher() i=4 2024-05-15T14:46:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.121+0000 7fdb15498800 20 add_watcher() i=5 2024-05-15T14:46:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.121+0000 7fdb15498800 20 add_watcher() i=6 2024-05-15T14:46:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.122+0000 7fdb15498800 20 add_watcher() i=7 2024-05-15T14:46:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.122+0000 7fdb15498800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.123+0000 7fd9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.124+0000 7fdb15498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.124+0000 7fdb15498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.124+0000 7fdb15498800 5 note: GC not initialized 2024-05-15T14:46:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.124+0000 7fd943fff640 20 reqs_thread_entry: start 2024-05-15T14:46:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.124+0000 7fdb15498800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.124+0000 7fdb15498800 20 Filter name: none 2024-05-15T14:46:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.124+0000 7fd941ffb640 20 reqs_thread_entry: start 2024-05-15T14:46:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.124+0000 7fdb15498800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom_2 : miss 2024-05-15T14:46:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 10 cache put: name=MyZone.rgw.log++pubsub.kaboom_2 info.flags=0x0 2024-05-15T14:46:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 10 adding MyZone.rgw.log++pubsub.kaboom_2 to cache LRU end 2024-05-15T14:46:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom_2 : hit (negative entry) 2024-05-15T14:46:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 10 cache get: name=MyZone.rgw.meta+topics+topic.kaboom_2:vwwrqh-27_topic_1 : miss 2024-05-15T14:46:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 10 cache put: name=MyZone.rgw.meta+topics+topic.kaboom_2:vwwrqh-27_topic_1 info.flags=0x0 2024-05-15T14:46:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 10 adding MyZone.rgw.meta+topics+topic.kaboom_2:vwwrqh-27_topic_1 to cache LRU end 2024-05-15T14:46:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 1 failed to read topic info for name: vwwrqh-27_topic_1 tenant: kaboom_2, ret=-2 2024-05-15T14:46:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.125+0000 7fdb15498800 10 WARNING: topic name:vwwrqh-27_topic_1 does not exist, deletion is a no-op: ret=-2 2024-05-15T14:46:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.126+0000 7fd9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.128+0000 7fdb15498800 20 remove_watcher() i=0 2024-05-15T14:46:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.128+0000 7fdb15498800 2 removed watcher, disabling cache 2024-05-15T14:46:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.129+0000 7fdb15498800 20 remove_watcher() i=1 2024-05-15T14:46:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.130+0000 7fdb15498800 20 remove_watcher() i=2 2024-05-15T14:46:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.131+0000 7fdb15498800 20 remove_watcher() i=3 2024-05-15T14:46:20.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.132+0000 7fdb15498800 20 remove_watcher() i=4 2024-05-15T14:46:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.132+0000 7fdb15498800 20 remove_watcher() i=5 2024-05-15T14:46:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.133+0000 7fdb15498800 20 remove_watcher() i=6 2024-05-15T14:46:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.134+0000 7fdb15498800 20 remove_watcher() i=7 2024-05-15T14:46:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.227+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.229+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.229+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.230+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.230+0000 7fd8d5211800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.230+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.230+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.230+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.231+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:20.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.231+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.232+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.232+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.232+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.232+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.232+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.232+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.233+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.233+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 zone MyZone found 2024-05-15T14:46:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 started sync module instance, tier type = 2024-05-15T14:46:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.234+0000 7fd8d5211800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.244+0000 7fd8d5211800 20 add_watcher() i=0 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.244+0000 7fd8d5211800 20 add_watcher() i=1 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.244+0000 7fd8d5211800 20 add_watcher() i=2 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.244+0000 7fd8d5211800 20 add_watcher() i=3 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.244+0000 7fd8d5211800 20 add_watcher() i=4 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.244+0000 7fd8d5211800 20 add_watcher() i=5 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.244+0000 7fd8d5211800 20 add_watcher() i=6 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.245+0000 7fd8d5211800 20 add_watcher() i=7 2024-05-15T14:46:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.245+0000 7fd8d5211800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.246+0000 7fd786fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.246+0000 7fd8d5211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.246+0000 7fd8d5211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.246+0000 7fd8d5211800 5 note: GC not initialized 2024-05-15T14:46:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.247+0000 7fd785fe3640 20 reqs_thread_entry: start 2024-05-15T14:46:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.247+0000 7fd8d5211800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.247+0000 7fd8d5211800 20 Filter name: none 2024-05-15T14:46:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.247+0000 7fd6f77fe640 20 reqs_thread_entry: start 2024-05-15T14:46:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.256+0000 7fd8d5211800 20 RGWRados::pool_iterate: got topic.:vwwrqh-25_topic 2024-05-15T14:46:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.256+0000 7fd8d5211800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-26_topic 2024-05-15T14:46:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.256+0000 7fd8d5211800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-27_topic 2024-05-15T14:46:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.256+0000 7fd8d5211800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.257+0000 7fd8d5211800 20 rados_obj.operate() r=0 bl.length=222 2024-05-15T14:46:20.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.258+0000 7fd786fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.260+0000 7fd8d5211800 20 remove_watcher() i=0 2024-05-15T14:46:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.260+0000 7fd8d5211800 2 removed watcher, disabling cache 2024-05-15T14:46:20.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.261+0000 7fd8d5211800 20 remove_watcher() i=1 2024-05-15T14:46:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.262+0000 7fd8d5211800 20 remove_watcher() i=2 2024-05-15T14:46:20.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.263+0000 7fd8d5211800 20 remove_watcher() i=3 2024-05-15T14:46:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.264+0000 7fd8d5211800 20 remove_watcher() i=4 2024-05-15T14:46:20.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.265+0000 7fd8d5211800 20 remove_watcher() i=5 2024-05-15T14:46:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.266+0000 7fd8d5211800 20 remove_watcher() i=6 2024-05-15T14:46:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.267+0000 7fd8d5211800 20 remove_watcher() i=7 2024-05-15T14:46:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.363+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.365+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.365+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.366+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.366+0000 7fcf17687800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.366+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.366+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.366+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.367+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:20.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.367+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.368+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.368+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.368+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.368+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.368+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.368+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.369+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.369+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 20 zone MyZone found 2024-05-15T14:46:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.370+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.371+0000 7fcf17687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.371+0000 7fcf17687800 20 started sync module instance, tier type = 2024-05-15T14:46:20.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.371+0000 7fcf17687800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.380+0000 7fcf17687800 20 add_watcher() i=0 2024-05-15T14:46:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.380+0000 7fcf17687800 20 add_watcher() i=1 2024-05-15T14:46:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.380+0000 7fcf17687800 20 add_watcher() i=2 2024-05-15T14:46:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.380+0000 7fcf17687800 20 add_watcher() i=3 2024-05-15T14:46:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.380+0000 7fcf17687800 20 add_watcher() i=4 2024-05-15T14:46:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.380+0000 7fcf17687800 20 add_watcher() i=5 2024-05-15T14:46:20.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.380+0000 7fcf17687800 20 add_watcher() i=6 2024-05-15T14:46:20.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.381+0000 7fcf17687800 20 add_watcher() i=7 2024-05-15T14:46:20.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.381+0000 7fcf17687800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:20.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.382+0000 7fcdcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.383+0000 7fcf17687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:20.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.383+0000 7fcf17687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:20.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.383+0000 7fcf17687800 5 note: GC not initialized 2024-05-15T14:46:20.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.383+0000 7fcdca7e4640 20 reqs_thread_entry: start 2024-05-15T14:46:20.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.383+0000 7fcf17687800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:20.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.383+0000 7fcf17687800 20 Filter name: none 2024-05-15T14:46:20.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.383+0000 7fcd3bfff640 20 reqs_thread_entry: start 2024-05-15T14:46:20.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.392+0000 7fcf17687800 20 RGWRados::pool_iterate: got topic.:vwwrqh-25_topic 2024-05-15T14:46:20.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.392+0000 7fcf17687800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-26_topic 2024-05-15T14:46:20.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.392+0000 7fcf17687800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-27_topic 2024-05-15T14:46:20.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.392+0000 7fcf17687800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.393+0000 7fcf17687800 20 rados_obj.operate() r=0 bl.length=260 2024-05-15T14:46:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.394+0000 7fcdcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.396+0000 7fcf17687800 20 remove_watcher() i=0 2024-05-15T14:46:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.396+0000 7fcf17687800 2 removed watcher, disabling cache 2024-05-15T14:46:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.397+0000 7fcf17687800 20 remove_watcher() i=1 2024-05-15T14:46:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.398+0000 7fcf17687800 20 remove_watcher() i=2 2024-05-15T14:46:20.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.399+0000 7fcf17687800 20 remove_watcher() i=3 2024-05-15T14:46:20.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.400+0000 7fcf17687800 20 remove_watcher() i=4 2024-05-15T14:46:20.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.401+0000 7fcf17687800 20 remove_watcher() i=5 2024-05-15T14:46:20.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.402+0000 7fcf17687800 20 remove_watcher() i=6 2024-05-15T14:46:20.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.403+0000 7fcf17687800 20 remove_watcher() i=7 2024-05-15T14:46:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:20.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.499+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.500+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.500+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.501+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.501+0000 7fc6475af800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:20.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.501+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.501+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.501+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.502+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.502+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.503+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.503+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.503+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.503+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.503+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.503+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.504+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.504+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 20 zone MyZone found 2024-05-15T14:46:20.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.505+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.506+0000 7fc6475af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.506+0000 7fc6475af800 20 started sync module instance, tier type = 2024-05-15T14:46:20.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.506+0000 7fc6475af800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:20.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.515+0000 7fc6475af800 20 add_watcher() i=0 2024-05-15T14:46:20.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.515+0000 7fc6475af800 20 add_watcher() i=1 2024-05-15T14:46:20.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.515+0000 7fc6475af800 20 add_watcher() i=2 2024-05-15T14:46:20.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.515+0000 7fc6475af800 20 add_watcher() i=3 2024-05-15T14:46:20.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.515+0000 7fc6475af800 20 add_watcher() i=4 2024-05-15T14:46:20.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.515+0000 7fc6475af800 20 add_watcher() i=5 2024-05-15T14:46:20.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.515+0000 7fc6475af800 20 add_watcher() i=6 2024-05-15T14:46:20.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.516+0000 7fc6475af800 20 add_watcher() i=7 2024-05-15T14:46:20.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.516+0000 7fc6475af800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:20.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.517+0000 7fc4fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.518+0000 7fc6475af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:20.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.518+0000 7fc6475af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:20.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.518+0000 7fc6475af800 5 note: GC not initialized 2024-05-15T14:46:20.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.518+0000 7fc4fa7e4640 20 reqs_thread_entry: start 2024-05-15T14:46:20.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.518+0000 7fc6475af800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:20.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.518+0000 7fc6475af800 20 Filter name: none 2024-05-15T14:46:20.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.518+0000 7fc46bfff640 20 reqs_thread_entry: start 2024-05-15T14:46:20.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.527+0000 7fc6475af800 20 RGWRados::pool_iterate: got topic.:vwwrqh-25_topic 2024-05-15T14:46:20.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.527+0000 7fc6475af800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-26_topic 2024-05-15T14:46:20.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.527+0000 7fc6475af800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-27_topic 2024-05-15T14:46:20.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.527+0000 7fc6475af800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.528+0000 7fc6475af800 20 rados_obj.operate() r=0 bl.length=260 2024-05-15T14:46:20.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.529+0000 7fc4fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.531+0000 7fc6475af800 20 remove_watcher() i=0 2024-05-15T14:46:20.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.531+0000 7fc6475af800 2 removed watcher, disabling cache 2024-05-15T14:46:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.532+0000 7fc6475af800 20 remove_watcher() i=1 2024-05-15T14:46:20.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.533+0000 7fc6475af800 20 remove_watcher() i=2 2024-05-15T14:46:20.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.534+0000 7fc6475af800 20 remove_watcher() i=3 2024-05-15T14:46:20.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.535+0000 7fc6475af800 20 remove_watcher() i=4 2024-05-15T14:46:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.536+0000 7fc6475af800 20 remove_watcher() i=5 2024-05-15T14:46:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.537+0000 7fc6475af800 20 remove_watcher() i=6 2024-05-15T14:46:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.538+0000 7fc6475af800 20 remove_watcher() i=7 2024-05-15T14:46:20.595 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:20.595 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:20.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.634+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.636+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.636+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.637+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.637+0000 7effdcd19800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:20.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.637+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.637+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.637+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.638+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.638+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.639+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.639+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.639+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.639+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.639+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.639+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.640+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.640+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 zone MyZone found 2024-05-15T14:46:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 started sync module instance, tier type = 2024-05-15T14:46:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.641+0000 7effdcd19800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:20.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.651+0000 7effdcd19800 20 add_watcher() i=0 2024-05-15T14:46:20.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.651+0000 7effdcd19800 20 add_watcher() i=1 2024-05-15T14:46:20.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.651+0000 7effdcd19800 20 add_watcher() i=2 2024-05-15T14:46:20.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.651+0000 7effdcd19800 20 add_watcher() i=3 2024-05-15T14:46:20.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.651+0000 7effdcd19800 20 add_watcher() i=4 2024-05-15T14:46:20.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.651+0000 7effdcd19800 20 add_watcher() i=5 2024-05-15T14:46:20.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.651+0000 7effdcd19800 20 add_watcher() i=6 2024-05-15T14:46:20.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.652+0000 7effdcd19800 20 add_watcher() i=7 2024-05-15T14:46:20.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.652+0000 7effdcd19800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:20.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.653+0000 7efe917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.653+0000 7effdcd19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:20.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.653+0000 7effdcd19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:20.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.654+0000 7effdcd19800 5 note: GC not initialized 2024-05-15T14:46:20.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.654+0000 7efe0bfff640 20 reqs_thread_entry: start 2024-05-15T14:46:20.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.654+0000 7effdcd19800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.654+0000 7effdcd19800 20 Filter name: none 2024-05-15T14:46:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.654+0000 7efe09ffb640 20 reqs_thread_entry: start 2024-05-15T14:46:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.654+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.654+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=187 2024-05-15T14:46:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.654+0000 7effdcd19800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.655+0000 7effdcd19800 20 rados_obj.operate() r=0 bl.length=401 2024-05-15T14:46:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.655+0000 7effdcd19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:46:20.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.657+0000 7efe917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.659+0000 7effdcd19800 20 remove_watcher() i=0 2024-05-15T14:46:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.659+0000 7effdcd19800 2 removed watcher, disabling cache 2024-05-15T14:46:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.660+0000 7effdcd19800 20 remove_watcher() i=1 2024-05-15T14:46:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.660+0000 7effdcd19800 20 remove_watcher() i=2 2024-05-15T14:46:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.661+0000 7effdcd19800 20 remove_watcher() i=3 2024-05-15T14:46:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.662+0000 7effdcd19800 20 remove_watcher() i=4 2024-05-15T14:46:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.663+0000 7effdcd19800 20 remove_watcher() i=5 2024-05-15T14:46:20.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.664+0000 7effdcd19800 20 remove_watcher() i=6 2024-05-15T14:46:20.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.665+0000 7effdcd19800 20 remove_watcher() i=7 2024-05-15T14:46:20.724 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:20.724 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:20.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.763+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.765+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.765+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.765+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.765+0000 7fd7a792f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:20.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.765+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.766+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.766+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.766+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:20.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.766+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.767+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:20.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.767+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.767+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.767+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.768+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.768+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.768+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.768+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:20.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 20 zone MyZone found 2024-05-15T14:46:20.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:20.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.769+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.770+0000 7fd7a792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.770+0000 7fd7a792f800 20 started sync module instance, tier type = 2024-05-15T14:46:20.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.770+0000 7fd7a792f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.779+0000 7fd7a792f800 20 add_watcher() i=0 2024-05-15T14:46:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.779+0000 7fd7a792f800 20 add_watcher() i=1 2024-05-15T14:46:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.779+0000 7fd7a792f800 20 add_watcher() i=2 2024-05-15T14:46:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.779+0000 7fd7a792f800 20 add_watcher() i=3 2024-05-15T14:46:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.779+0000 7fd7a792f800 20 add_watcher() i=4 2024-05-15T14:46:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.779+0000 7fd7a792f800 20 add_watcher() i=5 2024-05-15T14:46:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.779+0000 7fd7a792f800 20 add_watcher() i=6 2024-05-15T14:46:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.780+0000 7fd7a792f800 20 add_watcher() i=7 2024-05-15T14:46:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.780+0000 7fd7a792f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.781+0000 7fd659fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.782+0000 7fd7a792f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.782+0000 7fd7a792f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.782+0000 7fd7a792f800 5 note: GC not initialized 2024-05-15T14:46:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.782+0000 7fd658fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.782+0000 7fd7a792f800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.782+0000 7fd7a792f800 20 Filter name: none 2024-05-15T14:46:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.782+0000 7fd5d27fc640 20 reqs_thread_entry: start 2024-05-15T14:46:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.782+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.783+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=231 2024-05-15T14:46:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.783+0000 7fd7a792f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.783+0000 7fd7a792f800 20 rados_obj.operate() r=0 bl.length=453 2024-05-15T14:46:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.783+0000 7fd7a792f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:46:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.785+0000 7fd659fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.787+0000 7fd7a792f800 20 remove_watcher() i=0 2024-05-15T14:46:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.787+0000 7fd7a792f800 2 removed watcher, disabling cache 2024-05-15T14:46:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.788+0000 7fd7a792f800 20 remove_watcher() i=1 2024-05-15T14:46:20.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.789+0000 7fd7a792f800 20 remove_watcher() i=2 2024-05-15T14:46:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.790+0000 7fd7a792f800 20 remove_watcher() i=3 2024-05-15T14:46:20.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.791+0000 7fd7a792f800 20 remove_watcher() i=4 2024-05-15T14:46:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.792+0000 7fd7a792f800 20 remove_watcher() i=5 2024-05-15T14:46:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.793+0000 7fd7a792f800 20 remove_watcher() i=6 2024-05-15T14:46:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.794+0000 7fd7a792f800 20 remove_watcher() i=7 2024-05-15T14:46:20.852 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:20.853 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:20.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.891+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.893+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.893+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.893+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.893+0000 7fe504f2d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:20.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.893+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.894+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.894+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.894+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:20.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.894+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.895+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:20.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.895+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.895+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.895+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.896+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:20.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.896+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.897+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:20.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.897+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:20.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 zone MyZone found 2024-05-15T14:46:20.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:20.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:20.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:20.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:20.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:20.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:20.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:20.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 started sync module instance, tier type = 2024-05-15T14:46:20.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.898+0000 7fe504f2d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:20.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 20 add_watcher() i=0 2024-05-15T14:46:20.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 20 add_watcher() i=1 2024-05-15T14:46:20.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 20 add_watcher() i=2 2024-05-15T14:46:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 20 add_watcher() i=3 2024-05-15T14:46:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 20 add_watcher() i=4 2024-05-15T14:46:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 20 add_watcher() i=5 2024-05-15T14:46:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 20 add_watcher() i=6 2024-05-15T14:46:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 20 add_watcher() i=7 2024-05-15T14:46:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.909+0000 7fe504f2d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:20.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.911+0000 7fe3b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.911+0000 7fe504f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:20.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.911+0000 7fe504f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:20.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.911+0000 7fe504f2d800 5 note: GC not initialized 2024-05-15T14:46:20.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.911+0000 7fe3b5fe3640 20 reqs_thread_entry: start 2024-05-15T14:46:20.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.912+0000 7fe504f2d800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:20.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.912+0000 7fe504f2d800 20 Filter name: none 2024-05-15T14:46:20.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.912+0000 7fe3277fe640 20 reqs_thread_entry: start 2024-05-15T14:46:20.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.912+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.912+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=231 2024-05-15T14:46:20.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.912+0000 7fe504f2d800 20 rados->read ofs=0 len=0 2024-05-15T14:46:20.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.913+0000 7fe504f2d800 20 rados_obj.operate() r=0 bl.length=453 2024-05-15T14:46:20.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.913+0000 7fe504f2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:46:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.915+0000 7fe3b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.917+0000 7fe504f2d800 20 remove_watcher() i=0 2024-05-15T14:46:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.917+0000 7fe504f2d800 2 removed watcher, disabling cache 2024-05-15T14:46:20.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.917+0000 7fe504f2d800 20 remove_watcher() i=1 2024-05-15T14:46:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.918+0000 7fe504f2d800 20 remove_watcher() i=2 2024-05-15T14:46:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.919+0000 7fe504f2d800 20 remove_watcher() i=3 2024-05-15T14:46:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.920+0000 7fe504f2d800 20 remove_watcher() i=4 2024-05-15T14:46:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.921+0000 7fe504f2d800 20 remove_watcher() i=5 2024-05-15T14:46:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.922+0000 7fe504f2d800 20 remove_watcher() i=6 2024-05-15T14:46:20.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:20.923+0000 7fe504f2d800 20 remove_watcher() i=7 2024-05-15T14:46:21.169 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-15?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:jliWcoDlqDm/UchDtLxDiAFALQM=\r\nDate: Wed, 15 May 2024 14:33:58 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000abe216b0e0f9dfa9-006644c7d6-4586-MyZone 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:33:58 GMT 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + async http notification is: 25.695323944091797 milliseconds 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-16?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:GfNOAR01EYR/mmj1MOUsNeMiwXo=\r\nDate: Wed, 15 May 2024 14:36:00 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.170 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000a220d939aca9ea9c-006644c850-4586-MyZone 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:36:00 GMT 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-17?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:B/M+kMqfsM62/3ywiWRMv5Au144=\r\nDate: Wed, 15 May 2024 14:36:51 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000004e47448518ab3455-006644c883-4586-MyZone 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.171 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:36:51 GMT 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-17?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:B/M+kMqfsM62/3ywiWRMv5Au144=\r\nDate: Wed, 15 May 2024 14:36:51 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx0000044efd9e429d5f536-006644c883-4586-MyZone 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:36:51 GMT 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + async http notification is: 23.38465690612793 milliseconds 2024-05-15T14:46:21.172 INFO:teuthology.orchestra.run.smithi018.stdout:average time for deletion + async http notification is: 2.0621800422668457 milliseconds 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-18?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:DIXfMaggbHJPzQXkTUfrzSRwRIs=\r\nDate: Wed, 15 May 2024 14:37:41 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000e86a954bb9388adb-006644c8b5-4586-MyZone 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:37:41 GMT 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + async http notification is: 23.831233978271484 milliseconds 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:average time for deletion + async http notification is: 2.2770285606384277 milliseconds 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-19?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715783861.4446368:Sbo69ooMcb1RC5efSFJ8k9NG3/4=\r\nDate: Wed, 15 May 2024 14:38:09 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.173 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx0000079ff2d7d580c2428-006644c8d1-4586-MyZone 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:38:09 GMT 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-20?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715783890.5353844:C1hegDWzxoiImNnv1M5zOkKxc6E=\r\nDate: Wed, 15 May 2024 14:38:10 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000006ecb6f4420bfaf8b-006644c8d2-4586-MyZone 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.174 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:38:10 GMT 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-21?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715783890.9371297:4TglTD5AE9xcTfra99fI/d6xbWI=\r\nDate: Wed, 15 May 2024 14:38:11 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000b591a65c043df206-006644c8d3-4586-MyZone 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:38:11 GMT 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:delete all topics 2024-05-15T14:46:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:('', 0) 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:('', 0) 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:start http server 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + async http notification is: 24.97889995574951 milliseconds 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + async http notification is: 25.373363494873047 milliseconds 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + async http notification is: 25.005793571472168 milliseconds 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-23?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:MIXEM7o+6n8QOsZ43KgX54e3Vek=\r\nDate: Wed, 15 May 2024 14:44:20 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.176 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000007d108011985003bb-006644ca44-7019-MyZone 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:44:20 GMT 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + http notification is: 27.71775722503662 milliseconds 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:average time for creation + http notification is: 27.55916118621826 milliseconds 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-24?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:Pg59LaH4KHyg/IP+PHREpBIlm/o=\r\nDate: Wed, 15 May 2024 14:45:18 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.177 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000006fd7b778373f2ba6-006644ca7e-8104-MyZone 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:45:18 GMT 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:('', 0) 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:('', 0) 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.179 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:migration in process... error: 154 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-25?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:UVtKSZeFvsM+KwTB/R9/je2FPo8=\r\nDate: Wed, 15 May 2024 14:46:20 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.180 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx0000074ee5318416b4ec4-006644cabc-8843-MyZone 2024-05-15T14:46:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:46:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:46:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:46:21 GMT 2024-05-15T14:46:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:46:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-26?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715784319.077319:mG7JlwukvaMjBOiStSD1MWmFTMA=\r\nDate: Wed, 15 May 2024 14:46:21 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:46:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:46:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:46:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:46:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:test data path v2 mixed migration ... ignoring --setuser ceph since I am not root 2024-05-15T14:46:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:21.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.471+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.473+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.473+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.474+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.474+0000 7fd298d29800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:21.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.474+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.474+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.474+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.475+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.475+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.476+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.476+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.476+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.476+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.476+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.476+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.477+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.477+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 zone MyZone found 2024-05-15T14:46:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 started sync module instance, tier type = 2024-05-15T14:46:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.478+0000 7fd298d29800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.488+0000 7fd298d29800 20 add_watcher() i=0 2024-05-15T14:46:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.488+0000 7fd298d29800 20 add_watcher() i=1 2024-05-15T14:46:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.488+0000 7fd298d29800 20 add_watcher() i=2 2024-05-15T14:46:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.488+0000 7fd298d29800 20 add_watcher() i=3 2024-05-15T14:46:21.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.488+0000 7fd298d29800 20 add_watcher() i=4 2024-05-15T14:46:21.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.488+0000 7fd298d29800 20 add_watcher() i=5 2024-05-15T14:46:21.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.488+0000 7fd298d29800 20 add_watcher() i=6 2024-05-15T14:46:21.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.489+0000 7fd298d29800 20 add_watcher() i=7 2024-05-15T14:46:21.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.489+0000 7fd298d29800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:21.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.490+0000 7fd14afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:21.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.491+0000 7fd298d29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:21.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.491+0000 7fd298d29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.491+0000 7fd298d29800 5 note: GC not initialized 2024-05-15T14:46:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.491+0000 7fd149fe3640 20 reqs_thread_entry: start 2024-05-15T14:46:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.491+0000 7fd298d29800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.491+0000 7fd298d29800 20 Filter name: none 2024-05-15T14:46:21.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.491+0000 7fd0bb7fe640 20 reqs_thread_entry: start 2024-05-15T14:46:21.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.501+0000 7fd14afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:21.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.503+0000 7fd298d29800 20 remove_watcher() i=0 2024-05-15T14:46:21.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.503+0000 7fd298d29800 2 removed watcher, disabling cache 2024-05-15T14:46:21.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.504+0000 7fd298d29800 20 remove_watcher() i=1 2024-05-15T14:46:21.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.505+0000 7fd298d29800 20 remove_watcher() i=2 2024-05-15T14:46:21.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.506+0000 7fd298d29800 20 remove_watcher() i=3 2024-05-15T14:46:21.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.507+0000 7fd298d29800 20 remove_watcher() i=4 2024-05-15T14:46:21.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.508+0000 7fd298d29800 20 remove_watcher() i=5 2024-05-15T14:46:21.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.509+0000 7fd298d29800 20 remove_watcher() i=6 2024-05-15T14:46:21.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.510+0000 7fd298d29800 20 remove_watcher() i=7 2024-05-15T14:46:21.565 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:21.565 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:21.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.595+0000 7fe605f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:21.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.595+0000 7fe605f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.598+0000 7fe437fff640 20 reqs_thread_entry: start 2024-05-15T14:46:21.657 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:21.657 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:21.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.686+0000 7fe8ea919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.686+0000 7fe8ea919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.690+0000 7fe72e7fc640 20 reqs_thread_entry: start 2024-05-15T14:46:21.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.694+0000 7fe8ea919800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:46:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.707+0000 7fe8ea919800 20 updating latest_epoch from 6 -> 7 on period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:46:21.763 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:21.763 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:21.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.802+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.804+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.804+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.805+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.805+0000 7efd1a262800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:21.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.805+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.805+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.805+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.806+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.806+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.806+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.806+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.807+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.807+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.807+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.807+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 20 zone MyZone found 2024-05-15T14:46:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:7 2024-05-15T14:46:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:21.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:21.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.808+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.809+0000 7efd1a262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:21.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.809+0000 7efd1a262800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.809+0000 7efd1a262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:21.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.809+0000 7efd1a262800 20 started sync module instance, tier type = 2024-05-15T14:46:21.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.809+0000 7efd1a262800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:21.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.819+0000 7efd1a262800 20 add_watcher() i=0 2024-05-15T14:46:21.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.819+0000 7efd1a262800 20 add_watcher() i=1 2024-05-15T14:46:21.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.819+0000 7efd1a262800 20 add_watcher() i=2 2024-05-15T14:46:21.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.819+0000 7efd1a262800 20 add_watcher() i=3 2024-05-15T14:46:21.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.819+0000 7efd1a262800 20 add_watcher() i=4 2024-05-15T14:46:21.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.819+0000 7efd1a262800 20 add_watcher() i=5 2024-05-15T14:46:21.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.819+0000 7efd1a262800 20 add_watcher() i=6 2024-05-15T14:46:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.820+0000 7efd1a262800 20 add_watcher() i=7 2024-05-15T14:46:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.820+0000 7efd1a262800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.821+0000 7efbcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.822+0000 7efd1a262800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.822+0000 7efd1a262800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.822+0000 7efd1a262800 5 note: GC not initialized 2024-05-15T14:46:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.822+0000 7efbccfe1640 20 reqs_thread_entry: start 2024-05-15T14:46:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.822+0000 7efd1a262800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.822+0000 7efd1a262800 20 Filter name: none 2024-05-15T14:46:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.822+0000 7efb467fc640 20 reqs_thread_entry: start 2024-05-15T14:46:21.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.824+0000 7efd1a262800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:46:21.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.826+0000 7efd1a262800 20 updating latest_epoch from 7 -> 8 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:46:21.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.831+0000 7efd1a262800 4 Committed new epoch 8 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:46:21.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.833+0000 7efbcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:21.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.835+0000 7efd1a262800 20 remove_watcher() i=0 2024-05-15T14:46:21.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.835+0000 7efd1a262800 2 removed watcher, disabling cache 2024-05-15T14:46:21.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.836+0000 7efd1a262800 20 remove_watcher() i=1 2024-05-15T14:46:21.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.837+0000 7efd1a262800 20 remove_watcher() i=2 2024-05-15T14:46:21.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.838+0000 7efd1a262800 20 remove_watcher() i=3 2024-05-15T14:46:21.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.839+0000 7efd1a262800 20 remove_watcher() i=4 2024-05-15T14:46:21.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.840+0000 7efd1a262800 20 remove_watcher() i=5 2024-05-15T14:46:21.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.841+0000 7efd1a262800 20 remove_watcher() i=6 2024-05-15T14:46:21.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.842+0000 7efd1a262800 20 remove_watcher() i=7 2024-05-15T14:46:21.907 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:21.907 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:21.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.948+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.949+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.949+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.950+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.950+0000 7f4dbdf33800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.950+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.950+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.950+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.951+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.951+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.951+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.951+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.951+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.951+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.952+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.952+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.952+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.952+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 20 zone MyZone found 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:8 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.953+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.954+0000 7f4dbdf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.954+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.954+0000 7f4dbdf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.954+0000 7f4dbdf33800 20 started sync module instance, tier type = 2024-05-15T14:46:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.954+0000 7f4dbdf33800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.963+0000 7f4dbdf33800 20 add_watcher() i=0 2024-05-15T14:46:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.963+0000 7f4dbdf33800 20 add_watcher() i=1 2024-05-15T14:46:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.963+0000 7f4dbdf33800 20 add_watcher() i=2 2024-05-15T14:46:21.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.963+0000 7f4dbdf33800 20 add_watcher() i=3 2024-05-15T14:46:21.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.963+0000 7f4dbdf33800 20 add_watcher() i=4 2024-05-15T14:46:21.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.963+0000 7f4dbdf33800 20 add_watcher() i=5 2024-05-15T14:46:21.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.963+0000 7f4dbdf33800 20 add_watcher() i=6 2024-05-15T14:46:21.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.964+0000 7f4dbdf33800 20 add_watcher() i=7 2024-05-15T14:46:21.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.964+0000 7f4dbdf33800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:21.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.966+0000 7f4c6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:21.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.966+0000 7f4dbdf33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:21.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.966+0000 7f4dbdf33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:21.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.966+0000 7f4dbdf33800 5 note: GC not initialized 2024-05-15T14:46:21.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.966+0000 7f4c6a7fc640 20 reqs_thread_entry: start 2024-05-15T14:46:21.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:21.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 20 Filter name: none 2024-05-15T14:46:21.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4bdffff640 20 reqs_thread_entry: start 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 10 cache get: name=MyZone.rgw.meta+users.uid+kaboom_1$superman1715784381.854312 : miss 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom_1$superman1715784381.854312 info.flags=0x0 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 10 adding MyZone.rgw.meta+users.uid+kaboom_1$superman1715784381.854312 to cache LRU end 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784381.854302 : miss 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 20 rados->read ofs=0 len=0 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 10 cache put: name=MyZone.rgw.meta+users.keys+1715784381.854302 info.flags=0x0 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 10 adding MyZone.rgw.meta+users.keys+1715784381.854302 to cache LRU end 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784381.854302 : hit (negative entry) 2024-05-15T14:46:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.967+0000 7f4dbdf33800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784381.854302 : hit (negative entry) 2024-05-15T14:46:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.969+0000 7f4dbdf33800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom_1$superman1715784381.854312 info.flags=0x17 2024-05-15T14:46:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.969+0000 7f4dbdf33800 10 moving MyZone.rgw.meta+users.uid+kaboom_1$superman1715784381.854312 to cache LRU end 2024-05-15T14:46:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.969+0000 7f4dbdf33800 10 distributing notification oid=MyZone.rgw.control:notify.6 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:kaboom_1$superman1715784381.854312, ofs0, ns] 2024-05-15T14:46:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.969+0000 7f4c9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724973 cookie 94245845282576 notifier 9083 bl.length()=600 2024-05-15T14:46:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.969+0000 7f4c9d7fa640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+kaboom_1$superman1715784381.854312 info.flags=0x17 2024-05-15T14:46:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.969+0000 7f4c9d7fa640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+kaboom_1$superman1715784381.854312 to cache LRU end 2024-05-15T14:46:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.971+0000 7f4dbdf33800 10 cache put: name=MyZone.rgw.meta+users.keys+1715784381.854302 info.flags=0x7 2024-05-15T14:46:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.971+0000 7f4dbdf33800 10 moving MyZone.rgw.meta+users.keys+1715784381.854302 to cache LRU end 2024-05-15T14:46:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.971+0000 7f4dbdf33800 10 distributing notification oid=MyZone.rgw.control:notify.5 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715784381.854302, ofs0, ns] 2024-05-15T14:46:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.971+0000 7f4c9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724974 cookie 94245845256112 notifier 9083 bl.length()=204 2024-05-15T14:46:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.971+0000 7f4c9cff9640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715784381.854302 info.flags=0x7 2024-05-15T14:46:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.971+0000 7f4c9cff9640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715784381.854302 to cache LRU end 2024-05-15T14:46:21.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.972+0000 7f4c6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.974+0000 7f4dbdf33800 20 remove_watcher() i=0 2024-05-15T14:46:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.974+0000 7f4dbdf33800 2 removed watcher, disabling cache 2024-05-15T14:46:21.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.976+0000 7f4dbdf33800 20 remove_watcher() i=1 2024-05-15T14:46:21.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.976+0000 7f4dbdf33800 20 remove_watcher() i=2 2024-05-15T14:46:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.978+0000 7f4dbdf33800 20 remove_watcher() i=3 2024-05-15T14:46:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.978+0000 7f4dbdf33800 20 remove_watcher() i=4 2024-05-15T14:46:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.979+0000 7f4dbdf33800 20 remove_watcher() i=5 2024-05-15T14:46:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.980+0000 7f4dbdf33800 20 remove_watcher() i=6 2024-05-15T14:46:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:21.981+0000 7f4dbdf33800 20 remove_watcher() i=7 2024-05-15T14:46:22.040 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:22.040 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:22.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.080+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.082+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.082+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.083+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.083+0000 7f70e2b23800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.083+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.083+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.083+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.084+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:22.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.084+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.084+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:22.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.084+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.084+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.084+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.085+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.085+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.085+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 20 zone MyZone found 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:8 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.086+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.087+0000 7f70e2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:22.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.087+0000 7f70e2b23800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.087+0000 7f70e2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:22.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.087+0000 7f70e2b23800 20 started sync module instance, tier type = 2024-05-15T14:46:22.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.087+0000 7f70e2b23800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.097+0000 7f70e2b23800 20 add_watcher() i=0 2024-05-15T14:46:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.097+0000 7f70e2b23800 20 add_watcher() i=1 2024-05-15T14:46:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.097+0000 7f70e2b23800 20 add_watcher() i=2 2024-05-15T14:46:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.097+0000 7f70e2b23800 20 add_watcher() i=3 2024-05-15T14:46:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.097+0000 7f70e2b23800 20 add_watcher() i=4 2024-05-15T14:46:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.097+0000 7f70e2b23800 20 add_watcher() i=5 2024-05-15T14:46:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.097+0000 7f70e2b23800 20 add_watcher() i=6 2024-05-15T14:46:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.098+0000 7f70e2b23800 20 add_watcher() i=7 2024-05-15T14:46:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.098+0000 7f70e2b23800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:22.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.099+0000 7f6f94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:22.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.100+0000 7f70e2b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:22.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.100+0000 7f70e2b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:22.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.100+0000 7f70e2b23800 5 note: GC not initialized 2024-05-15T14:46:22.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.100+0000 7f6f0f7fe640 20 reqs_thread_entry: start 2024-05-15T14:46:22.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.100+0000 7f70e2b23800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.100+0000 7f70e2b23800 20 Filter name: none 2024-05-15T14:46:22.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.100+0000 7f6f0d7fa640 20 reqs_thread_entry: start 2024-05-15T14:46:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.110+0000 7f6f94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.113+0000 7f70e2b23800 20 remove_watcher() i=0 2024-05-15T14:46:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.113+0000 7f70e2b23800 2 removed watcher, disabling cache 2024-05-15T14:46:22.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.113+0000 7f70e2b23800 20 remove_watcher() i=1 2024-05-15T14:46:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.114+0000 7f70e2b23800 20 remove_watcher() i=2 2024-05-15T14:46:22.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.115+0000 7f70e2b23800 20 remove_watcher() i=3 2024-05-15T14:46:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.116+0000 7f70e2b23800 20 remove_watcher() i=4 2024-05-15T14:46:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.117+0000 7f70e2b23800 20 remove_watcher() i=5 2024-05-15T14:46:22.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.118+0000 7f70e2b23800 20 remove_watcher() i=6 2024-05-15T14:46:22.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.119+0000 7f70e2b23800 20 remove_watcher() i=7 2024-05-15T14:46:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:22.185 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:22.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.224+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.225+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.225+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.226+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.226+0000 7f68f181f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.226+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.226+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.226+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.227+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.227+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.228+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.228+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.228+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.228+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.228+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.228+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.229+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.229+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 zone MyZone found 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:8 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 started sync module instance, tier type = 2024-05-15T14:46:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.230+0000 7f68f181f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:22.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.240+0000 7f68f181f800 20 add_watcher() i=0 2024-05-15T14:46:22.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.240+0000 7f68f181f800 20 add_watcher() i=1 2024-05-15T14:46:22.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.240+0000 7f68f181f800 20 add_watcher() i=2 2024-05-15T14:46:22.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.240+0000 7f68f181f800 20 add_watcher() i=3 2024-05-15T14:46:22.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.240+0000 7f68f181f800 20 add_watcher() i=4 2024-05-15T14:46:22.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.240+0000 7f68f181f800 20 add_watcher() i=5 2024-05-15T14:46:22.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.240+0000 7f68f181f800 20 add_watcher() i=6 2024-05-15T14:46:22.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.241+0000 7f68f181f800 20 add_watcher() i=7 2024-05-15T14:46:22.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.241+0000 7f68f181f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:22.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.243+0000 7f67a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:22.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.243+0000 7f68f181f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.243+0000 7f68f181f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 5 note: GC not initialized 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f67a4fe1640 20 reqs_thread_entry: start 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 20 Filter name: none 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f671e7fc640 20 reqs_thread_entry: start 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 10 cache get: name=MyZone.rgw.meta+users.uid+kaboom_2$superman1715784382.131934 : miss 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom_2$superman1715784382.131934 info.flags=0x0 2024-05-15T14:46:22.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 10 adding MyZone.rgw.meta+users.uid+kaboom_2$superman1715784382.131934 to cache LRU end 2024-05-15T14:46:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784382.1319225 : miss 2024-05-15T14:46:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.244+0000 7f68f181f800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.245+0000 7f68f181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.245+0000 7f68f181f800 10 cache put: name=MyZone.rgw.meta+users.keys+1715784382.1319225 info.flags=0x0 2024-05-15T14:46:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.245+0000 7f68f181f800 10 adding MyZone.rgw.meta+users.keys+1715784382.1319225 to cache LRU end 2024-05-15T14:46:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.245+0000 7f68f181f800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784382.1319225 : hit (negative entry) 2024-05-15T14:46:22.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.245+0000 7f68f181f800 10 cache get: name=MyZone.rgw.meta+users.keys+1715784382.1319225 : hit (negative entry) 2024-05-15T14:46:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.246+0000 7f68f181f800 10 cache put: name=MyZone.rgw.meta+users.uid+kaboom_2$superman1715784382.131934 info.flags=0x17 2024-05-15T14:46:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.246+0000 7f68f181f800 10 moving MyZone.rgw.meta+users.uid+kaboom_2$superman1715784382.131934 to cache LRU end 2024-05-15T14:46:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.246+0000 7f68f181f800 10 distributing notification oid=MyZone.rgw.control:notify.6 cni=[op: 0, obj: MyZone.rgw.meta:users.uid:kaboom_2$superman1715784382.131934, ofs0, ns] 2024-05-15T14:46:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.246+0000 7f67d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724975 cookie 94558181442240 notifier 9116 bl.length()=603 2024-05-15T14:46:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.246+0000 7f67d2ffd640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.uid+kaboom_2$superman1715784382.131934 info.flags=0x17 2024-05-15T14:46:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.246+0000 7f67d2ffd640 10 rgw watcher librados: moving MyZone.rgw.meta+users.uid+kaboom_2$superman1715784382.131934 to cache LRU end 2024-05-15T14:46:22.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.248+0000 7f68f181f800 10 cache put: name=MyZone.rgw.meta+users.keys+1715784382.1319225 info.flags=0x7 2024-05-15T14:46:22.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.248+0000 7f68f181f800 10 moving MyZone.rgw.meta+users.keys+1715784382.1319225 to cache LRU end 2024-05-15T14:46:22.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.248+0000 7f68f181f800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 0, obj: MyZone.rgw.meta:users.keys:1715784382.1319225, ofs0, ns] 2024-05-15T14:46:22.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.248+0000 7f67d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724956 cookie 94558181391952 notifier 9116 bl.length()=205 2024-05-15T14:46:22.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.248+0000 7f67d2ffd640 10 rgw watcher librados: cache put: name=MyZone.rgw.meta+users.keys+1715784382.1319225 info.flags=0x7 2024-05-15T14:46:22.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.248+0000 7f67d2ffd640 10 rgw watcher librados: moving MyZone.rgw.meta+users.keys+1715784382.1319225 to cache LRU end 2024-05-15T14:46:22.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.249+0000 7f67a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.251+0000 7f68f181f800 20 remove_watcher() i=0 2024-05-15T14:46:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.251+0000 7f68f181f800 2 removed watcher, disabling cache 2024-05-15T14:46:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.252+0000 7f68f181f800 20 remove_watcher() i=1 2024-05-15T14:46:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.253+0000 7f68f181f800 20 remove_watcher() i=2 2024-05-15T14:46:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.254+0000 7f68f181f800 20 remove_watcher() i=3 2024-05-15T14:46:22.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.255+0000 7f68f181f800 20 remove_watcher() i=4 2024-05-15T14:46:22.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.256+0000 7f68f181f800 20 remove_watcher() i=5 2024-05-15T14:46:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.257+0000 7f68f181f800 20 remove_watcher() i=6 2024-05-15T14:46:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.258+0000 7f68f181f800 20 remove_watcher() i=7 2024-05-15T14:46:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:22.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.353+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.355+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.355+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.356+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.356+0000 7f1740519800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:22.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.356+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.356+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.356+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.357+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:22.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.357+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.357+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:22.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.357+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.357+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.357+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.358+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:22.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.358+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.358+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:22.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.358+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 20 zone MyZone found 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:8 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.359+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.360+0000 7f1740519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.360+0000 7f1740519800 20 rados->read ofs=0 len=0 2024-05-15T14:46:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.360+0000 7f1740519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.360+0000 7f1740519800 20 started sync module instance, tier type = 2024-05-15T14:46:22.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.360+0000 7f1740519800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:22.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.369+0000 7f1740519800 20 add_watcher() i=0 2024-05-15T14:46:22.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.369+0000 7f1740519800 20 add_watcher() i=1 2024-05-15T14:46:22.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.369+0000 7f1740519800 20 add_watcher() i=2 2024-05-15T14:46:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.369+0000 7f1740519800 20 add_watcher() i=3 2024-05-15T14:46:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.369+0000 7f1740519800 20 add_watcher() i=4 2024-05-15T14:46:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.369+0000 7f1740519800 20 add_watcher() i=5 2024-05-15T14:46:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.369+0000 7f1740519800 20 add_watcher() i=6 2024-05-15T14:46:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.370+0000 7f1740519800 20 add_watcher() i=7 2024-05-15T14:46:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.370+0000 7f1740519800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.372+0000 7f15f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.372+0000 7f1740519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.372+0000 7f1740519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.372+0000 7f1740519800 5 note: GC not initialized 2024-05-15T14:46:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.372+0000 7f156f7fe640 20 reqs_thread_entry: start 2024-05-15T14:46:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.372+0000 7f1740519800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.373+0000 7f1740519800 20 Filter name: none 2024-05-15T14:46:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.373+0000 7f156d7fa640 20 reqs_thread_entry: start 2024-05-15T14:46:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.382+0000 7f15f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.384+0000 7f1740519800 20 remove_watcher() i=0 2024-05-15T14:46:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.384+0000 7f1740519800 2 removed watcher, disabling cache 2024-05-15T14:46:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.385+0000 7f1740519800 20 remove_watcher() i=1 2024-05-15T14:46:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.386+0000 7f1740519800 20 remove_watcher() i=2 2024-05-15T14:46:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.387+0000 7f1740519800 20 remove_watcher() i=3 2024-05-15T14:46:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.388+0000 7f1740519800 20 remove_watcher() i=4 2024-05-15T14:46:22.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.389+0000 7f1740519800 20 remove_watcher() i=5 2024-05-15T14:46:22.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.390+0000 7f1740519800 20 remove_watcher() i=6 2024-05-15T14:46:22.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:22.391+0000 7f1740519800 20 remove_watcher() i=7 2024-05-15T14:46:49.630 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:46:49.627+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:46:49.630 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:46:49.627+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:46:49.631 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:46:49.627+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:46:49.631 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:46:49.627+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:46:49.819 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:46:49.818+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:46:49.819 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:46:49.818+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:46:49.819 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:46:49.818+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:46:49.819 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:46:49.818+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:46:50.004 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:50.004 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:50.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.039+0000 7feec092f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:50.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.039+0000 7feec092f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:50.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.044+0000 7fed027fc640 20 reqs_thread_entry: start 2024-05-15T14:46:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:50.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.141+0000 7f217972c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:50.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.141+0000 7f217972c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:50.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.146+0000 7f1fabfff640 20 reqs_thread_entry: start 2024-05-15T14:46:50.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.149+0000 7f217972c800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:46:50.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.162+0000 7f217972c800 20 updating latest_epoch from 7 -> 8 on period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:46:50.218 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:46:50.218 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:46:50.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.257+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.259+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:50.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.259+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.260+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:50.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.260+0000 7f1f8b525800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:46:50.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.260+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.260+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:50.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.260+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.261+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:46:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.261+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.261+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:46:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.261+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.261+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:50.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.261+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.262+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:46:50.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.262+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.262+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:46:50.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.262+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:46:50.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 20 zone MyZone found 2024-05-15T14:46:50.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:46:50.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:46:50.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:46:50.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:8 2024-05-15T14:46:50.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 20 period zonegroup name MyZoneGroup 2024-05-15T14:46:50.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:46:50.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.263+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.264+0000 7f1f8b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:50.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.264+0000 7f1f8b525800 20 rados->read ofs=0 len=0 2024-05-15T14:46:50.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.264+0000 7f1f8b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:46:50.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.264+0000 7f1f8b525800 20 started sync module instance, tier type = 2024-05-15T14:46:50.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.264+0000 7f1f8b525800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:46:50.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.274+0000 7f1f8b525800 20 add_watcher() i=0 2024-05-15T14:46:50.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.274+0000 7f1f8b525800 20 add_watcher() i=1 2024-05-15T14:46:50.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.274+0000 7f1f8b525800 20 add_watcher() i=2 2024-05-15T14:46:50.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.274+0000 7f1f8b525800 20 add_watcher() i=3 2024-05-15T14:46:50.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.274+0000 7f1f8b525800 20 add_watcher() i=4 2024-05-15T14:46:50.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.274+0000 7f1f8b525800 20 add_watcher() i=5 2024-05-15T14:46:50.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.274+0000 7f1f8b525800 20 add_watcher() i=6 2024-05-15T14:46:50.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.275+0000 7f1f8b525800 20 add_watcher() i=7 2024-05-15T14:46:50.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.275+0000 7f1f8b525800 2 all 8 watchers are set, enabling cache 2024-05-15T14:46:50.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.276+0000 7f1e3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:50.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.276+0000 7f1f8b525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:46:50.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.276+0000 7f1f8b525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:46:50.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.277+0000 7f1f8b525800 5 note: GC not initialized 2024-05-15T14:46:50.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.277+0000 7f1e3cfe1640 20 reqs_thread_entry: start 2024-05-15T14:46:50.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.277+0000 7f1f8b525800 20 init_complete bucket index max shards: 11 2024-05-15T14:46:50.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.277+0000 7f1f8b525800 20 Filter name: none 2024-05-15T14:46:50.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.277+0000 7f1db67fc640 20 reqs_thread_entry: start 2024-05-15T14:46:50.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.279+0000 7f1f8b525800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:46:50.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.280+0000 7f1f8b525800 20 updating latest_epoch from 8 -> 9 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:46:50.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.286+0000 7f1f8b525800 4 Committed new epoch 9 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:46:50.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.288+0000 7f1e3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:46:50.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.290+0000 7f1f8b525800 20 remove_watcher() i=0 2024-05-15T14:46:50.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.290+0000 7f1f8b525800 2 removed watcher, disabling cache 2024-05-15T14:46:50.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.291+0000 7f1f8b525800 20 remove_watcher() i=1 2024-05-15T14:46:50.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.292+0000 7f1f8b525800 20 remove_watcher() i=2 2024-05-15T14:46:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.293+0000 7f1f8b525800 20 remove_watcher() i=3 2024-05-15T14:46:50.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.294+0000 7f1f8b525800 20 remove_watcher() i=4 2024-05-15T14:46:50.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.295+0000 7f1f8b525800 20 remove_watcher() i=5 2024-05-15T14:46:50.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.296+0000 7f1f8b525800 20 remove_watcher() i=6 2024-05-15T14:46:50.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:46:50.297+0000 7f1f8b525800 20 remove_watcher() i=7 2024-05-15T14:47:21.096 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:21.095+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:47:21.097 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:21.095+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:47:21.097 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:21.095+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:47:21.097 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:21.095+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:47:21.192 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:47:21.190+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:47:21.192 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:47:21.190+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:47:21.192 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:47:21.190+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:47:21.192 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:47:21.190+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:47:21.282 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:21.282 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:21.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.326+0000 7feb33487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:21.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.326+0000 7feb33487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:21.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.331+0000 7fe976ffd640 20 reqs_thread_entry: start 2024-05-15T14:47:21.405 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:21.405 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:21.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.443+0000 7f86c0b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:21.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.443+0000 7f86c0b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.449+0000 7f8580fe1640 20 reqs_thread_entry: start 2024-05-15T14:47:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.452+0000 7f86c0b40800 20 fork_period realm id=c960760b-b2d7-439f-9323-6ff955b035b5 period id=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:47:21.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.465+0000 7f86c0b40800 20 updating latest_epoch from 8 -> 9 on period=c960760b-b2d7-439f-9323-6ff955b035b5:staging 2024-05-15T14:47:21.525 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:21.525 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:21.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.564+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.566+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.566+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.567+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.567+0000 7f072e23f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.567+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.567+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.567+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.568+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:21.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.568+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.569+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=1107 2024-05-15T14:47:21.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.569+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.569+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:21.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.569+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.569+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:21.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.569+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 20 zone MyZone found 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:9 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.570+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.571+0000 7f072e23f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:21.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.571+0000 7f072e23f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.571+0000 7f072e23f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:21.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.571+0000 7f072e23f800 20 started sync module instance, tier type = 2024-05-15T14:47:21.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.571+0000 7f072e23f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:21.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.581+0000 7f072e23f800 20 add_watcher() i=0 2024-05-15T14:47:21.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.581+0000 7f072e23f800 20 add_watcher() i=1 2024-05-15T14:47:21.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.581+0000 7f072e23f800 20 add_watcher() i=2 2024-05-15T14:47:21.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.581+0000 7f072e23f800 20 add_watcher() i=3 2024-05-15T14:47:21.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.581+0000 7f072e23f800 20 add_watcher() i=4 2024-05-15T14:47:21.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.581+0000 7f072e23f800 20 add_watcher() i=5 2024-05-15T14:47:21.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.581+0000 7f072e23f800 20 add_watcher() i=6 2024-05-15T14:47:21.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.582+0000 7f072e23f800 20 add_watcher() i=7 2024-05-15T14:47:21.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.582+0000 7f072e23f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:21.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.584+0000 7f05e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:21.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.584+0000 7f072e23f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:21.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.584+0000 7f072e23f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:21.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.585+0000 7f072e23f800 5 note: GC not initialized 2024-05-15T14:47:21.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.585+0000 7f05e0fe1640 20 reqs_thread_entry: start 2024-05-15T14:47:21.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.585+0000 7f072e23f800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:21.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.585+0000 7f072e23f800 20 Filter name: none 2024-05-15T14:47:21.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.585+0000 7f055a7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:21.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.587+0000 7f072e23f800 20 commit_period realm c960760b-b2d7-439f-9323-6ff955b035b5 period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:47:21.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.588+0000 7f072e23f800 20 updating latest_epoch from 9 -> 10 on period=450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:47:21.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.594+0000 7f072e23f800 4 Committed new epoch 10 for period 450b0ad8-e873-4e0c-9309-d9dacbb20322 2024-05-15T14:47:21.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.596+0000 7f05e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.598+0000 7f072e23f800 20 remove_watcher() i=0 2024-05-15T14:47:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.598+0000 7f072e23f800 2 removed watcher, disabling cache 2024-05-15T14:47:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.599+0000 7f072e23f800 20 remove_watcher() i=1 2024-05-15T14:47:21.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.600+0000 7f072e23f800 20 remove_watcher() i=2 2024-05-15T14:47:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.601+0000 7f072e23f800 20 remove_watcher() i=3 2024-05-15T14:47:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.602+0000 7f072e23f800 20 remove_watcher() i=4 2024-05-15T14:47:21.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.603+0000 7f072e23f800 20 remove_watcher() i=5 2024-05-15T14:47:21.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.604+0000 7f072e23f800 20 remove_watcher() i=6 2024-05-15T14:47:21.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.605+0000 7f072e23f800 20 remove_watcher() i=7 2024-05-15T14:47:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.701+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.703+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.703+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.704+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.704+0000 7f015911f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.704+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.704+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.704+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.705+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.705+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.706+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.706+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.706+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.706+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.706+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.706+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.707+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.707+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 zone MyZone found 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 started sync module instance, tier type = 2024-05-15T14:47:21.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.708+0000 7f015911f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:21.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.717+0000 7f015911f800 20 add_watcher() i=0 2024-05-15T14:47:21.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.717+0000 7f015911f800 20 add_watcher() i=1 2024-05-15T14:47:21.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.717+0000 7f015911f800 20 add_watcher() i=2 2024-05-15T14:47:21.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.717+0000 7f015911f800 20 add_watcher() i=3 2024-05-15T14:47:21.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.717+0000 7f015911f800 20 add_watcher() i=4 2024-05-15T14:47:21.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.717+0000 7f015911f800 20 add_watcher() i=5 2024-05-15T14:47:21.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.717+0000 7f015911f800 20 add_watcher() i=6 2024-05-15T14:47:21.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.718+0000 7f015911f800 20 add_watcher() i=7 2024-05-15T14:47:21.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.718+0000 7f015911f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:21.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.720+0000 7f000b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:21.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.720+0000 7f015911f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:21.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.720+0000 7f015911f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:21.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.720+0000 7f015911f800 5 note: GC not initialized 2024-05-15T14:47:21.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.720+0000 7f000a7e4640 20 reqs_thread_entry: start 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.720+0000 7f015911f800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.721+0000 7f015911f800 20 Filter name: none 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.721+0000 7f00037fe640 20 reqs_thread_entry: start 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.721+0000 7f015911f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.721+0000 7f015911f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.721+0000 7f015911f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.721+0000 7f015911f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.721+0000 7f015911f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:21.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.722+0000 7f000b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:21.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.724+0000 7f015911f800 20 remove_watcher() i=0 2024-05-15T14:47:21.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.724+0000 7f015911f800 2 removed watcher, disabling cache 2024-05-15T14:47:21.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.725+0000 7f015911f800 20 remove_watcher() i=1 2024-05-15T14:47:21.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.726+0000 7f015911f800 20 remove_watcher() i=2 2024-05-15T14:47:21.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.726+0000 7f015911f800 20 remove_watcher() i=3 2024-05-15T14:47:21.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.727+0000 7f015911f800 20 remove_watcher() i=4 2024-05-15T14:47:21.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.728+0000 7f015911f800 20 remove_watcher() i=5 2024-05-15T14:47:21.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.729+0000 7f015911f800 20 remove_watcher() i=6 2024-05-15T14:47:21.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:21.730+0000 7f015911f800 20 remove_watcher() i=7 2024-05-15T14:47:22.795 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:22.796 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.840+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.842+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:22.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.842+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.843+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:22.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.843+0000 7fd1aa5af800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:22.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.843+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.843+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.843+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.844+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.844+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.844+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.844+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.845+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.845+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.845+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.845+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.846+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:22.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.846+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 zone MyZone found 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 started sync module instance, tier type = 2024-05-15T14:47:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.847+0000 7fd1aa5af800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.858+0000 7fd1aa5af800 20 add_watcher() i=0 2024-05-15T14:47:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.858+0000 7fd1aa5af800 20 add_watcher() i=1 2024-05-15T14:47:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.858+0000 7fd1aa5af800 20 add_watcher() i=2 2024-05-15T14:47:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.858+0000 7fd1aa5af800 20 add_watcher() i=3 2024-05-15T14:47:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.858+0000 7fd1aa5af800 20 add_watcher() i=4 2024-05-15T14:47:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.858+0000 7fd1aa5af800 20 add_watcher() i=5 2024-05-15T14:47:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.858+0000 7fd1aa5af800 20 add_watcher() i=6 2024-05-15T14:47:22.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.859+0000 7fd1aa5af800 20 add_watcher() i=7 2024-05-15T14:47:22.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.859+0000 7fd1aa5af800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.861+0000 7fd05efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.861+0000 7fd1aa5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.861+0000 7fd1aa5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.861+0000 7fd1aa5af800 5 note: GC not initialized 2024-05-15T14:47:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.861+0000 7fd05dfdb640 20 reqs_thread_entry: start 2024-05-15T14:47:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.861+0000 7fd1aa5af800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.862+0000 7fd1aa5af800 20 Filter name: none 2024-05-15T14:47:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.862+0000 7fcfcf7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.862+0000 7fd1aa5af800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:22.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.862+0000 7fd1aa5af800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:22.866 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:22.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.862+0000 7fd1aa5af800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:22.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.862+0000 7fd1aa5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:22.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.862+0000 7fd1aa5af800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:22.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.863+0000 7fd05efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:22.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.866+0000 7fd1aa5af800 20 remove_watcher() i=0 2024-05-15T14:47:22.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.866+0000 7fd1aa5af800 2 removed watcher, disabling cache 2024-05-15T14:47:22.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.867+0000 7fd1aa5af800 20 remove_watcher() i=1 2024-05-15T14:47:22.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.868+0000 7fd1aa5af800 20 remove_watcher() i=2 2024-05-15T14:47:22.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.870+0000 7fd1aa5af800 20 remove_watcher() i=3 2024-05-15T14:47:22.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.871+0000 7fd1aa5af800 20 remove_watcher() i=4 2024-05-15T14:47:22.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.872+0000 7fd1aa5af800 20 remove_watcher() i=5 2024-05-15T14:47:22.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.873+0000 7fd1aa5af800 20 remove_watcher() i=6 2024-05-15T14:47:22.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:22.874+0000 7fd1aa5af800 20 remove_watcher() i=7 2024-05-15T14:47:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:23.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.983+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.985+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:23.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.985+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.986+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:23.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.986+0000 7fc2df933800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:23.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.986+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.986+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:23.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.986+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.987+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:23.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.987+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.988+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:23.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.988+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.988+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:23.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.988+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.989+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.989+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.989+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:23.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.989+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 20 zone MyZone found 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.990+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.991+0000 7fc2df933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.991+0000 7fc2df933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.991+0000 7fc2df933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.991+0000 7fc2df933800 20 started sync module instance, tier type = 2024-05-15T14:47:23.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:23.991+0000 7fc2df933800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:24.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.009+0000 7fc2df933800 20 add_watcher() i=0 2024-05-15T14:47:24.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.009+0000 7fc2df933800 20 add_watcher() i=1 2024-05-15T14:47:24.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.009+0000 7fc2df933800 20 add_watcher() i=2 2024-05-15T14:47:24.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.009+0000 7fc2df933800 20 add_watcher() i=3 2024-05-15T14:47:24.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.009+0000 7fc2df933800 20 add_watcher() i=4 2024-05-15T14:47:24.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.009+0000 7fc2df933800 20 add_watcher() i=5 2024-05-15T14:47:24.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.009+0000 7fc2df933800 20 add_watcher() i=6 2024-05-15T14:47:24.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.010+0000 7fc2df933800 20 add_watcher() i=7 2024-05-15T14:47:24.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.010+0000 7fc2df933800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:24.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.012+0000 7fc191fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:24.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.012+0000 7fc2df933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:24.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.012+0000 7fc2df933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:24.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.012+0000 7fc2df933800 5 note: GC not initialized 2024-05-15T14:47:24.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.012+0000 7fc190fe1640 20 reqs_thread_entry: start 2024-05-15T14:47:24.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.012+0000 7fc2df933800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:24.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.013+0000 7fc2df933800 20 Filter name: none 2024-05-15T14:47:24.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.013+0000 7fc10a7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:24.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.013+0000 7fc2df933800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:24.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.013+0000 7fc2df933800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:24.016 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:24.013+0000 7fc2df933800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:24.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.013+0000 7fc2df933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:24.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.013+0000 7fc2df933800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:24.016 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:24.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.014+0000 7fc191fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:24.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.017+0000 7fc2df933800 20 remove_watcher() i=0 2024-05-15T14:47:24.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.017+0000 7fc2df933800 2 removed watcher, disabling cache 2024-05-15T14:47:24.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.018+0000 7fc2df933800 20 remove_watcher() i=1 2024-05-15T14:47:24.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.019+0000 7fc2df933800 20 remove_watcher() i=2 2024-05-15T14:47:24.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.020+0000 7fc2df933800 20 remove_watcher() i=3 2024-05-15T14:47:24.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.021+0000 7fc2df933800 20 remove_watcher() i=4 2024-05-15T14:47:24.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.022+0000 7fc2df933800 20 remove_watcher() i=5 2024-05-15T14:47:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.023+0000 7fc2df933800 20 remove_watcher() i=6 2024-05-15T14:47:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:24.024+0000 7fc2df933800 20 remove_watcher() i=7 2024-05-15T14:47:25.089 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:25.090 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.133+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.135+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.135+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.136+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:25.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.136+0000 7f8d4c462800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:25.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.136+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.137+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:25.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.137+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.137+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:25.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.137+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.138+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:25.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.138+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.138+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.138+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.139+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.139+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.139+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.139+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 20 zone MyZone found 2024-05-15T14:47:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.140+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.141+0000 7f8d4c462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:25.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.141+0000 7f8d4c462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:25.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.141+0000 7f8d4c462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:25.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.141+0000 7f8d4c462800 20 started sync module instance, tier type = 2024-05-15T14:47:25.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.141+0000 7f8d4c462800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:25.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.152+0000 7f8d4c462800 20 add_watcher() i=0 2024-05-15T14:47:25.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.152+0000 7f8d4c462800 20 add_watcher() i=1 2024-05-15T14:47:25.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.152+0000 7f8d4c462800 20 add_watcher() i=2 2024-05-15T14:47:25.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.152+0000 7f8d4c462800 20 add_watcher() i=3 2024-05-15T14:47:25.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.152+0000 7f8d4c462800 20 add_watcher() i=4 2024-05-15T14:47:25.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.152+0000 7f8d4c462800 20 add_watcher() i=5 2024-05-15T14:47:25.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.152+0000 7f8d4c462800 20 add_watcher() i=6 2024-05-15T14:47:25.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.153+0000 7f8d4c462800 20 add_watcher() i=7 2024-05-15T14:47:25.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.153+0000 7f8d4c462800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:25.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.155+0000 7f8bfbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:25.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.155+0000 7f8d4c462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:25.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.155+0000 7f8d4c462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:25.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.155+0000 7f8d4c462800 5 note: GC not initialized 2024-05-15T14:47:25.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8bfaffd640 20 reqs_thread_entry: start 2024-05-15T14:47:25.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8d4c462800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:25.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8d4c462800 20 Filter name: none 2024-05-15T14:47:25.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8bf8ff9640 20 reqs_thread_entry: start 2024-05-15T14:47:25.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8d4c462800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:25.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8d4c462800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:25.158 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:25.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8d4c462800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:25.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8d4c462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:25.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.156+0000 7f8d4c462800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:25.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.157+0000 7f8bfbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:25.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.160+0000 7f8d4c462800 20 remove_watcher() i=0 2024-05-15T14:47:25.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.160+0000 7f8d4c462800 2 removed watcher, disabling cache 2024-05-15T14:47:25.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.161+0000 7f8d4c462800 20 remove_watcher() i=1 2024-05-15T14:47:25.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.162+0000 7f8d4c462800 20 remove_watcher() i=2 2024-05-15T14:47:25.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.164+0000 7f8d4c462800 20 remove_watcher() i=3 2024-05-15T14:47:25.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.165+0000 7f8d4c462800 20 remove_watcher() i=4 2024-05-15T14:47:25.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.166+0000 7f8d4c462800 20 remove_watcher() i=5 2024-05-15T14:47:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.167+0000 7f8d4c462800 20 remove_watcher() i=6 2024-05-15T14:47:25.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:25.168+0000 7f8d4c462800 20 remove_watcher() i=7 2024-05-15T14:47:26.234 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:26.234 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:26.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.279+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.280+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:26.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.280+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.281+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:26.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.281+0000 7f0c78946800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:26.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.281+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.282+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:26.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.282+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.282+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:26.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.282+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.283+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:26.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.283+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.283+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:26.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.283+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.284+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:26.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.284+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.284+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:26.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.284+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 20 zone MyZone found 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.285+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.286+0000 7f0c78946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:26.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.286+0000 7f0c78946800 20 rados->read ofs=0 len=0 2024-05-15T14:47:26.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.286+0000 7f0c78946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:26.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.286+0000 7f0c78946800 20 started sync module instance, tier type = 2024-05-15T14:47:26.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.286+0000 7f0c78946800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:26.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.296+0000 7f0c78946800 20 add_watcher() i=0 2024-05-15T14:47:26.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.296+0000 7f0c78946800 20 add_watcher() i=1 2024-05-15T14:47:26.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.296+0000 7f0c78946800 20 add_watcher() i=2 2024-05-15T14:47:26.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.296+0000 7f0c78946800 20 add_watcher() i=3 2024-05-15T14:47:26.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.296+0000 7f0c78946800 20 add_watcher() i=4 2024-05-15T14:47:26.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.296+0000 7f0c78946800 20 add_watcher() i=5 2024-05-15T14:47:26.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.297+0000 7f0c78946800 20 add_watcher() i=6 2024-05-15T14:47:26.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.297+0000 7f0c78946800 20 add_watcher() i=7 2024-05-15T14:47:26.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.297+0000 7f0c78946800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:26.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.299+0000 7f0b2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.300+0000 7f0c78946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.300+0000 7f0c78946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.300+0000 7f0c78946800 5 note: GC not initialized 2024-05-15T14:47:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.300+0000 7f0aa77fe640 20 reqs_thread_entry: start 2024-05-15T14:47:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.300+0000 7f0c78946800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:26.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.300+0000 7f0c78946800 20 Filter name: none 2024-05-15T14:47:26.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.300+0000 7f0aa57fa640 20 reqs_thread_entry: start 2024-05-15T14:47:26.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.300+0000 7f0c78946800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:26.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.301+0000 7f0c78946800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:26.302 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:26.301+0000 7f0c78946800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:26.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.301+0000 7f0c78946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:26.303 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:26.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.301+0000 7f0c78946800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:26.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.302+0000 7f0b2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:26.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.304+0000 7f0c78946800 20 remove_watcher() i=0 2024-05-15T14:47:26.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.304+0000 7f0c78946800 2 removed watcher, disabling cache 2024-05-15T14:47:26.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.305+0000 7f0c78946800 20 remove_watcher() i=1 2024-05-15T14:47:26.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.306+0000 7f0c78946800 20 remove_watcher() i=2 2024-05-15T14:47:26.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.307+0000 7f0c78946800 20 remove_watcher() i=3 2024-05-15T14:47:26.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.308+0000 7f0c78946800 20 remove_watcher() i=4 2024-05-15T14:47:26.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.309+0000 7f0c78946800 20 remove_watcher() i=5 2024-05-15T14:47:26.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.310+0000 7f0c78946800 20 remove_watcher() i=6 2024-05-15T14:47:26.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:26.311+0000 7f0c78946800 20 remove_watcher() i=7 2024-05-15T14:47:27.377 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:27.377 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:27.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.421+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.423+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:27.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.423+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.423+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:27.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.423+0000 7f4d12098800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:27.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.423+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.424+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:27.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.424+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.424+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:27.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.424+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.425+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:27.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.425+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.425+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:27.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.425+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.426+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:27.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.426+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.427+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:27.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.427+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 zone MyZone found 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 rados->read ofs=0 len=0 2024-05-15T14:47:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 started sync module instance, tier type = 2024-05-15T14:47:27.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.428+0000 7f4d12098800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:27.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.439+0000 7f4d12098800 20 add_watcher() i=0 2024-05-15T14:47:27.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.439+0000 7f4d12098800 20 add_watcher() i=1 2024-05-15T14:47:27.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.439+0000 7f4d12098800 20 add_watcher() i=2 2024-05-15T14:47:27.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.439+0000 7f4d12098800 20 add_watcher() i=3 2024-05-15T14:47:27.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.439+0000 7f4d12098800 20 add_watcher() i=4 2024-05-15T14:47:27.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.439+0000 7f4d12098800 20 add_watcher() i=5 2024-05-15T14:47:27.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.439+0000 7f4d12098800 20 add_watcher() i=6 2024-05-15T14:47:27.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.440+0000 7f4d12098800 20 add_watcher() i=7 2024-05-15T14:47:27.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.440+0000 7f4d12098800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.441+0000 7f4bc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:27.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.442+0000 7f4d12098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:27.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.442+0000 7f4d12098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:27.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.442+0000 7f4d12098800 5 note: GC not initialized 2024-05-15T14:47:27.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.442+0000 7f4bc4fe1640 20 reqs_thread_entry: start 2024-05-15T14:47:27.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.442+0000 7f4d12098800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:27.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.442+0000 7f4d12098800 20 Filter name: none 2024-05-15T14:47:27.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.442+0000 7f4b3e7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:27.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.442+0000 7f4d12098800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:27.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.443+0000 7f4d12098800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:27.445 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:27.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.443+0000 7f4d12098800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:27.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.443+0000 7f4d12098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:27.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.443+0000 7f4d12098800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:27.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.444+0000 7f4bc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:27.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.446+0000 7f4d12098800 20 remove_watcher() i=0 2024-05-15T14:47:27.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.446+0000 7f4d12098800 2 removed watcher, disabling cache 2024-05-15T14:47:27.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.447+0000 7f4d12098800 20 remove_watcher() i=1 2024-05-15T14:47:27.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.448+0000 7f4d12098800 20 remove_watcher() i=2 2024-05-15T14:47:27.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.450+0000 7f4d12098800 20 remove_watcher() i=3 2024-05-15T14:47:27.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.451+0000 7f4d12098800 20 remove_watcher() i=4 2024-05-15T14:47:27.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.452+0000 7f4d12098800 20 remove_watcher() i=5 2024-05-15T14:47:27.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.453+0000 7f4d12098800 20 remove_watcher() i=6 2024-05-15T14:47:27.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:27.454+0000 7f4d12098800 20 remove_watcher() i=7 2024-05-15T14:47:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.564+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.566+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.566+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.567+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:28.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.567+0000 7f9212b25800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:28.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.567+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.567+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:28.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.567+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.568+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:28.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.568+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.568+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:28.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.569+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.569+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:28.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.569+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.569+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:28.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.569+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.570+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:28.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.570+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 20 zone MyZone found 2024-05-15T14:47:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.571+0000 7f9212b25800 20 rados->read ofs=0 len=0 2024-05-15T14:47:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.572+0000 7f9212b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:28.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.572+0000 7f9212b25800 20 started sync module instance, tier type = 2024-05-15T14:47:28.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.572+0000 7f9212b25800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.582+0000 7f9212b25800 20 add_watcher() i=0 2024-05-15T14:47:28.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.582+0000 7f9212b25800 20 add_watcher() i=1 2024-05-15T14:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.582+0000 7f9212b25800 20 add_watcher() i=2 2024-05-15T14:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.582+0000 7f9212b25800 20 add_watcher() i=3 2024-05-15T14:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.582+0000 7f9212b25800 20 add_watcher() i=4 2024-05-15T14:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.582+0000 7f9212b25800 20 add_watcher() i=5 2024-05-15T14:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.582+0000 7f9212b25800 20 add_watcher() i=6 2024-05-15T14:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.583+0000 7f9212b25800 20 add_watcher() i=7 2024-05-15T14:47:28.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.583+0000 7f9212b25800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:28.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.585+0000 7f90c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.586+0000 7f9212b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.586+0000 7f9212b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.586+0000 7f9212b25800 5 note: GC not initialized 2024-05-15T14:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.586+0000 7f903ffff640 20 reqs_thread_entry: start 2024-05-15T14:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.586+0000 7f9212b25800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:28.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.586+0000 7f9212b25800 20 Filter name: none 2024-05-15T14:47:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.586+0000 7f903dffb640 20 reqs_thread_entry: start 2024-05-15T14:47:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.587+0000 7f9212b25800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.587+0000 7f9212b25800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:28.587+0000 7f9212b25800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.587+0000 7f9212b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:47:28.587+0000 7f9212b25800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:28.588 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.588+0000 7f90c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:28.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.590+0000 7f9212b25800 20 remove_watcher() i=0 2024-05-15T14:47:28.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.590+0000 7f9212b25800 2 removed watcher, disabling cache 2024-05-15T14:47:28.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.591+0000 7f9212b25800 20 remove_watcher() i=1 2024-05-15T14:47:28.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.592+0000 7f9212b25800 20 remove_watcher() i=2 2024-05-15T14:47:28.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.593+0000 7f9212b25800 20 remove_watcher() i=3 2024-05-15T14:47:28.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.595+0000 7f9212b25800 20 remove_watcher() i=4 2024-05-15T14:47:28.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.596+0000 7f9212b25800 20 remove_watcher() i=5 2024-05-15T14:47:28.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.597+0000 7f9212b25800 20 remove_watcher() i=6 2024-05-15T14:47:28.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:28.598+0000 7f9212b25800 20 remove_watcher() i=7 2024-05-15T14:47:29.664 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:29.664 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:29.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.708+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.709+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:29.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.709+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.710+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:29.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.710+0000 7f2f7c5af800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:29.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.710+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.711+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.711+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.711+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.711+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.712+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:29.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.712+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.712+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:29.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.712+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.713+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.713+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.713+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.713+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 20 zone MyZone found 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.714+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.715+0000 7f2f7c5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.715+0000 7f2f7c5af800 20 rados->read ofs=0 len=0 2024-05-15T14:47:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.715+0000 7f2f7c5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.715+0000 7f2f7c5af800 20 started sync module instance, tier type = 2024-05-15T14:47:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.715+0000 7f2f7c5af800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:29.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.726+0000 7f2f7c5af800 20 add_watcher() i=0 2024-05-15T14:47:29.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.726+0000 7f2f7c5af800 20 add_watcher() i=1 2024-05-15T14:47:29.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.726+0000 7f2f7c5af800 20 add_watcher() i=2 2024-05-15T14:47:29.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.726+0000 7f2f7c5af800 20 add_watcher() i=3 2024-05-15T14:47:29.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.726+0000 7f2f7c5af800 20 add_watcher() i=4 2024-05-15T14:47:29.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.726+0000 7f2f7c5af800 20 add_watcher() i=5 2024-05-15T14:47:29.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.726+0000 7f2f7c5af800 20 add_watcher() i=6 2024-05-15T14:47:29.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.727+0000 7f2f7c5af800 20 add_watcher() i=7 2024-05-15T14:47:29.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.727+0000 7f2f7c5af800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:29.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.728+0000 7f2e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:29.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.729+0000 7f2f7c5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.729+0000 7f2f7c5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.729+0000 7f2f7c5af800 5 note: GC not initialized 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.729+0000 7f2dab7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.729+0000 7f2f7c5af800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.729+0000 7f2f7c5af800 20 Filter name: none 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.729+0000 7f2da97fa640 20 reqs_thread_entry: start 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.729+0000 7f2f7c5af800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.730+0000 7f2f7c5af800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:29.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.730+0000 7f2f7c5af800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:29.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.730+0000 7f2f7c5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:29.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.730+0000 7f2f7c5af800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:29.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.731+0000 7f2e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:29.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.733+0000 7f2f7c5af800 20 remove_watcher() i=0 2024-05-15T14:47:29.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.733+0000 7f2f7c5af800 2 removed watcher, disabling cache 2024-05-15T14:47:29.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.734+0000 7f2f7c5af800 20 remove_watcher() i=1 2024-05-15T14:47:29.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.736+0000 7f2f7c5af800 20 remove_watcher() i=2 2024-05-15T14:47:29.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.737+0000 7f2f7c5af800 20 remove_watcher() i=3 2024-05-15T14:47:29.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.738+0000 7f2f7c5af800 20 remove_watcher() i=4 2024-05-15T14:47:29.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.739+0000 7f2f7c5af800 20 remove_watcher() i=5 2024-05-15T14:47:29.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.740+0000 7f2f7c5af800 20 remove_watcher() i=6 2024-05-15T14:47:29.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:29.741+0000 7f2f7c5af800 20 remove_watcher() i=7 2024-05-15T14:47:30.806 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:30.806 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:30.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.850+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.852+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:30.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.852+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.853+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:30.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.853+0000 7f9920036800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:30.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.853+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.853+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:30.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.853+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.854+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:30.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.854+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.855+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:30.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.855+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.855+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:30.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.855+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.856+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:30.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.856+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.856+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:30.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.856+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 20 zone MyZone found 2024-05-15T14:47:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.857+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.858+0000 7f9920036800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.858+0000 7f9920036800 20 rados->read ofs=0 len=0 2024-05-15T14:47:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.858+0000 7f9920036800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.858+0000 7f9920036800 20 started sync module instance, tier type = 2024-05-15T14:47:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.858+0000 7f9920036800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:30.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.869+0000 7f9920036800 20 add_watcher() i=0 2024-05-15T14:47:30.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.869+0000 7f9920036800 20 add_watcher() i=1 2024-05-15T14:47:30.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.869+0000 7f9920036800 20 add_watcher() i=2 2024-05-15T14:47:30.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.869+0000 7f9920036800 20 add_watcher() i=3 2024-05-15T14:47:30.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.869+0000 7f9920036800 20 add_watcher() i=4 2024-05-15T14:47:30.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.869+0000 7f9920036800 20 add_watcher() i=5 2024-05-15T14:47:30.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.869+0000 7f9920036800 20 add_watcher() i=6 2024-05-15T14:47:30.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.870+0000 7f9920036800 20 add_watcher() i=7 2024-05-15T14:47:30.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.870+0000 7f9920036800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:30.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.871+0000 7f97cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:30.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.872+0000 7f9920036800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:30.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.872+0000 7f9920036800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:30.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.872+0000 7f9920036800 5 note: GC not initialized 2024-05-15T14:47:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.872+0000 7f97ce7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.872+0000 7f9920036800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.872+0000 7f9920036800 20 Filter name: none 2024-05-15T14:47:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.872+0000 7f973ffff640 20 reqs_thread_entry: start 2024-05-15T14:47:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.872+0000 7f9920036800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.873+0000 7f9920036800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.873+0000 7f9920036800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.873+0000 7f9920036800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.873+0000 7f9920036800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.874+0000 7f97cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:30.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.876+0000 7f9920036800 20 remove_watcher() i=0 2024-05-15T14:47:30.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.876+0000 7f9920036800 2 removed watcher, disabling cache 2024-05-15T14:47:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.877+0000 7f9920036800 20 remove_watcher() i=1 2024-05-15T14:47:30.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.879+0000 7f9920036800 20 remove_watcher() i=2 2024-05-15T14:47:30.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.880+0000 7f9920036800 20 remove_watcher() i=3 2024-05-15T14:47:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.881+0000 7f9920036800 20 remove_watcher() i=4 2024-05-15T14:47:30.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.882+0000 7f9920036800 20 remove_watcher() i=5 2024-05-15T14:47:30.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.883+0000 7f9920036800 20 remove_watcher() i=6 2024-05-15T14:47:30.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:30.884+0000 7f9920036800 20 remove_watcher() i=7 2024-05-15T14:47:31.950 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:31.950 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:31.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.994+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.996+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:31.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.996+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.997+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.997+0000 7fdc9dd2e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.997+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.997+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.997+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:31.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.998+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:31.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.998+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:31.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.998+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:31.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.998+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:32.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.999+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:32.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.999+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:32.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.999+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:32.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:31.999+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:32.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.000+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:32.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.000+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 20 zone MyZone found 2024-05-15T14:47:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.001+0000 7fdc9dd2e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.002+0000 7fdc9dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.002+0000 7fdc9dd2e800 20 started sync module instance, tier type = 2024-05-15T14:47:32.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.002+0000 7fdc9dd2e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.012+0000 7fdc9dd2e800 20 add_watcher() i=0 2024-05-15T14:47:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.012+0000 7fdc9dd2e800 20 add_watcher() i=1 2024-05-15T14:47:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.012+0000 7fdc9dd2e800 20 add_watcher() i=2 2024-05-15T14:47:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.012+0000 7fdc9dd2e800 20 add_watcher() i=3 2024-05-15T14:47:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.012+0000 7fdc9dd2e800 20 add_watcher() i=4 2024-05-15T14:47:32.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.012+0000 7fdc9dd2e800 20 add_watcher() i=5 2024-05-15T14:47:32.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.012+0000 7fdc9dd2e800 20 add_watcher() i=6 2024-05-15T14:47:32.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.013+0000 7fdc9dd2e800 20 add_watcher() i=7 2024-05-15T14:47:32.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.013+0000 7fdc9dd2e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:32.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.015+0000 7fdb4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:32.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.016+0000 7fdc9dd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:32.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.016+0000 7fdc9dd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:32.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.016+0000 7fdc9dd2e800 5 note: GC not initialized 2024-05-15T14:47:32.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.016+0000 7fdb4a7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:32.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.016+0000 7fdc9dd2e800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:32.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.016+0000 7fdc9dd2e800 20 Filter name: none 2024-05-15T14:47:32.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.016+0000 7fdabbfff640 20 reqs_thread_entry: start 2024-05-15T14:47:32.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.016+0000 7fdc9dd2e800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:32.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.017+0000 7fdc9dd2e800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:32.018 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:32.017+0000 7fdc9dd2e800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:32.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.017+0000 7fdc9dd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:32.018 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:47:32.017+0000 7fdc9dd2e800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:32.019 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:32.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.018+0000 7fdb4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:32.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.020+0000 7fdc9dd2e800 20 remove_watcher() i=0 2024-05-15T14:47:32.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.020+0000 7fdc9dd2e800 2 removed watcher, disabling cache 2024-05-15T14:47:32.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.021+0000 7fdc9dd2e800 20 remove_watcher() i=1 2024-05-15T14:47:32.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.022+0000 7fdc9dd2e800 20 remove_watcher() i=2 2024-05-15T14:47:32.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.023+0000 7fdc9dd2e800 20 remove_watcher() i=3 2024-05-15T14:47:32.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.024+0000 7fdc9dd2e800 20 remove_watcher() i=4 2024-05-15T14:47:32.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.025+0000 7fdc9dd2e800 20 remove_watcher() i=5 2024-05-15T14:47:32.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.026+0000 7fdc9dd2e800 20 remove_watcher() i=6 2024-05-15T14:47:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:32.027+0000 7fdc9dd2e800 20 remove_watcher() i=7 2024-05-15T14:47:33.093 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:33.093 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:33.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.137+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.139+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.139+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.140+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.140+0000 7f24d8808800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.140+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.140+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.140+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.141+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.141+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.142+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.142+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.142+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.142+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.142+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.142+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.143+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.143+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 20 zone MyZone found 2024-05-15T14:47:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:33.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.144+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.145+0000 7f24d8808800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.145+0000 7f24d8808800 20 rados->read ofs=0 len=0 2024-05-15T14:47:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.145+0000 7f24d8808800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.145+0000 7f24d8808800 20 started sync module instance, tier type = 2024-05-15T14:47:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.145+0000 7f24d8808800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:33.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.155+0000 7f24d8808800 20 add_watcher() i=0 2024-05-15T14:47:33.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.155+0000 7f24d8808800 20 add_watcher() i=1 2024-05-15T14:47:33.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.155+0000 7f24d8808800 20 add_watcher() i=2 2024-05-15T14:47:33.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.155+0000 7f24d8808800 20 add_watcher() i=3 2024-05-15T14:47:33.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.155+0000 7f24d8808800 20 add_watcher() i=4 2024-05-15T14:47:33.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.155+0000 7f24d8808800 20 add_watcher() i=5 2024-05-15T14:47:33.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.155+0000 7f24d8808800 20 add_watcher() i=6 2024-05-15T14:47:33.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.156+0000 7f24d8808800 20 add_watcher() i=7 2024-05-15T14:47:33.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.156+0000 7f24d8808800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:33.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.158+0000 7f238cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:33.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.158+0000 7f24d8808800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:33.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.158+0000 7f24d8808800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:33.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.158+0000 7f24d8808800 5 note: GC not initialized 2024-05-15T14:47:33.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.158+0000 7f23077fe640 20 reqs_thread_entry: start 2024-05-15T14:47:33.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.159+0000 7f24d8808800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:33.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.159+0000 7f24d8808800 20 Filter name: none 2024-05-15T14:47:33.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.159+0000 7f23057fa640 20 reqs_thread_entry: start 2024-05-15T14:47:33.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.159+0000 7f24d8808800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:33.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.159+0000 7f24d8808800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:33.161 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:33.159+0000 7f24d8808800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:33.161 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:33.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.159+0000 7f24d8808800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:33.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.159+0000 7f24d8808800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:33.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.160+0000 7f238cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:33.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.162+0000 7f24d8808800 20 remove_watcher() i=0 2024-05-15T14:47:33.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.162+0000 7f24d8808800 2 removed watcher, disabling cache 2024-05-15T14:47:33.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.163+0000 7f24d8808800 20 remove_watcher() i=1 2024-05-15T14:47:33.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.164+0000 7f24d8808800 20 remove_watcher() i=2 2024-05-15T14:47:33.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.166+0000 7f24d8808800 20 remove_watcher() i=3 2024-05-15T14:47:33.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.167+0000 7f24d8808800 20 remove_watcher() i=4 2024-05-15T14:47:33.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.168+0000 7f24d8808800 20 remove_watcher() i=5 2024-05-15T14:47:33.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.169+0000 7f24d8808800 20 remove_watcher() i=6 2024-05-15T14:47:33.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:33.170+0000 7f24d8808800 20 remove_watcher() i=7 2024-05-15T14:47:34.236 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:34.237 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:34.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.280+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.282+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.282+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.283+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.283+0000 7f9b2383a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.283+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.284+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.284+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.285+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.285+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.285+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.285+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.286+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.286+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.286+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:34.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.286+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.287+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:34.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.287+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 20 zone MyZone found 2024-05-15T14:47:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.288+0000 7f9b2383a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:34.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.289+0000 7f9b2383a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:34.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.289+0000 7f9b2383a800 20 started sync module instance, tier type = 2024-05-15T14:47:34.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.289+0000 7f9b2383a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.299+0000 7f9b2383a800 20 add_watcher() i=0 2024-05-15T14:47:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.299+0000 7f9b2383a800 20 add_watcher() i=1 2024-05-15T14:47:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.299+0000 7f9b2383a800 20 add_watcher() i=2 2024-05-15T14:47:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.299+0000 7f9b2383a800 20 add_watcher() i=3 2024-05-15T14:47:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.299+0000 7f9b2383a800 20 add_watcher() i=4 2024-05-15T14:47:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.299+0000 7f9b2383a800 20 add_watcher() i=5 2024-05-15T14:47:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.299+0000 7f9b2383a800 20 add_watcher() i=6 2024-05-15T14:47:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.300+0000 7f9b2383a800 20 add_watcher() i=7 2024-05-15T14:47:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.300+0000 7f9b2383a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:34.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.302+0000 7f99d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.303+0000 7f9b2383a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.303+0000 7f9b2383a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.303+0000 7f9b2383a800 5 note: GC not initialized 2024-05-15T14:47:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.303+0000 7f994f7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.303+0000 7f9b2383a800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.303+0000 7f9b2383a800 20 Filter name: none 2024-05-15T14:47:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.303+0000 7f994d7fa640 20 reqs_thread_entry: start 2024-05-15T14:47:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.303+0000 7f9b2383a800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.304+0000 7f9b2383a800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:34.304+0000 7f9b2383a800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.304+0000 7f9b2383a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.304+0000 7f9b2383a800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:34.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.305+0000 7f99d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:34.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.307+0000 7f9b2383a800 20 remove_watcher() i=0 2024-05-15T14:47:34.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.307+0000 7f9b2383a800 2 removed watcher, disabling cache 2024-05-15T14:47:34.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.308+0000 7f9b2383a800 20 remove_watcher() i=1 2024-05-15T14:47:34.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.309+0000 7f9b2383a800 20 remove_watcher() i=2 2024-05-15T14:47:34.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.311+0000 7f9b2383a800 20 remove_watcher() i=3 2024-05-15T14:47:34.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.312+0000 7f9b2383a800 20 remove_watcher() i=4 2024-05-15T14:47:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.313+0000 7f9b2383a800 20 remove_watcher() i=5 2024-05-15T14:47:34.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.314+0000 7f9b2383a800 20 remove_watcher() i=6 2024-05-15T14:47:34.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:34.315+0000 7f9b2383a800 20 remove_watcher() i=7 2024-05-15T14:47:35.381 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:35.381 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:35.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.425+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.426+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:35.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.426+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.427+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:35.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.427+0000 7f477f52d800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:35.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.427+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.427+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:35.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.428+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.428+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:35.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.428+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.429+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:35.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.429+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.429+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:35.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.429+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.430+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:35.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.430+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.431+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:35.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.431+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 20 zone MyZone found 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:35.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:35.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.432+0000 7f477f52d800 20 rados->read ofs=0 len=0 2024-05-15T14:47:35.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.433+0000 7f477f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:35.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.433+0000 7f477f52d800 20 started sync module instance, tier type = 2024-05-15T14:47:35.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.433+0000 7f477f52d800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:35.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.443+0000 7f477f52d800 20 add_watcher() i=0 2024-05-15T14:47:35.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.443+0000 7f477f52d800 20 add_watcher() i=1 2024-05-15T14:47:35.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.443+0000 7f477f52d800 20 add_watcher() i=2 2024-05-15T14:47:35.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.443+0000 7f477f52d800 20 add_watcher() i=3 2024-05-15T14:47:35.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.443+0000 7f477f52d800 20 add_watcher() i=4 2024-05-15T14:47:35.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.443+0000 7f477f52d800 20 add_watcher() i=5 2024-05-15T14:47:35.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.443+0000 7f477f52d800 20 add_watcher() i=6 2024-05-15T14:47:35.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.444+0000 7f477f52d800 20 add_watcher() i=7 2024-05-15T14:47:35.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.444+0000 7f477f52d800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:35.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.446+0000 7f4631fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.446+0000 7f477f52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.446+0000 7f477f52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.446+0000 7f477f52d800 5 note: GC not initialized 2024-05-15T14:47:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.446+0000 7f4630fe1640 20 reqs_thread_entry: start 2024-05-15T14:47:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.447+0000 7f477f52d800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.447+0000 7f477f52d800 20 Filter name: none 2024-05-15T14:47:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.447+0000 7f45aa7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.447+0000 7f477f52d800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.447+0000 7f477f52d800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.447+0000 7f477f52d800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.447+0000 7f477f52d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.447+0000 7f477f52d800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.448+0000 7f4631fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:35.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.451+0000 7f477f52d800 20 remove_watcher() i=0 2024-05-15T14:47:35.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.451+0000 7f477f52d800 2 removed watcher, disabling cache 2024-05-15T14:47:35.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.452+0000 7f477f52d800 20 remove_watcher() i=1 2024-05-15T14:47:35.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.453+0000 7f477f52d800 20 remove_watcher() i=2 2024-05-15T14:47:35.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.454+0000 7f477f52d800 20 remove_watcher() i=3 2024-05-15T14:47:35.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.455+0000 7f477f52d800 20 remove_watcher() i=4 2024-05-15T14:47:35.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.456+0000 7f477f52d800 20 remove_watcher() i=5 2024-05-15T14:47:35.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.457+0000 7f477f52d800 20 remove_watcher() i=6 2024-05-15T14:47:35.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:35.458+0000 7f477f52d800 20 remove_watcher() i=7 2024-05-15T14:47:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:36.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.570+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.572+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.572+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.573+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:36.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.573+0000 7f05d3d2f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:36.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.573+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.573+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:36.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.573+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.574+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:36.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.574+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.574+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:36.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.574+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.575+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:36.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.575+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.575+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:36.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.575+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.576+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:36.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.576+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:36.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 20 zone MyZone found 2024-05-15T14:47:36.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.577+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.578+0000 7f05d3d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:36.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.578+0000 7f05d3d2f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:36.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.578+0000 7f05d3d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:36.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.578+0000 7f05d3d2f800 20 started sync module instance, tier type = 2024-05-15T14:47:36.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.578+0000 7f05d3d2f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.589+0000 7f05d3d2f800 20 add_watcher() i=0 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.589+0000 7f05d3d2f800 20 add_watcher() i=1 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.589+0000 7f05d3d2f800 20 add_watcher() i=2 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.589+0000 7f05d3d2f800 20 add_watcher() i=3 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.589+0000 7f05d3d2f800 20 add_watcher() i=4 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.589+0000 7f05d3d2f800 20 add_watcher() i=5 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.589+0000 7f05d3d2f800 20 add_watcher() i=6 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.590+0000 7f05d3d2f800 20 add_watcher() i=7 2024-05-15T14:47:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.590+0000 7f05d3d2f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:36.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.591+0000 7f0485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.592+0000 7f05d3d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.592+0000 7f05d3d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.592+0000 7f05d3d2f800 5 note: GC not initialized 2024-05-15T14:47:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.592+0000 7f0484fe1640 20 reqs_thread_entry: start 2024-05-15T14:47:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.592+0000 7f05d3d2f800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.592+0000 7f05d3d2f800 20 Filter name: none 2024-05-15T14:47:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.592+0000 7f03fe7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:36.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.592+0000 7f05d3d2f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:36.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.593+0000 7f05d3d2f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:36.594 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:47:36.593+0000 7f05d3d2f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:36.594 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:36.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.593+0000 7f05d3d2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:36.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.593+0000 7f05d3d2f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:36.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.594+0000 7f0485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:36.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.596+0000 7f05d3d2f800 20 remove_watcher() i=0 2024-05-15T14:47:36.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.596+0000 7f05d3d2f800 2 removed watcher, disabling cache 2024-05-15T14:47:36.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.597+0000 7f05d3d2f800 20 remove_watcher() i=1 2024-05-15T14:47:36.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.598+0000 7f05d3d2f800 20 remove_watcher() i=2 2024-05-15T14:47:36.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.599+0000 7f05d3d2f800 20 remove_watcher() i=3 2024-05-15T14:47:36.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.600+0000 7f05d3d2f800 20 remove_watcher() i=4 2024-05-15T14:47:36.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.601+0000 7f05d3d2f800 20 remove_watcher() i=5 2024-05-15T14:47:36.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.602+0000 7f05d3d2f800 20 remove_watcher() i=6 2024-05-15T14:47:36.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:36.603+0000 7f05d3d2f800 20 remove_watcher() i=7 2024-05-15T14:47:37.669 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:37.669 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:37.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.712+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.714+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:37.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.714+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.715+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:37.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.715+0000 7f21aa83f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:37.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.715+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.715+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:37.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.715+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.716+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:37.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.716+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.717+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:37.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.717+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.717+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:37.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.717+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.718+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:37.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.718+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.719+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:37.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.719+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 zone MyZone found 2024-05-15T14:47:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:37.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:37.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:37.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:37.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:37.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 started sync module instance, tier type = 2024-05-15T14:47:37.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.720+0000 7f21aa83f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:37.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.731+0000 7f21aa83f800 20 add_watcher() i=0 2024-05-15T14:47:37.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.731+0000 7f21aa83f800 20 add_watcher() i=1 2024-05-15T14:47:37.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.731+0000 7f21aa83f800 20 add_watcher() i=2 2024-05-15T14:47:37.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.731+0000 7f21aa83f800 20 add_watcher() i=3 2024-05-15T14:47:37.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.731+0000 7f21aa83f800 20 add_watcher() i=4 2024-05-15T14:47:37.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.731+0000 7f21aa83f800 20 add_watcher() i=5 2024-05-15T14:47:37.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.731+0000 7f21aa83f800 20 add_watcher() i=6 2024-05-15T14:47:37.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.732+0000 7f21aa83f800 20 add_watcher() i=7 2024-05-15T14:47:37.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.732+0000 7f21aa83f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:37.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.734+0000 7f205efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:37.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.734+0000 7f21aa83f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:37.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.734+0000 7f21aa83f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:37.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.734+0000 7f21aa83f800 5 note: GC not initialized 2024-05-15T14:47:37.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.735+0000 7f205dfdb640 20 reqs_thread_entry: start 2024-05-15T14:47:37.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.735+0000 7f21aa83f800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:37.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.735+0000 7f21aa83f800 20 Filter name: none 2024-05-15T14:47:37.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.735+0000 7f1fcf7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:37.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.735+0000 7f21aa83f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:37.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.736+0000 7f21aa83f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:37.737 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:37.736+0000 7f21aa83f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:37.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.736+0000 7f21aa83f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:37.737 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:47:37.736+0000 7f21aa83f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:37.737 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:37.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.736+0000 7f205efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:37.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.739+0000 7f21aa83f800 20 remove_watcher() i=0 2024-05-15T14:47:37.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.739+0000 7f21aa83f800 2 removed watcher, disabling cache 2024-05-15T14:47:37.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.740+0000 7f21aa83f800 20 remove_watcher() i=1 2024-05-15T14:47:37.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.741+0000 7f21aa83f800 20 remove_watcher() i=2 2024-05-15T14:47:37.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.742+0000 7f21aa83f800 20 remove_watcher() i=3 2024-05-15T14:47:37.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.743+0000 7f21aa83f800 20 remove_watcher() i=4 2024-05-15T14:47:37.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.744+0000 7f21aa83f800 20 remove_watcher() i=5 2024-05-15T14:47:37.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.745+0000 7f21aa83f800 20 remove_watcher() i=6 2024-05-15T14:47:37.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:37.746+0000 7f21aa83f800 20 remove_watcher() i=7 2024-05-15T14:47:38.812 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:38.812 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:38.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.856+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.857+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:38.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.857+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.858+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:38.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.858+0000 7f565952c800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:38.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.858+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.859+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:38.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.859+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.859+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:38.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.859+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.860+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.860+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.861+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:38.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.861+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.861+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:38.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.861+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.862+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.862+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 zone MyZone found 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.863+0000 7f565952c800 20 started sync module instance, tier type = 2024-05-15T14:47:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.864+0000 7f565952c800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.874+0000 7f565952c800 20 add_watcher() i=0 2024-05-15T14:47:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.874+0000 7f565952c800 20 add_watcher() i=1 2024-05-15T14:47:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.874+0000 7f565952c800 20 add_watcher() i=2 2024-05-15T14:47:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.874+0000 7f565952c800 20 add_watcher() i=3 2024-05-15T14:47:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.874+0000 7f565952c800 20 add_watcher() i=4 2024-05-15T14:47:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.874+0000 7f565952c800 20 add_watcher() i=5 2024-05-15T14:47:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.874+0000 7f565952c800 20 add_watcher() i=6 2024-05-15T14:47:38.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.875+0000 7f565952c800 20 add_watcher() i=7 2024-05-15T14:47:38.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.875+0000 7f565952c800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:38.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.877+0000 7f550bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:38.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.877+0000 7f565952c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:38.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.877+0000 7f565952c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:38.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.877+0000 7f565952c800 5 note: GC not initialized 2024-05-15T14:47:38.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.877+0000 7f550afe5640 20 reqs_thread_entry: start 2024-05-15T14:47:38.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.877+0000 7f565952c800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:38.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.878+0000 7f565952c800 20 Filter name: none 2024-05-15T14:47:38.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.878+0000 7f5508fe1640 20 reqs_thread_entry: start 2024-05-15T14:47:38.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.878+0000 7f565952c800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.878+0000 7f565952c800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.878+0000 7f565952c800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.878+0000 7f565952c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.878+0000 7f565952c800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.879+0000 7f550bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.881+0000 7f565952c800 20 remove_watcher() i=0 2024-05-15T14:47:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.881+0000 7f565952c800 2 removed watcher, disabling cache 2024-05-15T14:47:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.882+0000 7f565952c800 20 remove_watcher() i=1 2024-05-15T14:47:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.883+0000 7f565952c800 20 remove_watcher() i=2 2024-05-15T14:47:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.884+0000 7f565952c800 20 remove_watcher() i=3 2024-05-15T14:47:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.885+0000 7f565952c800 20 remove_watcher() i=4 2024-05-15T14:47:38.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.886+0000 7f565952c800 20 remove_watcher() i=5 2024-05-15T14:47:38.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.887+0000 7f565952c800 20 remove_watcher() i=6 2024-05-15T14:47:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:38.888+0000 7f565952c800 20 remove_watcher() i=7 2024-05-15T14:47:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:39.999+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.001+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.001+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.002+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.002+0000 7efeaa810800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.002+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.002+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.002+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.003+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.003+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.004+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.004+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.004+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.004+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.004+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.004+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.005+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.005+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 20 zone MyZone found 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.006+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.007+0000 7efeaa810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:40.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.007+0000 7efeaa810800 20 rados->read ofs=0 len=0 2024-05-15T14:47:40.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.007+0000 7efeaa810800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:40.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.007+0000 7efeaa810800 20 started sync module instance, tier type = 2024-05-15T14:47:40.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.007+0000 7efeaa810800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:40.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.017+0000 7efeaa810800 20 add_watcher() i=0 2024-05-15T14:47:40.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.017+0000 7efeaa810800 20 add_watcher() i=1 2024-05-15T14:47:40.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.017+0000 7efeaa810800 20 add_watcher() i=2 2024-05-15T14:47:40.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.017+0000 7efeaa810800 20 add_watcher() i=3 2024-05-15T14:47:40.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.017+0000 7efeaa810800 20 add_watcher() i=4 2024-05-15T14:47:40.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.017+0000 7efeaa810800 20 add_watcher() i=5 2024-05-15T14:47:40.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.017+0000 7efeaa810800 20 add_watcher() i=6 2024-05-15T14:47:40.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.018+0000 7efeaa810800 20 add_watcher() i=7 2024-05-15T14:47:40.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.018+0000 7efeaa810800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:40.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.020+0000 7efd57fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:40.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.020+0000 7efeaa810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:40.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.020+0000 7efeaa810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:40.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.020+0000 7efeaa810800 5 note: GC not initialized 2024-05-15T14:47:40.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efd56ffd640 20 reqs_thread_entry: start 2024-05-15T14:47:40.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efeaa810800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:40.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efeaa810800 20 Filter name: none 2024-05-15T14:47:40.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efd54ff9640 20 reqs_thread_entry: start 2024-05-15T14:47:40.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efeaa810800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:40.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efeaa810800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:40.023 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:40.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efeaa810800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:40.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efeaa810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:40.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.021+0000 7efeaa810800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:40.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.022+0000 7efd57fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:40.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.025+0000 7efeaa810800 20 remove_watcher() i=0 2024-05-15T14:47:40.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.025+0000 7efeaa810800 2 removed watcher, disabling cache 2024-05-15T14:47:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.026+0000 7efeaa810800 20 remove_watcher() i=1 2024-05-15T14:47:40.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.027+0000 7efeaa810800 20 remove_watcher() i=2 2024-05-15T14:47:40.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.028+0000 7efeaa810800 20 remove_watcher() i=3 2024-05-15T14:47:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.029+0000 7efeaa810800 20 remove_watcher() i=4 2024-05-15T14:47:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.030+0000 7efeaa810800 20 remove_watcher() i=5 2024-05-15T14:47:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.031+0000 7efeaa810800 20 remove_watcher() i=6 2024-05-15T14:47:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:40.033+0000 7efeaa810800 20 remove_watcher() i=7 2024-05-15T14:47:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:41.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.145+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.146+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:41.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.146+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.147+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.147+0000 7f0e70898800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.147+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.147+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.147+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.148+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.148+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.149+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:41.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.149+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.149+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.149+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.150+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.150+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.150+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.150+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 20 zone MyZone found 2024-05-15T14:47:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.151+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.152+0000 7f0e70898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.152+0000 7f0e70898800 20 rados->read ofs=0 len=0 2024-05-15T14:47:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.152+0000 7f0e70898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.152+0000 7f0e70898800 20 started sync module instance, tier type = 2024-05-15T14:47:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.152+0000 7f0e70898800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 20 add_watcher() i=0 2024-05-15T14:47:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 20 add_watcher() i=1 2024-05-15T14:47:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 20 add_watcher() i=2 2024-05-15T14:47:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 20 add_watcher() i=3 2024-05-15T14:47:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 20 add_watcher() i=4 2024-05-15T14:47:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 20 add_watcher() i=5 2024-05-15T14:47:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 20 add_watcher() i=6 2024-05-15T14:47:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 20 add_watcher() i=7 2024-05-15T14:47:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.163+0000 7f0e70898800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:41.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.165+0000 7f0d24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:41.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.165+0000 7f0e70898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:41.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.165+0000 7f0e70898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:41.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.166+0000 7f0e70898800 5 note: GC not initialized 2024-05-15T14:47:41.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.166+0000 7f0c9f7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:41.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.166+0000 7f0e70898800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:41.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.166+0000 7f0e70898800 20 Filter name: none 2024-05-15T14:47:41.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.166+0000 7f0c9d7fa640 20 reqs_thread_entry: start 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.166+0000 7f0e70898800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.167+0000 7f0e70898800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:47:41.167+0000 7f0e70898800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.167+0000 7f0e70898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.167+0000 7f0e70898800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.167+0000 7f0d24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.170+0000 7f0e70898800 20 remove_watcher() i=0 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.170+0000 7f0e70898800 2 removed watcher, disabling cache 2024-05-15T14:47:41.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.171+0000 7f0e70898800 20 remove_watcher() i=1 2024-05-15T14:47:41.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.172+0000 7f0e70898800 20 remove_watcher() i=2 2024-05-15T14:47:41.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.173+0000 7f0e70898800 20 remove_watcher() i=3 2024-05-15T14:47:41.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.174+0000 7f0e70898800 20 remove_watcher() i=4 2024-05-15T14:47:41.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.175+0000 7f0e70898800 20 remove_watcher() i=5 2024-05-15T14:47:41.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.176+0000 7f0e70898800 20 remove_watcher() i=6 2024-05-15T14:47:41.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:41.177+0000 7f0e70898800 20 remove_watcher() i=7 2024-05-15T14:47:42.245 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:42.245 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.289+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.291+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.291+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.292+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.292+0000 7f1694619800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.292+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.292+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.292+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.293+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.293+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.293+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.293+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.294+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.294+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.294+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.294+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.295+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.295+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 20 zone MyZone found 2024-05-15T14:47:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.296+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.297+0000 7f1694619800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.297+0000 7f1694619800 20 rados->read ofs=0 len=0 2024-05-15T14:47:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.297+0000 7f1694619800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.297+0000 7f1694619800 20 started sync module instance, tier type = 2024-05-15T14:47:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.297+0000 7f1694619800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.307+0000 7f1694619800 20 add_watcher() i=0 2024-05-15T14:47:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.307+0000 7f1694619800 20 add_watcher() i=1 2024-05-15T14:47:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.307+0000 7f1694619800 20 add_watcher() i=2 2024-05-15T14:47:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.307+0000 7f1694619800 20 add_watcher() i=3 2024-05-15T14:47:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.307+0000 7f1694619800 20 add_watcher() i=4 2024-05-15T14:47:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.307+0000 7f1694619800 20 add_watcher() i=5 2024-05-15T14:47:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.307+0000 7f1694619800 20 add_watcher() i=6 2024-05-15T14:47:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.308+0000 7f1694619800 20 add_watcher() i=7 2024-05-15T14:47:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.308+0000 7f1694619800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:42.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.310+0000 7f1548fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:42.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.310+0000 7f1694619800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:42.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.310+0000 7f1694619800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:42.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.310+0000 7f1694619800 5 note: GC not initialized 2024-05-15T14:47:42.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.311+0000 7f14c37fe640 20 reqs_thread_entry: start 2024-05-15T14:47:42.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.311+0000 7f1694619800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:42.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.311+0000 7f1694619800 20 Filter name: none 2024-05-15T14:47:42.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.311+0000 7f14c17fa640 20 reqs_thread_entry: start 2024-05-15T14:47:42.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.311+0000 7f1694619800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:42.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.311+0000 7f1694619800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:42.313 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:42.311+0000 7f1694619800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:42.313 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:42.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.311+0000 7f1694619800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:42.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.311+0000 7f1694619800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:42.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.312+0000 7f1548fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.314+0000 7f1694619800 20 remove_watcher() i=0 2024-05-15T14:47:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.314+0000 7f1694619800 2 removed watcher, disabling cache 2024-05-15T14:47:42.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.315+0000 7f1694619800 20 remove_watcher() i=1 2024-05-15T14:47:42.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.317+0000 7f1694619800 20 remove_watcher() i=2 2024-05-15T14:47:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.318+0000 7f1694619800 20 remove_watcher() i=3 2024-05-15T14:47:42.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.319+0000 7f1694619800 20 remove_watcher() i=4 2024-05-15T14:47:42.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.320+0000 7f1694619800 20 remove_watcher() i=5 2024-05-15T14:47:42.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.321+0000 7f1694619800 20 remove_watcher() i=6 2024-05-15T14:47:42.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:42.322+0000 7f1694619800 20 remove_watcher() i=7 2024-05-15T14:47:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:43.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.432+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.434+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:43.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.434+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.435+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:43.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.435+0000 7f678ed0a800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:43.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.435+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.435+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:43.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.435+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.436+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:43.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.436+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.437+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:43.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.437+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.437+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:43.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.437+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.438+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:43.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.438+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.438+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:43.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.438+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 20 zone MyZone found 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.439+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.440+0000 7f678ed0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.440+0000 7f678ed0a800 20 rados->read ofs=0 len=0 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.440+0000 7f678ed0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:43.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.440+0000 7f678ed0a800 20 started sync module instance, tier type = 2024-05-15T14:47:43.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.440+0000 7f678ed0a800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:43.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.450+0000 7f678ed0a800 20 add_watcher() i=0 2024-05-15T14:47:43.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.450+0000 7f678ed0a800 20 add_watcher() i=1 2024-05-15T14:47:43.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.450+0000 7f678ed0a800 20 add_watcher() i=2 2024-05-15T14:47:43.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.450+0000 7f678ed0a800 20 add_watcher() i=3 2024-05-15T14:47:43.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.450+0000 7f678ed0a800 20 add_watcher() i=4 2024-05-15T14:47:43.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.450+0000 7f678ed0a800 20 add_watcher() i=5 2024-05-15T14:47:43.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.450+0000 7f678ed0a800 20 add_watcher() i=6 2024-05-15T14:47:43.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.451+0000 7f678ed0a800 20 add_watcher() i=7 2024-05-15T14:47:43.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.451+0000 7f678ed0a800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:43.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.453+0000 7f6642fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:43.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.453+0000 7f678ed0a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:43.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.453+0000 7f678ed0a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:43.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.453+0000 7f678ed0a800 5 note: GC not initialized 2024-05-15T14:47:43.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.454+0000 7f6641fdb640 20 reqs_thread_entry: start 2024-05-15T14:47:43.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.454+0000 7f678ed0a800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:43.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.454+0000 7f678ed0a800 20 Filter name: none 2024-05-15T14:47:43.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.454+0000 7f65b37fe640 20 reqs_thread_entry: start 2024-05-15T14:47:43.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.454+0000 7f678ed0a800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:43.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.454+0000 7f678ed0a800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:43.456 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:43.454+0000 7f678ed0a800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:43.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.454+0000 7f678ed0a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:43.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.454+0000 7f678ed0a800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:43.456 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:43.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.455+0000 7f6642fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:43.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.458+0000 7f678ed0a800 20 remove_watcher() i=0 2024-05-15T14:47:43.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.458+0000 7f678ed0a800 2 removed watcher, disabling cache 2024-05-15T14:47:43.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.459+0000 7f678ed0a800 20 remove_watcher() i=1 2024-05-15T14:47:43.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.460+0000 7f678ed0a800 20 remove_watcher() i=2 2024-05-15T14:47:43.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.462+0000 7f678ed0a800 20 remove_watcher() i=3 2024-05-15T14:47:43.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.463+0000 7f678ed0a800 20 remove_watcher() i=4 2024-05-15T14:47:43.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.464+0000 7f678ed0a800 20 remove_watcher() i=5 2024-05-15T14:47:43.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.465+0000 7f678ed0a800 20 remove_watcher() i=6 2024-05-15T14:47:43.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:43.466+0000 7f678ed0a800 20 remove_watcher() i=7 2024-05-15T14:47:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:44.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.576+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.578+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:44.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.578+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.579+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:44.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.579+0000 7fba38836800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:44.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.579+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.579+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:44.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.579+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.580+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:44.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.580+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.581+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:44.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.581+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.581+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:44.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.581+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.581+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:44.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.581+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.582+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:44.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.582+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 20 zone MyZone found 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.583+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.584+0000 7fba38836800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.584+0000 7fba38836800 20 rados->read ofs=0 len=0 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.584+0000 7fba38836800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:44.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.584+0000 7fba38836800 20 started sync module instance, tier type = 2024-05-15T14:47:44.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.584+0000 7fba38836800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:44.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.594+0000 7fba38836800 20 add_watcher() i=0 2024-05-15T14:47:44.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.594+0000 7fba38836800 20 add_watcher() i=1 2024-05-15T14:47:44.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.594+0000 7fba38836800 20 add_watcher() i=2 2024-05-15T14:47:44.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.594+0000 7fba38836800 20 add_watcher() i=3 2024-05-15T14:47:44.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.594+0000 7fba38836800 20 add_watcher() i=4 2024-05-15T14:47:44.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.594+0000 7fba38836800 20 add_watcher() i=5 2024-05-15T14:47:44.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.594+0000 7fba38836800 20 add_watcher() i=6 2024-05-15T14:47:44.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.595+0000 7fba38836800 20 add_watcher() i=7 2024-05-15T14:47:44.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.595+0000 7fba38836800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:44.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.597+0000 7fb8ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:44.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.598+0000 7fba38836800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:44.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.598+0000 7fba38836800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:44.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.598+0000 7fba38836800 5 note: GC not initialized 2024-05-15T14:47:44.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.598+0000 7fb8677fe640 20 reqs_thread_entry: start 2024-05-15T14:47:44.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.598+0000 7fba38836800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:44.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.598+0000 7fba38836800 20 Filter name: none 2024-05-15T14:47:44.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.598+0000 7fb8657fa640 20 reqs_thread_entry: start 2024-05-15T14:47:44.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.598+0000 7fba38836800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:44.600 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:44.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.599+0000 7fba38836800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:44.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.599+0000 7fba38836800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:44.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.599+0000 7fba38836800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:44.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.599+0000 7fba38836800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:44.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.600+0000 7fb8ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:44.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.602+0000 7fba38836800 20 remove_watcher() i=0 2024-05-15T14:47:44.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.602+0000 7fba38836800 2 removed watcher, disabling cache 2024-05-15T14:47:44.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.603+0000 7fba38836800 20 remove_watcher() i=1 2024-05-15T14:47:44.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.604+0000 7fba38836800 20 remove_watcher() i=2 2024-05-15T14:47:44.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.605+0000 7fba38836800 20 remove_watcher() i=3 2024-05-15T14:47:44.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.606+0000 7fba38836800 20 remove_watcher() i=4 2024-05-15T14:47:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.607+0000 7fba38836800 20 remove_watcher() i=5 2024-05-15T14:47:44.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.608+0000 7fba38836800 20 remove_watcher() i=6 2024-05-15T14:47:44.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:44.609+0000 7fba38836800 20 remove_watcher() i=7 2024-05-15T14:47:45.677 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:45.678 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.722+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.724+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:45.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.724+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.725+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:45.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.725+0000 7f30ec933800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:45.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.725+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.725+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.725+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.726+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.726+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.727+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.727+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.727+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.727+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.728+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.728+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.728+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.728+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 20 zone MyZone found 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.729+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.730+0000 7f30ec933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.730+0000 7f30ec933800 20 rados->read ofs=0 len=0 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.730+0000 7f30ec933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.730+0000 7f30ec933800 20 started sync module instance, tier type = 2024-05-15T14:47:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.730+0000 7f30ec933800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.741+0000 7f30ec933800 20 add_watcher() i=0 2024-05-15T14:47:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.741+0000 7f30ec933800 20 add_watcher() i=1 2024-05-15T14:47:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.741+0000 7f30ec933800 20 add_watcher() i=2 2024-05-15T14:47:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.741+0000 7f30ec933800 20 add_watcher() i=3 2024-05-15T14:47:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.741+0000 7f30ec933800 20 add_watcher() i=4 2024-05-15T14:47:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.741+0000 7f30ec933800 20 add_watcher() i=5 2024-05-15T14:47:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.741+0000 7f30ec933800 20 add_watcher() i=6 2024-05-15T14:47:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.742+0000 7f30ec933800 20 add_watcher() i=7 2024-05-15T14:47:45.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.742+0000 7f30ec933800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:45.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.743+0000 7f2f9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.744+0000 7f30ec933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.744+0000 7f30ec933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.744+0000 7f30ec933800 5 note: GC not initialized 2024-05-15T14:47:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.744+0000 7f2f9dfdb640 20 reqs_thread_entry: start 2024-05-15T14:47:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.744+0000 7f30ec933800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.744+0000 7f30ec933800 20 Filter name: none 2024-05-15T14:47:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.744+0000 7f2f0f7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.744+0000 7f30ec933800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.745+0000 7f30ec933800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.745+0000 7f30ec933800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 22022024-05-15T14:47:45.745+0000 7f30ec933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:45.747 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:45.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.745+0000 7f30ec933800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:45.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.746+0000 7f2f9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.749+0000 7f30ec933800 20 remove_watcher() i=0 2024-05-15T14:47:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.749+0000 7f30ec933800 2 removed watcher, disabling cache 2024-05-15T14:47:45.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.750+0000 7f30ec933800 20 remove_watcher() i=1 2024-05-15T14:47:45.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.751+0000 7f30ec933800 20 remove_watcher() i=2 2024-05-15T14:47:45.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.753+0000 7f30ec933800 20 remove_watcher() i=3 2024-05-15T14:47:45.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.754+0000 7f30ec933800 20 remove_watcher() i=4 2024-05-15T14:47:45.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.755+0000 7f30ec933800 20 remove_watcher() i=5 2024-05-15T14:47:45.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.756+0000 7f30ec933800 20 remove_watcher() i=6 2024-05-15T14:47:45.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:45.757+0000 7f30ec933800 20 remove_watcher() i=7 2024-05-15T14:47:46.825 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:46.825 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:46.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.869+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.871+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:46.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.871+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.872+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:46.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.872+0000 7fcf86698800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:46.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.872+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.872+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:46.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.872+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.873+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:46.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.873+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.874+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:46.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.874+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.874+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:46.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.874+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.875+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:46.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.875+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.875+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:46.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.875+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 20 zone MyZone found 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.876+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.877+0000 7fcf86698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:46.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.877+0000 7fcf86698800 20 rados->read ofs=0 len=0 2024-05-15T14:47:46.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.877+0000 7fcf86698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:46.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.877+0000 7fcf86698800 20 started sync module instance, tier type = 2024-05-15T14:47:46.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.877+0000 7fcf86698800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:46.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.887+0000 7fcf86698800 20 add_watcher() i=0 2024-05-15T14:47:46.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.887+0000 7fcf86698800 20 add_watcher() i=1 2024-05-15T14:47:46.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.887+0000 7fcf86698800 20 add_watcher() i=2 2024-05-15T14:47:46.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.887+0000 7fcf86698800 20 add_watcher() i=3 2024-05-15T14:47:46.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.887+0000 7fcf86698800 20 add_watcher() i=4 2024-05-15T14:47:46.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.887+0000 7fcf86698800 20 add_watcher() i=5 2024-05-15T14:47:46.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.887+0000 7fcf86698800 20 add_watcher() i=6 2024-05-15T14:47:46.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.888+0000 7fcf86698800 20 add_watcher() i=7 2024-05-15T14:47:46.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.888+0000 7fcf86698800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:46.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.890+0000 7fce3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:46.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.891+0000 7fcf86698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:46.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.891+0000 7fcf86698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:46.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.891+0000 7fcf86698800 5 note: GC not initialized 2024-05-15T14:47:46.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.891+0000 7fce39fdb640 20 reqs_thread_entry: start 2024-05-15T14:47:46.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.891+0000 7fcf86698800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:46.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.891+0000 7fcf86698800 20 Filter name: none 2024-05-15T14:47:46.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.891+0000 7fcdab7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:46.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.891+0000 7fcf86698800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:46.899 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:46.892+0000 7fcf86698800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:46.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.892+0000 7fcf86698800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:46.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.892+0000 7fcf86698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:46.900 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 22022024-05-15T14:47:46.892+0000 7fcf86698800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:46.900 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:46.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.893+0000 7fce3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:46.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.895+0000 7fcf86698800 20 remove_watcher() i=0 2024-05-15T14:47:46.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.895+0000 7fcf86698800 2 removed watcher, disabling cache 2024-05-15T14:47:46.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.896+0000 7fcf86698800 20 remove_watcher() i=1 2024-05-15T14:47:46.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.897+0000 7fcf86698800 20 remove_watcher() i=2 2024-05-15T14:47:46.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.899+0000 7fcf86698800 20 remove_watcher() i=3 2024-05-15T14:47:46.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.900+0000 7fcf86698800 20 remove_watcher() i=4 2024-05-15T14:47:46.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.901+0000 7fcf86698800 20 remove_watcher() i=5 2024-05-15T14:47:46.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.902+0000 7fcf86698800 20 remove_watcher() i=6 2024-05-15T14:47:46.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:46.903+0000 7fcf86698800 20 remove_watcher() i=7 2024-05-15T14:47:47.968 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:47.968 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.013+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.015+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.015+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.016+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.016+0000 7f99bb135800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.016+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.016+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.016+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.017+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.017+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.018+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.018+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.018+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.018+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.019+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.019+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.019+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.019+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:48.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 20 zone MyZone found 2024-05-15T14:47:48.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.020+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.021+0000 7f99bb135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.021+0000 7f99bb135800 20 rados->read ofs=0 len=0 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.021+0000 7f99bb135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.021+0000 7f99bb135800 20 started sync module instance, tier type = 2024-05-15T14:47:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.021+0000 7f99bb135800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:48.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.032+0000 7f99bb135800 20 add_watcher() i=0 2024-05-15T14:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.032+0000 7f99bb135800 20 add_watcher() i=1 2024-05-15T14:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.032+0000 7f99bb135800 20 add_watcher() i=2 2024-05-15T14:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.032+0000 7f99bb135800 20 add_watcher() i=3 2024-05-15T14:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.032+0000 7f99bb135800 20 add_watcher() i=4 2024-05-15T14:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.032+0000 7f99bb135800 20 add_watcher() i=5 2024-05-15T14:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.032+0000 7f99bb135800 20 add_watcher() i=6 2024-05-15T14:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.033+0000 7f99bb135800 20 add_watcher() i=7 2024-05-15T14:47:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.033+0000 7f99bb135800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.035+0000 7f986d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.036+0000 7f99bb135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.036+0000 7f99bb135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.036+0000 7f99bb135800 5 note: GC not initialized 2024-05-15T14:47:48.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.036+0000 7f97e7fff640 20 reqs_thread_entry: start 2024-05-15T14:47:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.036+0000 7f99bb135800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.036+0000 7f99bb135800 20 Filter name: none 2024-05-15T14:47:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.036+0000 7f97e5ffb640 20 reqs_thread_entry: start 2024-05-15T14:47:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.036+0000 7f99bb135800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.037+0000 7f99bb135800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:48.039 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:48.037+0000 7f99bb135800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:48.039 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:48.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.037+0000 7f99bb135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:48.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.037+0000 7f99bb135800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:48.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.038+0000 7f986d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.040+0000 7f99bb135800 20 remove_watcher() i=0 2024-05-15T14:47:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.040+0000 7f99bb135800 2 removed watcher, disabling cache 2024-05-15T14:47:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.041+0000 7f99bb135800 20 remove_watcher() i=1 2024-05-15T14:47:48.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.042+0000 7f99bb135800 20 remove_watcher() i=2 2024-05-15T14:47:48.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.043+0000 7f99bb135800 20 remove_watcher() i=3 2024-05-15T14:47:48.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.044+0000 7f99bb135800 20 remove_watcher() i=4 2024-05-15T14:47:48.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.045+0000 7f99bb135800 20 remove_watcher() i=5 2024-05-15T14:47:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.046+0000 7f99bb135800 20 remove_watcher() i=6 2024-05-15T14:47:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:48.047+0000 7f99bb135800 20 remove_watcher() i=7 2024-05-15T14:47:49.114 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:49.114 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:49.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.158+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.160+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:49.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.160+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.161+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:49.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.161+0000 7f9294f2b800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:49.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.161+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.161+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:49.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.161+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.162+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:49.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.162+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.162+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:49.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.162+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.163+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:49.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.163+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.163+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:49.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.163+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.164+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:49.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.164+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:49.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 20 zone MyZone found 2024-05-15T14:47:49.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:49.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.165+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.166+0000 7f9294f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.166+0000 7f9294f2b800 20 rados->read ofs=0 len=0 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.166+0000 7f9294f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.166+0000 7f9294f2b800 20 started sync module instance, tier type = 2024-05-15T14:47:49.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.166+0000 7f9294f2b800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:49.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.176+0000 7f9294f2b800 20 add_watcher() i=0 2024-05-15T14:47:49.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.176+0000 7f9294f2b800 20 add_watcher() i=1 2024-05-15T14:47:49.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.176+0000 7f9294f2b800 20 add_watcher() i=2 2024-05-15T14:47:49.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.176+0000 7f9294f2b800 20 add_watcher() i=3 2024-05-15T14:47:49.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.176+0000 7f9294f2b800 20 add_watcher() i=4 2024-05-15T14:47:49.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.176+0000 7f9294f2b800 20 add_watcher() i=5 2024-05-15T14:47:49.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.176+0000 7f9294f2b800 20 add_watcher() i=6 2024-05-15T14:47:49.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.177+0000 7f9294f2b800 20 add_watcher() i=7 2024-05-15T14:47:49.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.177+0000 7f9294f2b800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:49.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.179+0000 7f9146fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:49.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.179+0000 7f9294f2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.179+0000 7f9294f2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.179+0000 7f9294f2b800 5 note: GC not initialized 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.180+0000 7f9145fe3640 20 reqs_thread_entry: start 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.180+0000 7f9294f2b800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.180+0000 7f9294f2b800 20 Filter name: none 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.180+0000 7f90b77fe640 20 reqs_thread_entry: start 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.180+0000 7f9294f2b800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.181+0000 7f9294f2b800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:49.181+0000 7f9294f2b800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:49.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.181+0000 7f9294f2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.181+0000 7f9294f2b800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:49.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.182+0000 7f9146fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:49.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.184+0000 7f9294f2b800 20 remove_watcher() i=0 2024-05-15T14:47:49.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.184+0000 7f9294f2b800 2 removed watcher, disabling cache 2024-05-15T14:47:49.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.185+0000 7f9294f2b800 20 remove_watcher() i=1 2024-05-15T14:47:49.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.186+0000 7f9294f2b800 20 remove_watcher() i=2 2024-05-15T14:47:49.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.187+0000 7f9294f2b800 20 remove_watcher() i=3 2024-05-15T14:47:49.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.188+0000 7f9294f2b800 20 remove_watcher() i=4 2024-05-15T14:47:49.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.189+0000 7f9294f2b800 20 remove_watcher() i=5 2024-05-15T14:47:49.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.190+0000 7f9294f2b800 20 remove_watcher() i=6 2024-05-15T14:47:49.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:49.191+0000 7f9294f2b800 20 remove_watcher() i=7 2024-05-15T14:47:50.257 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:50.257 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:50.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.302+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.304+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:50.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.304+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.305+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:50.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.305+0000 7f578e638800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:50.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.305+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.305+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:50.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.305+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.306+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.306+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.306+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:50.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.306+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.307+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:50.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.307+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.307+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:50.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.307+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.308+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:50.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.308+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 20 zone MyZone found 2024-05-15T14:47:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:50.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.309+0000 7f578e638800 20 rados->read ofs=0 len=0 2024-05-15T14:47:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.310+0000 7f578e638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.310+0000 7f578e638800 20 started sync module instance, tier type = 2024-05-15T14:47:50.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.310+0000 7f578e638800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:50.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.320+0000 7f578e638800 20 add_watcher() i=0 2024-05-15T14:47:50.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.320+0000 7f578e638800 20 add_watcher() i=1 2024-05-15T14:47:50.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.320+0000 7f578e638800 20 add_watcher() i=2 2024-05-15T14:47:50.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.320+0000 7f578e638800 20 add_watcher() i=3 2024-05-15T14:47:50.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.320+0000 7f578e638800 20 add_watcher() i=4 2024-05-15T14:47:50.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.320+0000 7f578e638800 20 add_watcher() i=5 2024-05-15T14:47:50.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.320+0000 7f578e638800 20 add_watcher() i=6 2024-05-15T14:47:50.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.321+0000 7f578e638800 20 add_watcher() i=7 2024-05-15T14:47:50.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.321+0000 7f578e638800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:50.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.323+0000 7f5642fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:50.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.324+0000 7f578e638800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:50.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.324+0000 7f578e638800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:50.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.324+0000 7f578e638800 5 note: GC not initialized 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.324+0000 7f5641fdb640 20 reqs_thread_entry: start 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.324+0000 7f578e638800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.324+0000 7f578e638800 20 Filter name: none 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.324+0000 7f55b37fe640 20 reqs_thread_entry: start 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.324+0000 7f578e638800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: (2202) Unknown error 2202 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.325+0000 7f578e638800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.325+0000 7f578e638800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.325+0000 7f578e638800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:50.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.325+0000 7f578e638800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:50.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.326+0000 7f5642fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:50.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.328+0000 7f578e638800 20 remove_watcher() i=0 2024-05-15T14:47:50.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.328+0000 7f578e638800 2 removed watcher, disabling cache 2024-05-15T14:47:50.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.329+0000 7f578e638800 20 remove_watcher() i=1 2024-05-15T14:47:50.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.330+0000 7f578e638800 20 remove_watcher() i=2 2024-05-15T14:47:50.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.332+0000 7f578e638800 20 remove_watcher() i=3 2024-05-15T14:47:50.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.333+0000 7f578e638800 20 remove_watcher() i=4 2024-05-15T14:47:50.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.334+0000 7f578e638800 20 remove_watcher() i=5 2024-05-15T14:47:50.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.335+0000 7f578e638800 20 remove_watcher() i=6 2024-05-15T14:47:50.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:50.336+0000 7f578e638800 20 remove_watcher() i=7 2024-05-15T14:47:51.403 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:51.403 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:51.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.448+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.449+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:51.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.449+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.450+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:51.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.450+0000 7faa0db1f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.450+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.450+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.450+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.451+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.451+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.451+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.452+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.452+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.452+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.452+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.452+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.453+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.453+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 20 zone MyZone found 2024-05-15T14:47:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.454+0000 7faa0db1f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.455+0000 7faa0db1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.455+0000 7faa0db1f800 20 started sync module instance, tier type = 2024-05-15T14:47:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.455+0000 7faa0db1f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.465+0000 7faa0db1f800 20 add_watcher() i=0 2024-05-15T14:47:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.465+0000 7faa0db1f800 20 add_watcher() i=1 2024-05-15T14:47:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.465+0000 7faa0db1f800 20 add_watcher() i=2 2024-05-15T14:47:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.465+0000 7faa0db1f800 20 add_watcher() i=3 2024-05-15T14:47:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.465+0000 7faa0db1f800 20 add_watcher() i=4 2024-05-15T14:47:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.465+0000 7faa0db1f800 20 add_watcher() i=5 2024-05-15T14:47:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.465+0000 7faa0db1f800 20 add_watcher() i=6 2024-05-15T14:47:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.466+0000 7faa0db1f800 20 add_watcher() i=7 2024-05-15T14:47:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.466+0000 7faa0db1f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.468+0000 7fa8bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.468+0000 7faa0db1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.468+0000 7faa0db1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.468+0000 7faa0db1f800 5 note: GC not initialized 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.469+0000 7fa8ba7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.469+0000 7faa0db1f800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.469+0000 7faa0db1f800 20 Filter name: none 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.469+0000 7fa82bfff640 20 reqs_thread_entry: start 2024-05-15T14:47:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.469+0000 7faa0db1f800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:51.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.469+0000 7faa0db1f800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x6 2024-05-15T14:47:51.471 INFO:teuthology.orchestra.run.smithi018.stderr:ERROR: could not remove topic: 2024-05-15T14:47:51.469+0000 7faa0db1f800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:51.471 INFO:teuthology.orchestra.run.smithi018.stderr:(2202) Unknown error 2202 2024-05-15T14:47:51.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.469+0000 7faa0db1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:51.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.469+0000 7faa0db1f800 1 WARNING: topic migration in process. please try again later 2024-05-15T14:47:51.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.470+0000 7fa8bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:51.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.473+0000 7faa0db1f800 20 remove_watcher() i=0 2024-05-15T14:47:51.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.473+0000 7faa0db1f800 2 removed watcher, disabling cache 2024-05-15T14:47:51.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.474+0000 7faa0db1f800 20 remove_watcher() i=1 2024-05-15T14:47:51.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.475+0000 7faa0db1f800 20 remove_watcher() i=2 2024-05-15T14:47:51.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.476+0000 7faa0db1f800 20 remove_watcher() i=3 2024-05-15T14:47:51.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.477+0000 7faa0db1f800 20 remove_watcher() i=4 2024-05-15T14:47:51.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.478+0000 7faa0db1f800 20 remove_watcher() i=5 2024-05-15T14:47:51.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.479+0000 7faa0db1f800 20 remove_watcher() i=6 2024-05-15T14:47:51.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:51.480+0000 7faa0db1f800 20 remove_watcher() i=7 2024-05-15T14:47:52.355 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:52.353+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:47:52.355 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:52.353+0000 7fe219384640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:47:52.355 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:52.353+0000 7fe219384640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:47:52.355 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:52.353+0000 7fe219384640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:47:52.412 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:47:52.410+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):730 WARNING: Cluster is is misconfigured! Zonegroup MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! 2024-05-15T14:47:52.412 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:47:52.410+0000 7f37cdd19640 -1 sync log trim: bool {anonymous}::sanity_check_endpoints(const DoutPrefixProvider*, rgw::sal::RadosStore*):740 ERROR: Cluster is is misconfigured! Zone MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) in Zonegroup MyZoneGroup ( 88d155fc-d3b1-427c-898a-ccb610f9ade3) in Realm id ( c960760b-b2d7-439f-9323-6ff955b035b5) has no endpoints! Trimming is impossible. 2024-05-15T14:47:52.412 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:47:52.410+0000 7f37cdd19640 -1 sync log trim: RGWCoroutine* create_meta_log_trim_cr(const DoutPrefixProvider*, rgw::sal::RadosStore*, RGWHTTPManager*, int, utime_t):759 ERROR: Cluster is is misconfigured! Refusing to trim. 2024-05-15T14:47:52.412 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:47:52.410+0000 7f37cdd19640 -1 rgw rados thread: Bailing out of trim thread! 2024-05-15T14:47:52.548 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:52.548 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:52.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.595+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.597+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.597+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.598+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.598+0000 7f1fdb72e800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:52.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.598+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.599+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.599+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.599+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:52.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.599+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.601+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:52.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.601+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.601+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.601+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.601+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.601+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.602+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.602+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:52.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 20 zone MyZone found 2024-05-15T14:47:52.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:52.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:52.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:52.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:52.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:52.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:52.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.603+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.604+0000 7f1fdb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.604+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.604+0000 7f1fdb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.604+0000 7f1fdb72e800 20 started sync module instance, tier type = 2024-05-15T14:47:52.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.604+0000 7f1fdb72e800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:52.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.615+0000 7f1fdb72e800 20 add_watcher() i=0 2024-05-15T14:47:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.615+0000 7f1fdb72e800 20 add_watcher() i=1 2024-05-15T14:47:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.615+0000 7f1fdb72e800 20 add_watcher() i=2 2024-05-15T14:47:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.615+0000 7f1fdb72e800 20 add_watcher() i=3 2024-05-15T14:47:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.615+0000 7f1fdb72e800 20 add_watcher() i=4 2024-05-15T14:47:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.615+0000 7f1fdb72e800 20 add_watcher() i=5 2024-05-15T14:47:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.615+0000 7f1fdb72e800 20 add_watcher() i=6 2024-05-15T14:47:52.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.616+0000 7f1fdb72e800 20 add_watcher() i=7 2024-05-15T14:47:52.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.616+0000 7f1fdb72e800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:52.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.617+0000 7f1e8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.618+0000 7f1fdb72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.618+0000 7f1fdb72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.618+0000 7f1fdb72e800 5 note: GC not initialized 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.618+0000 7f1e8cfe1640 20 reqs_thread_entry: start 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.618+0000 7f1fdb72e800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.618+0000 7f1fdb72e800 20 Filter name: none 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.618+0000 7f1dfe7fc640 20 reqs_thread_entry: start 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 10 cache get: name=MyZone.rgw.log++pubsub. : miss 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 10 cache put: name=MyZone.rgw.log++pubsub. info.flags=0x0 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 10 adding MyZone.rgw.log++pubsub. to cache LRU end 2024-05-15T14:47:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 10 cache get: name=MyZone.rgw.log++pubsub. : hit (negative entry) 2024-05-15T14:47:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 10 cache get: name=MyZone.rgw.meta+topics+topic.:vwwrqh-28_topic_1 : miss 2024-05-15T14:47:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 10 cache put: name=MyZone.rgw.meta+topics+topic.:vwwrqh-28_topic_1 info.flags=0x0 2024-05-15T14:47:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 10 adding MyZone.rgw.meta+topics+topic.:vwwrqh-28_topic_1 to cache LRU end 2024-05-15T14:47:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 1 failed to read topic info for name: vwwrqh-28_topic_1 tenant: , ret=-2 2024-05-15T14:47:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.619+0000 7f1fdb72e800 10 WARNING: topic name:vwwrqh-28_topic_1 does not exist, deletion is a no-op: ret=-2 2024-05-15T14:47:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.620+0000 7f1e8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:52.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.623+0000 7f1fdb72e800 20 remove_watcher() i=0 2024-05-15T14:47:52.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.623+0000 7f1fdb72e800 2 removed watcher, disabling cache 2024-05-15T14:47:52.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.624+0000 7f1fdb72e800 20 remove_watcher() i=1 2024-05-15T14:47:52.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.625+0000 7f1fdb72e800 20 remove_watcher() i=2 2024-05-15T14:47:52.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.626+0000 7f1fdb72e800 20 remove_watcher() i=3 2024-05-15T14:47:52.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.627+0000 7f1fdb72e800 20 remove_watcher() i=4 2024-05-15T14:47:52.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.628+0000 7f1fdb72e800 20 remove_watcher() i=5 2024-05-15T14:47:52.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.629+0000 7f1fdb72e800 20 remove_watcher() i=6 2024-05-15T14:47:52.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.631+0000 7f1fdb72e800 20 remove_watcher() i=7 2024-05-15T14:47:52.701 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:52.701 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.743+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.745+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.745+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.746+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.746+0000 7f34bcf46800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:52.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.746+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.746+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.746+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.747+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:52.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.747+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.748+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:52.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.748+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.748+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.748+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.748+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.748+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.749+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.749+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 zone MyZone found 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 started sync module instance, tier type = 2024-05-15T14:47:52.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.750+0000 7f34bcf46800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:52.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.760+0000 7f34bcf46800 20 add_watcher() i=0 2024-05-15T14:47:52.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.760+0000 7f34bcf46800 20 add_watcher() i=1 2024-05-15T14:47:52.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.760+0000 7f34bcf46800 20 add_watcher() i=2 2024-05-15T14:47:52.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.760+0000 7f34bcf46800 20 add_watcher() i=3 2024-05-15T14:47:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.760+0000 7f34bcf46800 20 add_watcher() i=4 2024-05-15T14:47:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.760+0000 7f34bcf46800 20 add_watcher() i=5 2024-05-15T14:47:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.760+0000 7f34bcf46800 20 add_watcher() i=6 2024-05-15T14:47:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.761+0000 7f34bcf46800 20 add_watcher() i=7 2024-05-15T14:47:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.761+0000 7f34bcf46800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:52.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f33717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:52.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f34bcf46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:52.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f34bcf46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:52.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f34bcf46800 5 note: GC not initialized 2024-05-15T14:47:52.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f32ebfff640 20 reqs_thread_entry: start 2024-05-15T14:47:52.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f34bcf46800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f34bcf46800 20 Filter name: none 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f32e9ffb640 20 reqs_thread_entry: start 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.763+0000 7f34bcf46800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom_1 : miss 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 10 cache put: name=MyZone.rgw.log++pubsub.kaboom_1 info.flags=0x0 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 10 adding MyZone.rgw.log++pubsub.kaboom_1 to cache LRU end 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom_1 : hit (negative entry) 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 10 cache get: name=MyZone.rgw.meta+topics+topic.kaboom_1:vwwrqh-29_topic_1 : miss 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 10 cache put: name=MyZone.rgw.meta+topics+topic.kaboom_1:vwwrqh-29_topic_1 info.flags=0x0 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 10 adding MyZone.rgw.meta+topics+topic.kaboom_1:vwwrqh-29_topic_1 to cache LRU end 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 1 failed to read topic info for name: vwwrqh-29_topic_1 tenant: kaboom_1, ret=-2 2024-05-15T14:47:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.764+0000 7f34bcf46800 10 WARNING: topic name:vwwrqh-29_topic_1 does not exist, deletion is a no-op: ret=-2 2024-05-15T14:47:52.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.765+0000 7f33717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:52.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.767+0000 7f34bcf46800 20 remove_watcher() i=0 2024-05-15T14:47:52.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.767+0000 7f34bcf46800 2 removed watcher, disabling cache 2024-05-15T14:47:52.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.768+0000 7f34bcf46800 20 remove_watcher() i=1 2024-05-15T14:47:52.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.769+0000 7f34bcf46800 20 remove_watcher() i=2 2024-05-15T14:47:52.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.770+0000 7f34bcf46800 20 remove_watcher() i=3 2024-05-15T14:47:52.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.771+0000 7f34bcf46800 20 remove_watcher() i=4 2024-05-15T14:47:52.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.772+0000 7f34bcf46800 20 remove_watcher() i=5 2024-05-15T14:47:52.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.773+0000 7f34bcf46800 20 remove_watcher() i=6 2024-05-15T14:47:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.774+0000 7f34bcf46800 20 remove_watcher() i=7 2024-05-15T14:47:52.834 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:52.834 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:52.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.873+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.874+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.874+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.875+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.875+0000 7f682a610800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:52.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.875+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.875+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.875+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.876+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:52.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.876+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.877+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:52.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.877+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.877+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.877+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.877+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.877+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.878+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.878+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:52.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 zone MyZone found 2024-05-15T14:47:52.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:52.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:52.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 started sync module instance, tier type = 2024-05-15T14:47:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.879+0000 7f682a610800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:52.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.889+0000 7f682a610800 20 add_watcher() i=0 2024-05-15T14:47:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.889+0000 7f682a610800 20 add_watcher() i=1 2024-05-15T14:47:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.889+0000 7f682a610800 20 add_watcher() i=2 2024-05-15T14:47:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.889+0000 7f682a610800 20 add_watcher() i=3 2024-05-15T14:47:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.889+0000 7f682a610800 20 add_watcher() i=4 2024-05-15T14:47:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.889+0000 7f682a610800 20 add_watcher() i=5 2024-05-15T14:47:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.889+0000 7f682a610800 20 add_watcher() i=6 2024-05-15T14:47:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.891+0000 7f682a610800 20 add_watcher() i=7 2024-05-15T14:47:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.891+0000 7f682a610800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:52.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.892+0000 7f66d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:52.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.892+0000 7f682a610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:52.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.892+0000 7f682a610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.893+0000 7f682a610800 5 note: GC not initialized 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.893+0000 7f66d67fc640 20 reqs_thread_entry: start 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.893+0000 7f682a610800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.893+0000 7f682a610800 20 Filter name: none 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.893+0000 7f6647fff640 20 reqs_thread_entry: start 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.893+0000 7f682a610800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom_2 : miss 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.893+0000 7f682a610800 10 cache put: name=MyZone.rgw.log++pubsub.kaboom_2 info.flags=0x0 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 10 adding MyZone.rgw.log++pubsub.kaboom_2 to cache LRU end 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 10 cache get: name=MyZone.rgw.log++pubsub.kaboom_2 : hit (negative entry) 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 10 cache get: name=MyZone.rgw.meta+topics+topic.kaboom_2:vwwrqh-30_topic_1 : miss 2024-05-15T14:47:52.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 20 rados->read ofs=0 len=0 2024-05-15T14:47:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 10 cache put: name=MyZone.rgw.meta+topics+topic.kaboom_2:vwwrqh-30_topic_1 info.flags=0x0 2024-05-15T14:47:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 10 adding MyZone.rgw.meta+topics+topic.kaboom_2:vwwrqh-30_topic_1 to cache LRU end 2024-05-15T14:47:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 1 failed to read topic info for name: vwwrqh-30_topic_1 tenant: kaboom_2, ret=-2 2024-05-15T14:47:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.894+0000 7f682a610800 10 WARNING: topic name:vwwrqh-30_topic_1 does not exist, deletion is a no-op: ret=-2 2024-05-15T14:47:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.895+0000 7f66d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:52.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.897+0000 7f682a610800 20 remove_watcher() i=0 2024-05-15T14:47:52.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.897+0000 7f682a610800 2 removed watcher, disabling cache 2024-05-15T14:47:52.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.898+0000 7f682a610800 20 remove_watcher() i=1 2024-05-15T14:47:52.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.899+0000 7f682a610800 20 remove_watcher() i=2 2024-05-15T14:47:52.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.900+0000 7f682a610800 20 remove_watcher() i=3 2024-05-15T14:47:52.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.901+0000 7f682a610800 20 remove_watcher() i=4 2024-05-15T14:47:52.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.902+0000 7f682a610800 20 remove_watcher() i=5 2024-05-15T14:47:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.903+0000 7f682a610800 20 remove_watcher() i=6 2024-05-15T14:47:52.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.904+0000 7f682a610800 20 remove_watcher() i=7 2024-05-15T14:47:52.960 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:52.960 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:52.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.997+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.999+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:52.999+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.000+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.000+0000 7f21bb70c800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:53.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.000+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.000+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.000+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.001+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:53.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.001+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.001+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:53.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.002+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.002+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.002+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.002+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.002+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.003+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.003+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:53.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 20 zone MyZone found 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.004+0000 7f21bb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.005+0000 7f21bb70c800 20 started sync module instance, tier type = 2024-05-15T14:47:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.005+0000 7f21bb70c800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:53.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.014+0000 7f21bb70c800 20 add_watcher() i=0 2024-05-15T14:47:53.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.014+0000 7f21bb70c800 20 add_watcher() i=1 2024-05-15T14:47:53.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.014+0000 7f21bb70c800 20 add_watcher() i=2 2024-05-15T14:47:53.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.014+0000 7f21bb70c800 20 add_watcher() i=3 2024-05-15T14:47:53.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.014+0000 7f21bb70c800 20 add_watcher() i=4 2024-05-15T14:47:53.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.014+0000 7f21bb70c800 20 add_watcher() i=5 2024-05-15T14:47:53.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.014+0000 7f21bb70c800 20 add_watcher() i=6 2024-05-15T14:47:53.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.015+0000 7f21bb70c800 20 add_watcher() i=7 2024-05-15T14:47:53.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.015+0000 7f21bb70c800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.016+0000 7f206ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.017+0000 7f21bb70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.017+0000 7f21bb70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.017+0000 7f21bb70c800 5 note: GC not initialized 2024-05-15T14:47:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.017+0000 7f206efe5640 20 reqs_thread_entry: start 2024-05-15T14:47:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.017+0000 7f21bb70c800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.017+0000 7f21bb70c800 20 Filter name: none 2024-05-15T14:47:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.017+0000 7f206cfe1640 20 reqs_thread_entry: start 2024-05-15T14:47:53.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-29_topic_created_v1 2024-05-15T14:47:53.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-29_topic_created_v2 2024-05-15T14:47:53.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got buckets.kaboom_2:vwwrqh-30_topic_created_v2 2024-05-15T14:47:53.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got topic.:vwwrqh-28_topic_created_v1 2024-05-15T14:47:53.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got buckets.:vwwrqh-28_topic_created_v2 2024-05-15T14:47:53.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-30_topic_created_v1 2024-05-15T14:47:53.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got topic.:vwwrqh-28_topic_created_v2 2024-05-15T14:47:53.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got buckets.kaboom_1:vwwrqh-29_topic_created_v2 2024-05-15T14:47:53.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-30_topic_created_v2 2024-05-15T14:47:53.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.027+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.028+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=266 2024-05-15T14:47:53.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.028+0000 7f21bb70c800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.028+0000 7f21bb70c800 20 rados_obj.operate() r=0 bl.length=266 2024-05-15T14:47:53.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.031+0000 7f206ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.033+0000 7f21bb70c800 20 remove_watcher() i=0 2024-05-15T14:47:53.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.033+0000 7f21bb70c800 2 removed watcher, disabling cache 2024-05-15T14:47:53.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.034+0000 7f21bb70c800 20 remove_watcher() i=1 2024-05-15T14:47:53.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.035+0000 7f21bb70c800 20 remove_watcher() i=2 2024-05-15T14:47:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.036+0000 7f21bb70c800 20 remove_watcher() i=3 2024-05-15T14:47:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.037+0000 7f21bb70c800 20 remove_watcher() i=4 2024-05-15T14:47:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.038+0000 7f21bb70c800 20 remove_watcher() i=5 2024-05-15T14:47:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.039+0000 7f21bb70c800 20 remove_watcher() i=6 2024-05-15T14:47:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.040+0000 7f21bb70c800 20 remove_watcher() i=7 2024-05-15T14:47:53.097 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:53.098 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:53.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.135+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.137+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.137+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.138+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.138+0000 7f8fc2735800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:53.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.138+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.138+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.138+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.139+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.139+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.140+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:53.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.140+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.140+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.140+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.140+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.140+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.141+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.141+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 zone MyZone found 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 started sync module instance, tier type = 2024-05-15T14:47:53.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.142+0000 7f8fc2735800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.152+0000 7f8fc2735800 20 add_watcher() i=0 2024-05-15T14:47:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.152+0000 7f8fc2735800 20 add_watcher() i=1 2024-05-15T14:47:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.152+0000 7f8fc2735800 20 add_watcher() i=2 2024-05-15T14:47:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.152+0000 7f8fc2735800 20 add_watcher() i=3 2024-05-15T14:47:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.152+0000 7f8fc2735800 20 add_watcher() i=4 2024-05-15T14:47:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.152+0000 7f8fc2735800 20 add_watcher() i=5 2024-05-15T14:47:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.152+0000 7f8fc2735800 20 add_watcher() i=6 2024-05-15T14:47:53.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.153+0000 7f8fc2735800 20 add_watcher() i=7 2024-05-15T14:47:53.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.153+0000 7f8fc2735800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:53.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.154+0000 7f8e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.155+0000 7f8fc2735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.155+0000 7f8fc2735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.155+0000 7f8fc2735800 5 note: GC not initialized 2024-05-15T14:47:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.155+0000 7f8def7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.155+0000 7f8fc2735800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.155+0000 7f8fc2735800 20 Filter name: none 2024-05-15T14:47:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.155+0000 7f8ded7fa640 20 reqs_thread_entry: start 2024-05-15T14:47:53.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-29_topic_created_v1 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-29_topic_created_v2 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got buckets.kaboom_2:vwwrqh-30_topic_created_v2 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got topic.:vwwrqh-28_topic_created_v1 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got buckets.:vwwrqh-28_topic_created_v2 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-30_topic_created_v1 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got topic.:vwwrqh-28_topic_created_v2 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got buckets.kaboom_1:vwwrqh-29_topic_created_v2 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-30_topic_created_v2 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.164+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.165+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=303 2024-05-15T14:47:53.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.165+0000 7f8fc2735800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.165+0000 7f8fc2735800 20 rados_obj.operate() r=0 bl.length=303 2024-05-15T14:47:53.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.167+0000 7f8e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.169+0000 7f8fc2735800 20 remove_watcher() i=0 2024-05-15T14:47:53.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.169+0000 7f8fc2735800 2 removed watcher, disabling cache 2024-05-15T14:47:53.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.170+0000 7f8fc2735800 20 remove_watcher() i=1 2024-05-15T14:47:53.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.171+0000 7f8fc2735800 20 remove_watcher() i=2 2024-05-15T14:47:53.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.172+0000 7f8fc2735800 20 remove_watcher() i=3 2024-05-15T14:47:53.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.173+0000 7f8fc2735800 20 remove_watcher() i=4 2024-05-15T14:47:53.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.174+0000 7f8fc2735800 20 remove_watcher() i=5 2024-05-15T14:47:53.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.175+0000 7f8fc2735800 20 remove_watcher() i=6 2024-05-15T14:47:53.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.176+0000 7f8fc2735800 20 remove_watcher() i=7 2024-05-15T14:47:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:53.235 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:53.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.273+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.274+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.274+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.275+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.275+0000 7f011441f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.275+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.276+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.276+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.276+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.276+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.277+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.277+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.277+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.277+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.277+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.277+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.278+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.278+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:53.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 20 zone MyZone found 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.279+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.280+0000 7f011441f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.280+0000 7f011441f800 20 started sync module instance, tier type = 2024-05-15T14:47:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.280+0000 7f011441f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.289+0000 7f011441f800 20 add_watcher() i=0 2024-05-15T14:47:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.289+0000 7f011441f800 20 add_watcher() i=1 2024-05-15T14:47:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.289+0000 7f011441f800 20 add_watcher() i=2 2024-05-15T14:47:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.289+0000 7f011441f800 20 add_watcher() i=3 2024-05-15T14:47:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.289+0000 7f011441f800 20 add_watcher() i=4 2024-05-15T14:47:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.289+0000 7f011441f800 20 add_watcher() i=5 2024-05-15T14:47:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.289+0000 7f011441f800 20 add_watcher() i=6 2024-05-15T14:47:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.290+0000 7f011441f800 20 add_watcher() i=7 2024-05-15T14:47:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.290+0000 7f011441f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:53.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.292+0000 7effc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.292+0000 7f011441f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:53.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.292+0000 7f011441f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:53.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.292+0000 7f011441f800 5 note: GC not initialized 2024-05-15T14:47:53.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.292+0000 7effc27fc640 20 reqs_thread_entry: start 2024-05-15T14:47:53.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.293+0000 7f011441f800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:53.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.293+0000 7f011441f800 20 Filter name: none 2024-05-15T14:47:53.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.293+0000 7eff33fff640 20 reqs_thread_entry: start 2024-05-15T14:47:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-29_topic_created_v1 2024-05-15T14:47:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got topic.kaboom_1:vwwrqh-29_topic_created_v2 2024-05-15T14:47:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got buckets.kaboom_2:vwwrqh-30_topic_created_v2 2024-05-15T14:47:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got topic.:vwwrqh-28_topic_created_v1 2024-05-15T14:47:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got buckets.:vwwrqh-28_topic_created_v2 2024-05-15T14:47:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-30_topic_created_v1 2024-05-15T14:47:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got topic.:vwwrqh-28_topic_created_v2 2024-05-15T14:47:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got buckets.kaboom_1:vwwrqh-29_topic_created_v2 2024-05-15T14:47:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 RGWRados::pool_iterate: got topic.kaboom_2:vwwrqh-30_topic_created_v2 2024-05-15T14:47:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.302+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.303+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=303 2024-05-15T14:47:53.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.303+0000 7f011441f800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.304+0000 7f011441f800 20 rados_obj.operate() r=0 bl.length=303 2024-05-15T14:47:53.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.305+0000 7effc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.307+0000 7f011441f800 20 remove_watcher() i=0 2024-05-15T14:47:53.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.307+0000 7f011441f800 2 removed watcher, disabling cache 2024-05-15T14:47:53.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.308+0000 7f011441f800 20 remove_watcher() i=1 2024-05-15T14:47:53.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.309+0000 7f011441f800 20 remove_watcher() i=2 2024-05-15T14:47:53.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.310+0000 7f011441f800 20 remove_watcher() i=3 2024-05-15T14:47:53.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.311+0000 7f011441f800 20 remove_watcher() i=4 2024-05-15T14:47:53.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.312+0000 7f011441f800 20 remove_watcher() i=5 2024-05-15T14:47:53.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.313+0000 7f011441f800 20 remove_watcher() i=6 2024-05-15T14:47:53.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.314+0000 7f011441f800 20 remove_watcher() i=7 2024-05-15T14:47:53.372 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:53.373 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:53.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.411+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.413+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.413+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.413+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.413+0000 7ff87dc40800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:53.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.413+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.414+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.414+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.414+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:53.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.414+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.415+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:53.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.415+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.416+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.416+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.416+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.416+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.417+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.417+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:53.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 zone MyZone found 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 started sync module instance, tier type = 2024-05-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.418+0000 7ff87dc40800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:53.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 20 add_watcher() i=0 2024-05-15T14:47:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 20 add_watcher() i=1 2024-05-15T14:47:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 20 add_watcher() i=2 2024-05-15T14:47:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 20 add_watcher() i=3 2024-05-15T14:47:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 20 add_watcher() i=4 2024-05-15T14:47:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 20 add_watcher() i=5 2024-05-15T14:47:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 20 add_watcher() i=6 2024-05-15T14:47:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 20 add_watcher() i=7 2024-05-15T14:47:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.428+0000 7ff87dc40800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:53.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.430+0000 7ff72efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.430+0000 7ff87dc40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:53.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.430+0000 7ff87dc40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:53.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.430+0000 7ff87dc40800 5 note: GC not initialized 2024-05-15T14:47:53.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.431+0000 7ff72dfe3640 20 reqs_thread_entry: start 2024-05-15T14:47:53.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.431+0000 7ff87dc40800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:53.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.431+0000 7ff87dc40800 20 Filter name: none 2024-05-15T14:47:53.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.431+0000 7ff69f7fe640 20 reqs_thread_entry: start 2024-05-15T14:47:53.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.431+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.431+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=187 2024-05-15T14:47:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.431+0000 7ff87dc40800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.432+0000 7ff87dc40800 20 rados_obj.operate() r=0 bl.length=401 2024-05-15T14:47:53.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.432+0000 7ff87dc40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:47:53.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.433+0000 7ff72efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.435+0000 7ff87dc40800 20 remove_watcher() i=0 2024-05-15T14:47:53.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.435+0000 7ff87dc40800 2 removed watcher, disabling cache 2024-05-15T14:47:53.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.436+0000 7ff87dc40800 20 remove_watcher() i=1 2024-05-15T14:47:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.437+0000 7ff87dc40800 20 remove_watcher() i=2 2024-05-15T14:47:53.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.438+0000 7ff87dc40800 20 remove_watcher() i=3 2024-05-15T14:47:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.439+0000 7ff87dc40800 20 remove_watcher() i=4 2024-05-15T14:47:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.440+0000 7ff87dc40800 20 remove_watcher() i=5 2024-05-15T14:47:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.441+0000 7ff87dc40800 20 remove_watcher() i=6 2024-05-15T14:47:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.442+0000 7ff87dc40800 20 remove_watcher() i=7 2024-05-15T14:47:53.502 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:53.502 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.539+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.541+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.541+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.542+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.542+0000 7f4589719800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.542+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.542+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.542+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.543+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.543+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.543+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.543+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.544+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.544+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.544+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.544+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 20 zone MyZone found 2024-05-15T14:47:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.545+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.546+0000 7f4589719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.546+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.546+0000 7f4589719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.546+0000 7f4589719800 20 started sync module instance, tier type = 2024-05-15T14:47:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.546+0000 7f4589719800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:53.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.563+0000 7f4589719800 20 add_watcher() i=0 2024-05-15T14:47:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.563+0000 7f4589719800 20 add_watcher() i=1 2024-05-15T14:47:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.563+0000 7f4589719800 20 add_watcher() i=2 2024-05-15T14:47:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.563+0000 7f4589719800 20 add_watcher() i=3 2024-05-15T14:47:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.563+0000 7f4589719800 20 add_watcher() i=4 2024-05-15T14:47:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.563+0000 7f4589719800 20 add_watcher() i=5 2024-05-15T14:47:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.563+0000 7f4589719800 20 add_watcher() i=6 2024-05-15T14:47:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.564+0000 7f4589719800 20 add_watcher() i=7 2024-05-15T14:47:53.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.564+0000 7f4589719800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:53.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.565+0000 7f443dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.565+0000 7f4589719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.565+0000 7f4589719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.566+0000 7f4589719800 5 note: GC not initialized 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.566+0000 7f443cfe1640 20 reqs_thread_entry: start 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.566+0000 7f4589719800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.566+0000 7f4589719800 20 Filter name: none 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.566+0000 7f43b67fc640 20 reqs_thread_entry: start 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.566+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.566+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=229 2024-05-15T14:47:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.566+0000 7f4589719800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.567+0000 7f4589719800 20 rados_obj.operate() r=0 bl.length=451 2024-05-15T14:47:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.567+0000 7f4589719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:47:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.568+0000 7f443dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.570+0000 7f4589719800 20 remove_watcher() i=0 2024-05-15T14:47:53.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.570+0000 7f4589719800 2 removed watcher, disabling cache 2024-05-15T14:47:53.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.571+0000 7f4589719800 20 remove_watcher() i=1 2024-05-15T14:47:53.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.572+0000 7f4589719800 20 remove_watcher() i=2 2024-05-15T14:47:53.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.573+0000 7f4589719800 20 remove_watcher() i=3 2024-05-15T14:47:53.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.574+0000 7f4589719800 20 remove_watcher() i=4 2024-05-15T14:47:53.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.575+0000 7f4589719800 20 remove_watcher() i=5 2024-05-15T14:47:53.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.576+0000 7f4589719800 20 remove_watcher() i=6 2024-05-15T14:47:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.577+0000 7f4589719800 20 remove_watcher() i=7 2024-05-15T14:47:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:53.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.675+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.676+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.676+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.677+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.677+0000 7fa0f8662800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.677+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.677+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.677+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.678+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:53.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.678+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.679+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:53.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.679+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.679+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.679+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.680+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:53.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.680+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.680+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:53.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.680+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 20 zone MyZone found 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:53.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.681+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.682+0000 7fa0f8662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:53.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.682+0000 7fa0f8662800 20 started sync module instance, tier type = 2024-05-15T14:47:53.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.682+0000 7fa0f8662800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:53.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.691+0000 7fa0f8662800 20 add_watcher() i=0 2024-05-15T14:47:53.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.691+0000 7fa0f8662800 20 add_watcher() i=1 2024-05-15T14:47:53.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.691+0000 7fa0f8662800 20 add_watcher() i=2 2024-05-15T14:47:53.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.691+0000 7fa0f8662800 20 add_watcher() i=3 2024-05-15T14:47:53.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.691+0000 7fa0f8662800 20 add_watcher() i=4 2024-05-15T14:47:53.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.691+0000 7fa0f8662800 20 add_watcher() i=5 2024-05-15T14:47:53.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.691+0000 7fa0f8662800 20 add_watcher() i=6 2024-05-15T14:47:53.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.692+0000 7fa0f8662800 20 add_watcher() i=7 2024-05-15T14:47:53.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.692+0000 7fa0f8662800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:53.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.693+0000 7f9facfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.694+0000 7fa0f8662800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:53.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.694+0000 7fa0f8662800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:53.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.694+0000 7fa0f8662800 5 note: GC not initialized 2024-05-15T14:47:53.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.694+0000 7f9f277fe640 20 reqs_thread_entry: start 2024-05-15T14:47:53.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.694+0000 7fa0f8662800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:53.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.694+0000 7fa0f8662800 20 Filter name: none 2024-05-15T14:47:53.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.694+0000 7f9f257fa640 20 reqs_thread_entry: start 2024-05-15T14:47:53.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.694+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.695+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=229 2024-05-15T14:47:53.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.695+0000 7fa0f8662800 20 rados->read ofs=0 len=0 2024-05-15T14:47:53.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.695+0000 7fa0f8662800 20 rados_obj.operate() r=0 bl.length=451 2024-05-15T14:47:53.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.695+0000 7fa0f8662800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T14:47:53.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.696+0000 7f9facfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:53.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.698+0000 7fa0f8662800 20 remove_watcher() i=0 2024-05-15T14:47:53.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.698+0000 7fa0f8662800 2 removed watcher, disabling cache 2024-05-15T14:47:53.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.699+0000 7fa0f8662800 20 remove_watcher() i=1 2024-05-15T14:47:53.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.700+0000 7fa0f8662800 20 remove_watcher() i=2 2024-05-15T14:47:53.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.701+0000 7fa0f8662800 20 remove_watcher() i=3 2024-05-15T14:47:53.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.702+0000 7fa0f8662800 20 remove_watcher() i=4 2024-05-15T14:47:53.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.703+0000 7fa0f8662800 20 remove_watcher() i=5 2024-05-15T14:47:53.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.704+0000 7fa0f8662800 20 remove_watcher() i=6 2024-05-15T14:47:53.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:53.705+0000 7fa0f8662800 20 remove_watcher() i=7 2024-05-15T14:47:53.874 INFO:teuthology.orchestra.run.smithi018.stderr:ok 2024-05-15T14:47:53.874 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:53.874 INFO:teuthology.orchestra.run.smithi018.stderr:====================================================================== 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:FAIL: test pushing http s3 notification 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:---------------------------------------------------------------------- 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr:Traceback (most recent call last): 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/nose/case.py", line 198, in runTest 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr: self.test(*self.arg) 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 1564, in test_notification_push_http 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr: notification_push('http', conn) 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 1336, in notification_push 2024-05-15T14:47:53.875 INFO:teuthology.orchestra.run.smithi018.stderr: receiver.verify_s3_events(keys, exact_match=True, deletions=True, expected_sizes=objects_size, etags=etags) 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 250, in verify_s3_events 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr: raise err 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 247, in verify_s3_events 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr: verify_s3_records_by_elements(self.events, keys, exact_match=exact_match, deletions=deletions, expected_sizes=expected_sizes, etags=etags) 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 150, in verify_s3_records_by_elements 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr: assert False, err 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:AssertionError: no deletion event found for key: 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:-------------------- >> begin captured logging << -------------------- 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Using access key provided by client. 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Using secret key provided by client. 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/ 2024-05-15T14:47:53.876 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/ 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/ 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {} 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.877 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.878 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:53.878 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/ 2024-05-15T14:47:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:sOJqYKc4d6Z4o/XlQ0O1FbYHqds= 2024-05-15T14:47:53.878 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:sOJqYKc4d6Z4o/XlQ0O1FbYHqds=', 'Content-Length': '0'} 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000008f5a0bfb042b4623-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: http server created on ('172.21.15.18', 13952) 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: http server started on ('172.21.15.18', 13952) 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 172.21.15.18:13952 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received iempty event 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:urllib3.connectionpool: DEBUG: http://172.21.15.18:13952 "POST / HTTP/1.1" 200 None 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event choose-service-name: calling handler 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event creating-client-class.sns: calling handler 2024-05-15T14:47:53.879 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.regions: DEBUG: Creating a regex based endpoint for sns, MyZoneGroup 2024-05-15T14:47:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.endpoint: DEBUG: Setting sns timeout as (60, 60) 2024-05-15T14:47:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.client: DEBUG: Registering retry handlers for service: sns 2024-05-15T14:47:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-parameter-build.sns.CreateTopic: calling handler 2024-05-15T14:47:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Region': 'MyZoneGroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi018.front.sepia.ceph.com:80'} 2024-05-15T14:47:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.regions: DEBUG: Endpoint provider result: http://smithi018.front.sepia.ceph.com:80 2024-05-15T14:47:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2024-05-15T14:47:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2024-05-15T14:47:53.880 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.endpoint: DEBUG: Making request for OperationModel(name=CreateTopic) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.105 md/Botocore#1.34.105 ua/2.0 os/linux#5.14.0-446.el9.x86_64 md/arch#x86_64 lang/python#3.9.18 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.105'}, 'body': {'Action': 'CreateTopic', 'Version': '2010-03-31', 'Name': 'vwwrqh-8_topic', 'Attributes.entry.1.key': 'push-endpoint', 'Attributes.entry.1.value': 'http://172.21.15.18:13952'}, 'url': 'http://smithi018.front.sepia.ceph.com:80/', 'context': {'client_region': 'MyZoneGroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler > 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event choose-signer.sns.CreateTopic: calling handler 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.auth: DEBUG: Calculating signature using v4 auth. 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.auth: DEBUG: CanonicalRequest: 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:POST 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:/ 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:content-type:application/x-www-form-urlencoded; charset=utf-8 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:host:smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.881 INFO:teuthology.orchestra.run.smithi018.stderr:x-amz-date:20240515T143012Z 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:content-type;host;x-amz-date 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:dd8a35f7546ff3c628cf9649a55bc1f27af1f3fca075f4a18728680a44531c44 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.auth: DEBUG: StringToSign: 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:AWS4-HMAC-SHA256 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:20240515T143012Z 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:20240515/MyZoneGroup/sns/aws4_request 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:56af0be5ee2c03ea96510a1b152cb7a970a4e988cdfb8ea57372c210e5397813 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.auth: DEBUG: Signature: 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:8e413628f46876ca0a10958da325b6eb038e1ea71363fb83be6292d6e62425fb 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler 2024-05-15T14:47:53.882 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.endpoint: DEBUG: Sending http request: 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): smithi018.front.sepia.ceph.com:80 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:urllib3.connectionpool: DEBUG: http://smithi018.front.sepia.ceph.com:80 "POST / HTTP/1.1" 200 313 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx000002dd847326cf41e6b-006644c6f4-4586-MyZone', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '313', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Connection': 'Keep-Alive'} 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.parsers: DEBUG: Response body: 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:b'arn:aws:sns:MyZoneGroup::vwwrqh-8_topicd844ce7e-fd85-4b58-a5b6-40865194449a.4586.3303468608578133611' 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event needs-retry.sns.CreateTopic: calling handler 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.retryhandler: DEBUG: No retry needed. 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event choose-service-name: calling handler 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler ._handler at 0x7fc43ae839d0> 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler 2024-05-15T14:47:53.883 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.endpoint: DEBUG: Setting s3 timeout as (60, 60) 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.client: DEBUG: Registering retry handlers for service: s3 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.utils: DEBUG: Registering S3 region redirector handler 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.utils: DEBUG: Registering S3Express Identity Resolver 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler > 2024-05-15T14:47:53.884 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Bucket': 'vwwrqh-8', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://smithi018.front.sepia.ceph.com:80', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True} 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.regions: DEBUG: Endpoint provider result: http://smithi018.front.sepia.ceph.com:80/vwwrqh-8 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.regions: DEBUG: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None" 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.regions: DEBUG: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True} 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler > 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.endpoint: DEBUG: Making request for OperationModel(name=PutBucketNotificationConfiguration) with params: {'url_path': '?notification', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.105 md/Botocore#1.34.105 ua/2.0 os/linux#5.14.0-446.el9.x86_64 md/arch#x86_64 lang/python#3.9.18 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.105'}, 'body': b'vwwrqh-8_notifarn:aws:sns:MyZoneGroup::vwwrqh-8_topic', 'auth_path': '/vwwrqh-8/', 'url': 'http://smithi018.front.sepia.ceph.com:80/vwwrqh-8?notification', 'context': {'client_region': 'us-east-1', 'client_config': , 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'vwwrqh-8', 'params': {'Bucket': 'vwwrqh-8', 'NotificationConfiguration': {'TopicConfigurations': [{'Id': 'vwwrqh-8_notif', 'TopicArn': 'arn:aws:sns:MyZoneGroup::vwwrqh-8_topic', 'Events': []}]}}}, 'input_params': {'Bucket': 'vwwrqh-8'}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'us-east-1'}]}}} 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler > 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler > 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-sign.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event before-sign.s3.PutBucketNotificationConfiguration: calling handler > 2024-05-15T14:47:53.885 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.auth: DEBUG: Calculating signature using v4 auth. 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.auth: DEBUG: CanonicalRequest: 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:notification= 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:host:smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:x-amz-content-sha256:55e77666123e9ad89887b0fc1c69e4f1fb3663079355e51d3e73596d7630a0db 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:x-amz-date:20240515T143012Z 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:host;x-amz-content-sha256;x-amz-date 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:55e77666123e9ad89887b0fc1c69e4f1fb3663079355e51d3e73596d7630a0db 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.auth: DEBUG: StringToSign: 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:AWS4-HMAC-SHA256 2024-05-15T14:47:53.886 INFO:teuthology.orchestra.run.smithi018.stderr:20240515T143012Z 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:20240515/us-east-1/s3/aws4_request 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:dc25ce4503fd88898cb8791bd35299fb72d45c39fc781ef8027c11df4c198ea5 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.auth: DEBUG: Signature: 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:6f2e2c8020cf86eae63900a1bb247fca2c77706637ed6e28de7da83d480c1631 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.endpoint: DEBUG: Sending http request: 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): smithi018.front.sepia.ceph.com:80 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:urllib3.connectionpool: DEBUG: http://smithi018.front.sepia.ceph.com:80 "PUT /vwwrqh-8?notification HTTP/1.1" 200 0 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx000008b985db352004b1e-006644c6f4-4586-MyZone', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '0', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Connection': 'Keep-Alive'} 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.parsers: DEBUG: Response body: 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:b'' 2024-05-15T14:47:53.887 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.retryhandler: DEBUG: No retry needed. 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler > 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/0 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/0 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/0 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wGUmOo2eH1sF/QjxQbcnKA==', 'Content-Length': '3010766', 'Expect': '100-Continue'} 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.888 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.889 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.889 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.889 INFO:teuthology.orchestra.run.smithi018.stderr:wGUmOo2eH1sF/QjxQbcnKA== 2024-05-15T14:47:53.889 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.889 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.889 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/0 2024-05-15T14:47:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:W/6BJX/pgibt3wpI9cjXRqxzmo8= 2024-05-15T14:47:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wGUmOo2eH1sF/QjxQbcnKA==', 'Content-Length': '3010766', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:W/6BJX/pgibt3wpI9cjXRqxzmo8='} 2024-05-15T14:47:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/1 2024-05-15T14:47:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/1 2024-05-15T14:47:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/1 2024-05-15T14:47:53.890 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ybAsz0mdzXWzfGkbRrk3gg==', 'Content-Length': '3008742', 'Expect': '100-Continue'} 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:ybAsz0mdzXWzfGkbRrk3gg== 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/1 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.891 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:GS+btJukeNLdJb2f8VqrRqBJ9Hk= 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ybAsz0mdzXWzfGkbRrk3gg==', 'Content-Length': '3008742', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:GS+btJukeNLdJb2f8VqrRqBJ9Hk='} 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.696519Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1938857063729423785","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"0","size":3010766,"eTag":"c065263a8d9e1f5b05fd08f141b72728","versionId":"","sequencer":"F4C6446641C2592A","metadata":[],"tags":[]}},"eventId":"1715783412.710525.c065263a8d9e1f5b05fd08f141b72728","opaqueData":""}]}' 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c065263a8d9e1f5b05fd08f141b72728"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001ae8343a19d965a9-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/2 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/2 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/2 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Qf66vhWPHJqmEgwJvBKFQw==', 'Content-Length': '3011148', 'Expect': '100-Continue'} 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.892 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:Qf66vhWPHJqmEgwJvBKFQw== 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/2 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:3zx8gRKbERI15jSmDNw/vTJ9Mv8= 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Qf66vhWPHJqmEgwJvBKFQw==', 'Content-Length': '3011148', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:3zx8gRKbERI15jSmDNw/vTJ9Mv8='} 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.717570Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.14358578537562366474","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"1","size":3008742,"eTag":"c9b02ccf499dcd75b37c691b46b93782","versionId":"","sequencer":"F4C64466EE398C2B","metadata":[],"tags":[]}},"eventId":"1715783412.730610.c9b02ccf499dcd75b37c691b46b93782","opaqueData":""}]}' 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c9b02ccf499dcd75b37c691b46b93782"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c743eb1adaf3e20a-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/3 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/3 2024-05-15T14:47:53.893 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/3 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QADttNQkcS0ux8JrlejlxA==', 'Content-Length': '3010874', 'Expect': '100-Continue'} 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:QADttNQkcS0ux8JrlejlxA== 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.894 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/3 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:L2p3CrSCpfA1muWzouPHpRnOs8M= 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'QADttNQkcS0ux8JrlejlxA==', 'Content-Length': '3010874', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:L2p3CrSCpfA1muWzouPHpRnOs8M='} 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/4 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/4 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/4 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '90rNeI+JBOoqcgEjQRZkSw==', 'Content-Length': '3011336', 'Expect': '100-Continue'} 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.895 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:90rNeI+JBOoqcgEjQRZkSw== 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/4 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:Z4mMPfhzSK5kewrlqA2NDgMMpfI= 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '90rNeI+JBOoqcgEjQRZkSw==', 'Content-Length': '3011336', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:Z4mMPfhzSK5kewrlqA2NDgMMpfI='} 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.742453Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1964875799111971368","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"2","size":3011148,"eTag":"41febabe158f1c9aa6120c09bc128543","versionId":"","sequencer":"F4C6446664291C2D","metadata":[],"tags":[]}},"eventId":"1715783412.756820.41febabe158f1c9aa6120c09bc128543","opaqueData":""}]}' 2024-05-15T14:47:53.896 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"41febabe158f1c9aa6120c09bc128543"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001b44a42101d4b228-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/5 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/5 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/5 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3TlTx6Hv8MHQ4H9VU54pUw==', 'Content-Length': '3008869', 'Expect': '100-Continue'} 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.897 INFO:teuthology.orchestra.run.smithi018.stderr:3TlTx6Hv8MHQ4H9VU54pUw== 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/5 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:Qja6I2W8mJAthmJLF5a/4D5S1VE= 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3TlTx6Hv8MHQ4H9VU54pUw==', 'Content-Length': '3008869', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:Qja6I2W8mJAthmJLF5a/4D5S1VE='} 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.776626Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10051191123565683063","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"3","size":3010874,"eTag":"4000edb4d424712d2ec7c26b95e8e5c4","versionId":"","sequencer":"F4C644661CFB272F","metadata":[],"tags":[]}},"eventId":"1715783412.791149.4000edb4d424712d2ec7c26b95e8e5c4","opaqueData":""}]}' 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.780960Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.16769480680247760326","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"4","size":3011336,"eTag":"f74acd788f8904ea2a7201234116644b","versionId":"","sequencer":"F4C6446654FE272F","metadata":[],"tags":[]}},"eventId":"1715783412.791150.f74acd788f8904ea2a7201234116644b","opaqueData":""}]}' 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4000edb4d424712d2ec7c26b95e8e5c4"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008b7d0112c9b12177-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"f74acd788f8904ea2a7201234116644b"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e8b929d485f195c6-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/6 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/6 2024-05-15T14:47:53.898 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/6 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'J9liAx1avz1vXRyOwPxbfw==', 'Content-Length': '3011588', 'Expect': '100-Continue'} 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:J9liAx1avz1vXRyOwPxbfw== 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.899 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/6 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:CfqA1Ls1qOJNGVtfL9YoayXtjMc= 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'J9liAx1avz1vXRyOwPxbfw==', 'Content-Length': '3011588', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:CfqA1Ls1qOJNGVtfL9YoayXtjMc='} 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/7 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/7 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/7 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0mOlgky8ZBJ55ec5cuRW7w==', 'Content-Length': '3012208', 'Expect': '100-Continue'} 2024-05-15T14:47:53.900 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.902 INFO:teuthology.orchestra.run.smithi018.stderr:0mOlgky8ZBJ55ec5cuRW7w== 2024-05-15T14:47:53.902 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.902 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.902 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/7 2024-05-15T14:47:53.902 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.902 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:8RHzxxELV1a9IJO+PUknQvNpn2k= 2024-05-15T14:47:53.903 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0mOlgky8ZBJ55ec5cuRW7w==', 'Content-Length': '3012208', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:8RHzxxELV1a9IJO+PUknQvNpn2k='} 2024-05-15T14:47:53.903 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.814666Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10134536412874390150","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"5","size":3008869,"eTag":"dd3953c7a1eff0c1d0e07f55539e2953","versionId":"","sequencer":"F4C64466BA485F31","metadata":[],"tags":[]}},"eventId":"1715783412.828328.dd3953c7a1eff0c1d0e07f55539e2953","opaqueData":""}]}' 2024-05-15T14:47:53.903 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.819276Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10190833173760738081","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"6","size":3011588,"eTag":"27d962031d5abf3d6f5d1c8ec0fc5b7f","versionId":"","sequencer":"F4C64466C1FB6F31","metadata":[],"tags":[]}},"eventId":"1715783412.829422.27d962031d5abf3d6f5d1c8ec0fc5b7f","opaqueData":""}]}' 2024-05-15T14:47:53.903 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"dd3953c7a1eff0c1d0e07f55539e2953"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008ca51b2c24a3ba86-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.903 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"27d962031d5abf3d6f5d1c8ec0fc5b7f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008d6d1cc737468321-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/8 2024-05-15T14:47:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/8 2024-05-15T14:47:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/8 2024-05-15T14:47:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wtAA5VtSY+5lOE55KemWNA==', 'Content-Length': '3010246', 'Expect': '100-Continue'} 2024-05-15T14:47:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.906 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.906 INFO:teuthology.orchestra.run.smithi018.stderr:wtAA5VtSY+5lOE55KemWNA== 2024-05-15T14:47:53.906 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.906 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.906 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/8 2024-05-15T14:47:53.907 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.907 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:hVDP/ynx0RLGSfN99AbWWwcz+t0= 2024-05-15T14:47:53.907 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wtAA5VtSY+5lOE55KemWNA==', 'Content-Length': '3010246', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:hVDP/ynx0RLGSfN99AbWWwcz+t0='} 2024-05-15T14:47:53.907 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/9 2024-05-15T14:47:53.907 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/9 2024-05-15T14:47:53.908 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.908 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/9 2024-05-15T14:47:53.908 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.908 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2zTO69AJYun5EwKu8LJ+aA==', 'Content-Length': '3011300', 'Expect': '100-Continue'} 2024-05-15T14:47:53.908 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.908 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.909 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.909 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.909 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.909 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.909 INFO:teuthology.orchestra.run.smithi018.stderr:2zTO69AJYun5EwKu8LJ+aA== 2024-05-15T14:47:53.909 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.910 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.910 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/9 2024-05-15T14:47:53.910 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.910 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:C2/FuFRhn85N75mXwG6MrXfTaHM= 2024-05-15T14:47:53.910 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '2zTO69AJYun5EwKu8LJ+aA==', 'Content-Length': '3011300', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:C2/FuFRhn85N75mXwG6MrXfTaHM='} 2024-05-15T14:47:53.910 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.841815Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11470929739491452627","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"7","size":3012208,"eTag":"d263a5824cbc641279e5e73972e456ef","versionId":"","sequencer":"F4C6446671FAF232","metadata":[],"tags":[]}},"eventId":"1715783412.854784.d263a5824cbc641279e5e73972e456ef","opaqueData":""}]}' 2024-05-15T14:47:53.911 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d263a5824cbc641279e5e73972e456ef"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009f30edd28dda26d3-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.911 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/10 2024-05-15T14:47:53.911 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/10 2024-05-15T14:47:53.911 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.911 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/10 2024-05-15T14:47:53.911 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.912 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wuRyFrAaOb2bNjlKcIcTmg==', 'Content-Length': '3010715', 'Expect': '100-Continue'} 2024-05-15T14:47:53.912 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.912 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.912 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.912 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.912 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.912 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.913 INFO:teuthology.orchestra.run.smithi018.stderr:wuRyFrAaOb2bNjlKcIcTmg== 2024-05-15T14:47:53.913 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.913 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.913 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/10 2024-05-15T14:47:53.913 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.913 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:dpWRmARpn38cPEx2j/tMap54tq8= 2024-05-15T14:47:53.914 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'wuRyFrAaOb2bNjlKcIcTmg==', 'Content-Length': '3010715', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:dpWRmARpn38cPEx2j/tMap54tq8='} 2024-05-15T14:47:53.914 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.874011Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.17133106063476725643","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"8","size":3010246,"eTag":"c2d000e55b5263ee65384e7929e99634","versionId":"","sequencer":"F4C64466AF90F434","metadata":[],"tags":[]}},"eventId":"1715783412.888443.c2d000e55b5263ee65384e7929e99634","opaqueData":""}]}' 2024-05-15T14:47:53.914 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c2d000e55b5263ee65384e7929e99634"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000edc505308c9f178b-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.914 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.879712Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.18173668712812269798","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"9","size":3011300,"eTag":"db34ceebd00962e9f91302aef0b27e68","versionId":"","sequencer":"F4C644664E170935","metadata":[],"tags":[]}},"eventId":"1715783412.889788.db34ceebd00962e9f91302aef0b27e68","opaqueData":""}]}' 2024-05-15T14:47:53.914 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"db34ceebd00962e9f91302aef0b27e68"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fc35d767f4ce50e6-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.915 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/11 2024-05-15T14:47:53.915 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/11 2024-05-15T14:47:53.915 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.915 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/11 2024-05-15T14:47:53.915 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.915 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uYQLCquB5pNS6qepUZOFyQ==', 'Content-Length': '3011231', 'Expect': '100-Continue'} 2024-05-15T14:47:53.915 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.916 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.916 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.916 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.916 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.916 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.916 INFO:teuthology.orchestra.run.smithi018.stderr:uYQLCquB5pNS6qepUZOFyQ== 2024-05-15T14:47:53.916 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.917 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.917 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/11 2024-05-15T14:47:53.917 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.917 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:nXeallbvHR7GixdoTfuSJ/dPZn4= 2024-05-15T14:47:53.917 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uYQLCquB5pNS6qepUZOFyQ==', 'Content-Length': '3011231', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:nXeallbvHR7GixdoTfuSJ/dPZn4='} 2024-05-15T14:47:53.917 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/12 2024-05-15T14:47:53.917 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/12 2024-05-15T14:47:53.917 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/12 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Tws6i0Qhmll1/+K6xuONug==', 'Content-Length': '3009671', 'Expect': '100-Continue'} 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:Tws6i0Qhmll1/+K6xuONug== 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.918 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/12 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:YnA9tlXn/snUIM5VW/dTVc4rM/Q= 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Tws6i0Qhmll1/+K6xuONug==', 'Content-Length': '3009671', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:YnA9tlXn/snUIM5VW/dTVc4rM/Q='} 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.915217Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.13363501841919534854","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"10","size":3010715,"eTag":"c2e47216b01a39bd9b36394a7087139a","versionId":"","sequencer":"F4C6446677653C37","metadata":[],"tags":[]}},"eventId":"1715783412.926705.c2e47216b01a39bd9b36394a7087139a","opaqueData":""}]}' 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"c2e47216b01a39bd9b36394a7087139a"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b974b21f52e46706-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/13 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/13 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/13 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4+Nyh/skA0tF0RHYOlfPJA==', 'Content-Length': '3012199', 'Expect': '100-Continue'} 2024-05-15T14:47:53.919 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:4+Nyh/skA0tF0RHYOlfPJA== 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/13 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:r4DvAFl9bWxryNnfqBzGzFN2Fv0= 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4+Nyh/skA0tF0RHYOlfPJA==', 'Content-Length': '3012199', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:r4DvAFl9bWxryNnfqBzGzFN2Fv0='} 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.935019Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9736606496627025979","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"11","size":3011231,"eTag":"b9840b0aab81e69352eaa7a9519385c9","versionId":"","sequencer":"F4C6446691606F38","metadata":[],"tags":[]}},"eventId":"1715783412.946823.b9840b0aab81e69352eaa7a9519385c9","opaqueData":""}]}' 2024-05-15T14:47:53.920 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"b9840b0aab81e69352eaa7a9519385c9"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000871f60059d36e83b-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/14 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/14 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/14 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Wr3RCzGscKonrisKdnSt7Q==', 'Content-Length': '3007871', 'Expect': '100-Continue'} 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:Wr3RCzGscKonrisKdnSt7Q== 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.921 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/14 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:RGeC+t77OuEaF0bdT+nLkABrsvw= 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Wr3RCzGscKonrisKdnSt7Q==', 'Content-Length': '3007871', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:RGeC+t77OuEaF0bdT+nLkABrsvw='} 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.954496Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.16683800843196462491","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"12","size":3009671,"eTag":"4f0b3a8b44219a5975ffe2bac6e38dba","versionId":"","sequencer":"F4C64466CB9A6F39","metadata":[],"tags":[]}},"eventId":"1715783412.963615.4f0b3a8b44219a5975ffe2bac6e38dba","opaqueData":""}]}' 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"4f0b3a8b44219a5975ffe2bac6e38dba"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e788c478ea16759b-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/15 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/15 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/15 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hbQAXCgY8Rg8nwI7b4BBew==', 'Content-Length': '3013373', 'Expect': '100-Continue'} 2024-05-15T14:47:53.922 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:hbQAXCgY8Rg8nwI7b4BBew== 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/15 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:zyQ+XovLtK0GVEnRPUPcLxlU+Eo= 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hbQAXCgY8Rg8nwI7b4BBew==', 'Content-Length': '3013373', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:zyQ+XovLtK0GVEnRPUPcLxlU+Eo='} 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.973934Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.7747726603175082112","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"13","size":3012199,"eTag":"e3e37287fb24034b45d111d83a57cf24","versionId":"","sequencer":"F4C644663046CA3A","metadata":[],"tags":[]}},"eventId":"1715783412.986334.e3e37287fb24034b45d111d83a57cf24","opaqueData":""}]}' 2024-05-15T14:47:53.923 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"e3e37287fb24034b45d111d83a57cf24"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006b85744bdf183880-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:12 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/16 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/16 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/16 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7MnSBOjQwPjDdI4KK39qgw==', 'Content-Length': '3010223', 'Expect': '100-Continue'} 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:7MnSBOjQwPjDdI4KK39qgw== 2024-05-15T14:47:53.924 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:12 GMT 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/16 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:r8cIxDouf0TxcVIhtTysSFCj1MM= 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '7MnSBOjQwPjDdI4KK39qgw==', 'Content-Length': '3010223', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:12 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:r8cIxDouf0TxcVIhtTysSFCj1MM='} 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:12.994245Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6660170175653642889","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"14","size":3007871,"eTag":"5abdd10b31ac70aa27ae2b0a7674aded","versionId":"","sequencer":"F5C6446623234800","metadata":[],"tags":[]}},"eventId":"1715783413.004727.5abdd10b31ac70aa27ae2b0a7674aded","opaqueData":""}]}' 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"5abdd10b31ac70aa27ae2b0a7674aded"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005c6dad7cd77c8289-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:13 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/17 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/17 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/17 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0creAzbJnMUiV8S7mWoirQ==', 'Content-Length': '3011021', 'Expect': '100-Continue'} 2024-05-15T14:47:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:0creAzbJnMUiV8S7mWoirQ== 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/17 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:hTUDayNefANn/XCMIHa/T3W+tDQ= 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '0creAzbJnMUiV8S7mWoirQ==', 'Content-Length': '3011021', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:13 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:hTUDayNefANn/XCMIHa/T3W+tDQ='} 2024-05-15T14:47:53.926 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:13.016437Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.13283143579711104829","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"15","size":3013373,"eTag":"85b4005c2818f1183c9f023b6f80417b","versionId":"","sequencer":"F5C64466C0588D01","metadata":[],"tags":[]}},"eventId":"1715783413.026040.85b4005c2818f1183c9f023b6f80417b","opaqueData":""}]}' 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"85b4005c2818f1183c9f023b6f80417b"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b85734b56930e73d-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:13 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/18 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/18 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/18 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gz7kjCdb24P4E70uEU60TQ==', 'Content-Length': '3010072', 'Expect': '100-Continue'} 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:gz7kjCdb24P4E70uEU60TQ== 2024-05-15T14:47:53.927 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/18 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:WktcKg50CCs9aV40tkLoOFpqXZY= 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'gz7kjCdb24P4E70uEU60TQ==', 'Content-Length': '3010072', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:13 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:WktcKg50CCs9aV40tkLoOFpqXZY='} 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:13.048258Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.14802383349899538241","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"16","size":3010223,"eTag":"ecc9d204e8d0c0f8c3748e0a2b7f6a83","versionId":"","sequencer":"F5C644664A979703","metadata":[],"tags":[]}},"eventId":"1715783413.060266.ecc9d204e8d0c0f8c3748e0a2b7f6a83","opaqueData":""}]}' 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"ecc9d204e8d0c0f8c3748e0a2b7f6a83"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cd6ca13af7eb2f41-006644c6f4-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:13 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/19 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/19 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/19 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dnDyzxD9lQ6IExUuKll9xg==', 'Content-Length': '3012606', 'Expect': '100-Continue'} 2024-05-15T14:47:53.928 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:dnDyzxD9lQ6IExUuKll9xg== 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/19 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:siBY8ibNnI95nDPYfPv8QMrfGKI= 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dnDyzxD9lQ6IExUuKll9xg==', 'Content-Length': '3012606', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:13 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:siBY8ibNnI95nDPYfPv8QMrfGKI='} 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:13.071394Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.13316130820919046282","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"17","size":3011021,"eTag":"d1cade0336c99cc52257c4bb996a22ad","versionId":"","sequencer":"F5C6446689730205","metadata":[],"tags":[]}},"eventId":"1715783413.084046.d1cade0336c99cc52257c4bb996a22ad","opaqueData":""}]}' 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"d1cade0336c99cc52257c4bb996a22ad"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b8cc666e0382b08a-006644c6f5-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:13 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.929 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/20 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/20 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/20 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'pEakJ6B+Fmy3o1mTp1pFUQ==', 'Content-Length': '3010574', 'Expect': '100-Continue'} 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:pEakJ6B+Fmy3o1mTp1pFUQ== 2024-05-15T14:47:53.930 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/20 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:s3I9T/T5U0JcFvYNjum90VghRIA= 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'pEakJ6B+Fmy3o1mTp1pFUQ==', 'Content-Length': '3010574', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:13 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:s3I9T/T5U0JcFvYNjum90VghRIA='} 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/21 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/21 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/21 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '+wULF4ix63Gxz9gWOsY5vw==', 'Content-Length': '3012501', 'Expect': '100-Continue'} 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.931 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:+wULF4ix63Gxz9gWOsY5vw== 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/21 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:x+TlyRmHJpaeNSaOO7ecWbGzAoQ= 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '+wULF4ix63Gxz9gWOsY5vw==', 'Content-Length': '3012501', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:13 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:x+TlyRmHJpaeNSaOO7ecWbGzAoQ='} 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:13.106490Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1648433150486260136","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"18","size":3010072,"eTag":"833ee48c275bdb83f813bd2e114eb44d","versionId":"","sequencer":"F5C64466DCE70907","metadata":[],"tags":[]}},"eventId":"1715783413.118089.833ee48c275bdb83f813bd2e114eb44d","opaqueData":""}]}' 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"833ee48c275bdb83f813bd2e114eb44d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000016e0693772b629a8-006644c6f5-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:13 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/22 2024-05-15T14:47:53.932 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/22 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/22 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4N0Le9XLQcdkKctHJHFmbw==', 'Content-Length': '3008271', 'Expect': '100-Continue'} 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:4N0Le9XLQcdkKctHJHFmbw== 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/22 2024-05-15T14:47:53.933 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:hv39z8OvjqUIzKtBo3p3u9LJOQQ= 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '4N0Le9XLQcdkKctHJHFmbw==', 'Content-Length': '3008271', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:13 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:hv39z8OvjqUIzKtBo3p3u9LJOQQ='} 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:13.130662Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11319295724641038195","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"19","size":3012606,"eTag":"7670f2cf10fd950e8813152e2a597dc6","versionId":"","sequencer":"F5C64466B12D6B08","metadata":[],"tags":[]}},"eventId":"1715783413.141241.7670f2cf10fd950e8813152e2a597dc6","opaqueData":""}]}' 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"7670f2cf10fd950e8813152e2a597dc6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009d16377d46d3af73-006644c6f5-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:13 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/23 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/23 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/23 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'KzHFI2YjSS4a1xKTm9LZKQ==', 'Content-Length': '3010833', 'Expect': '100-Continue'} 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.934 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:KzHFI2YjSS4a1xKTm9LZKQ== 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/23 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:8EHf45kH9MCQiwo3CMc+9s6WE9k= 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'KzHFI2YjSS4a1xKTm9LZKQ==', 'Content-Length': '3010833', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:13 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:8EHf45kH9MCQiwo3CMc+9s6WE9k='} 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/24 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/24 2024-05-15T14:47:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/24 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '85N66C+Ggr7Vpsh6nAnuYQ==', 'Content-Length': '3010250', 'Expect': '100-Continue'} 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 80} 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:85N66C+Ggr7Vpsh6nAnuYQ== 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.936 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/24 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:QPC/qvbVI5Ruab8hZ085YbdzKbg= 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '85N66C+Ggr7Vpsh6nAnuYQ==', 'Content-Length': '3010250', 'Expect': '100-Continue', 'Date': 'Wed, 15 May 2024 14:30:13 GMT', 'Authorization': 'AWS MHWQSYCRCOLJHPGBGYLV:QPC/qvbVI5Ruab8hZ085YbdzKbg='} 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:bucket_notification.test_bn: INFO: HTTP Server received event: b'{"Records":[{"eventVersion":"2.2","eventSource":"ceph:s3","awsRegion":"MyZoneGroup","eventTime":"2024-05-15T14:30:13.183045Z","eventName":"ObjectCreated:Put","userIdentity":{"principalId":"foo.client.0"},"requestParameters":{"sourceIPAddress":""},"responseElements":{"x-amz-request-id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9306192764817931233","x-amz-id-2":"4586-MyZone-MyZoneGroup"},"s3":{"s3SchemaVersion":"1.0","configurationId":"vwwrqh-8_notif","bucket":{"name":"vwwrqh-8","ownerIdentity":{"principalId":"foo.client.0"},"arn":"arn:aws:s3:MyZoneGroup::vwwrqh-8","id":"d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6"},"object":{"key":"20","size":3010574,"eTag":"a446a427a07e166cb7a35993a75a4551","versionId":"","sequencer":"F5C6446678E8770B","metadata":[],"tags":[]}},"eventId":"1715783413.192407.a446a427a07e166cb7a35993a75a4551","opaqueData":""}]}' 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a446a427a07e166cb7a35993a75a4551"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000081263d0366487be1-006644c6f5-4586-MyZone'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Wed, 15 May 2024 14:30:13 GMT'), ('Connection', 'Keep-Alive')] 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: path=/vwwrqh-8/25 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: auth_path=/vwwrqh-8/25 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Method: PUT 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Path: /vwwrqh-8/25 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Data: 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 Linux/5.14.0-446.el9.x86_64', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6JRTiblgNs40Gan6SjDtpg==', 'Content-Length': '3009050', 'Expect': '100-Continue'} 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Host: smithi018.front.sepia.ceph.com 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Port: 80 2024-05-15T14:47:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Params: {} 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Token: None 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: StringToSign: 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:PUT 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:6JRTiblgNs40Gan6SjDtpg== 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:application/octet-stream 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:Wed, 15 May 2024 14:30:13 GMT 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:/vwwrqh-8/25 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Signature: 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:AWS MHWQSYCRCOLJHPGBGYLV:rWqjNxLwVejfmRs+Fv7l140+xdw= 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.9.18 LiTraceback (most recent call last): 2024-05-15T14:47:53.938 INFO:teuthology.orchestra.run.smithi018.stderr: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-15T14:47:53.940 INFO:teuthology.orchestra.run.smithi018.stderr: return _run_code(code, main_globals, None, 2024-05-15T14:47:53.940 INFO:teuthology.orchestra.run.smithi018.stderr: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-15T14:47:53.940 INFO:teuthology.orchestra.run.smithi018.stderr: exec(code, run_globals) 2024-05-15T14:47:53.940 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/nose/__main__.py", line 8, in 2024-05-15T14:47:53.940 INFO:teuthology.orchestra.run.smithi018.stderr: run_exit() 2024-05-15T14:47:53.940 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/nose/core.py", line 118, in __init__ 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: unittest.TestProgram.__init__( 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: File "/usr/lib64/python3.9/unittest/main.py", line 101, in __init__ 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: self.runTests() 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/nose/core.py", line 207, in runTests 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: result = self.testRunner.run(self.test) 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/nose/core.py", line 66, in run 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: result.printErrors() 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib64/python3.9/site-packages/nose/result.py", line 103, in printErrors 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: _TextTestResult.printErrors(self) 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: File "/usr/lib64/python3.9/unittest/runner.py", line 117, in printErrors 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: self.printErrorList('FAIL', self.failures) 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: File "/usr/lib64/python3.9/unittest/runner.py", line 124, in printErrorList 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: self.stream.writeln("%s" % err) 2024-05-15T14:47:53.941 INFO:teuthology.orchestra.run.smithi018.stderr: File "/usr/lib64/python3.9/unittest/runner.py", line 25, in writeln 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stderr: self.write(arg) 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stderr:BlockingIOError: [Errno 11] write could not complete without blocking 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx0000025cebe34b91882c0-006644cabd-8843-MyZone 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:46:21 GMT 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-27?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715784319.3502338:oewaRK9EI2mrO2w5ErRy3JwlRak=\r\nDate: Wed, 15 May 2024 14:46:21 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:47:53.942 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000aa55adb894ac5cbd-006644cabd-8843-MyZone 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:46:21 GMT 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.944 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:('', 154) 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-28?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:NL/E0AIAwk+9YDMXgd3uJYhqlf4=\r\nDate: Wed, 15 May 2024 14:47:53 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx0000016b3b33204a4bb63-006644cb19-9725-MyZone 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:47:53 GMT 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-29?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715784381.854302:Zwgtj0wAXKOXtX9sDKjtIV9oz7g=\r\nDate: Wed, 15 May 2024 14:47:53 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:47:53.945 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx0000073a33a4bf4057cd3-006644cb19-9725-MyZone 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:47:53 GMT 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-30?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715784382.1319225:s0RfI1KjQoYSbCnQwhmOJO7Q5ks=\r\nDate: Wed, 15 May 2024 14:47:53 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000af4b2be6a334651f-006644cb19-9725-MyZone 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:47:53 GMT 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-28?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS MHWQSYCRCOLJHPGBGYLV:NL/E0AIAwk+9YDMXgd3uJYhqlf4=\r\nDate: Wed, 15 May 2024 14:47:53 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:47:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx000001c88ea974f9fb536-006644cb19-9725-MyZone 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:47:53 GMT 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-29?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715784381.854302:Zwgtj0wAXKOXtX9sDKjtIV9oz7g=\r\nDate: Wed, 15 May 2024 14:47:53 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000833faeea86ece174-006644cb19-9725-MyZone 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:47:53 GMT 2024-05-15T14:47:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:47:53.948 INFO:teuthology.orchestra.run.smithi018.stdout:send: b'DELETE /vwwrqh-30?notification HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nAuthorization: AWS 1715784382.1319225:s0RfI1KjQoYSbCnQwhmOJO7Q5ks=\r\nDate: Wed, 15 May 2024 14:47:53 +0000\r\nHost: smithi018.front.sepia.ceph.com:80\r\n\r\n' 2024-05-15T14:47:53.948 INFO:teuthology.orchestra.run.smithi018.stdout:Zero length chunk ignored 2024-05-15T14:47:53.948 INFO:teuthology.orchestra.run.smithi018.stdout:reply: 'HTTP/1.1 200 OK\r\n' 2024-05-15T14:47:53.948 INFO:teuthology.orchestra.run.smithi018.stdout:header: x-amz-request-id: tx00000ab6c07c2553582bf-006644cb19-9725-MyZone 2024-05-15T14:47:53.948 INFO:teuthology.orchestra.run.smithi018.stdout:header: Server: Ceph Object Gateway (squid) 2024-05-15T14:47:53.948 INFO:teuthology.orchestra.run.smithi018.stdout:header: Content-Length: 0 2024-05-15T14:47:53.948 INFO:teuthology.orchestra.run.smithi018.stdout:header: Date: Wed, 15 May 2024 14:47:53 GMT 2024-05-15T14:47:53.948 INFO:teuthology.orchestra.run.smithi018.stdout:header: Connection: Keep-Alive 2024-05-15T14:47:54.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:47:54.018 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa/tasks/notification_tests.py", line 238, in run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (bucket notification tests against different endpoints) on smithi018 with status 1: "BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a '!kafka_test,!amqp_test,!amqp_ssl_test,!kafka_security_test,!modification_required,!manual_test'" 2024-05-15T14:47:54.038 INFO:tasks.notification_tests:Removing bn-tests.conf file... 2024-05-15T14:47:54.039 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf 2024-05-15T14:47:54.075 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2024-05-15T14:47:54.159 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:47:54.159 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:47:54.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.193+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.195+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:54.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.195+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.196+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:54.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.196+0000 7f5fc9462800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:47:54.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.196+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.196+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:54.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.196+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.197+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:47:54.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.197+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.197+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:47:54.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.197+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.198+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:54.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.198+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.198+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:47:54.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.198+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.199+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:47:54.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.199+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:47:54.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 zone MyZone found 2024-05-15T14:47:54.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:47:54.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:47:54.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:47:54.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:47:54.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 period zonegroup name MyZoneGroup 2024-05-15T14:47:54.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:47:54.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:54.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:54.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 started sync module instance, tier type = 2024-05-15T14:47:54.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.200+0000 7f5fc9462800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:47:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.210+0000 7f5fc9462800 20 add_watcher() i=0 2024-05-15T14:47:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.210+0000 7f5fc9462800 20 add_watcher() i=1 2024-05-15T14:47:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.210+0000 7f5fc9462800 20 add_watcher() i=2 2024-05-15T14:47:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.210+0000 7f5fc9462800 20 add_watcher() i=3 2024-05-15T14:47:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.210+0000 7f5fc9462800 20 add_watcher() i=4 2024-05-15T14:47:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.210+0000 7f5fc9462800 20 add_watcher() i=5 2024-05-15T14:47:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.210+0000 7f5fc9462800 20 add_watcher() i=6 2024-05-15T14:47:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.211+0000 7f5fc9462800 20 add_watcher() i=7 2024-05-15T14:47:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.211+0000 7f5fc9462800 2 all 8 watchers are set, enabling cache 2024-05-15T14:47:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.213+0000 7f5e7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.213+0000 7f5fc9462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:47:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.213+0000 7f5fc9462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:47:54.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.247+0000 7f5df7fff640 20 reqs_thread_entry: start 2024-05-15T14:47:54.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.247+0000 7f5fc9462800 20 init_complete bucket index max shards: 11 2024-05-15T14:47:54.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.247+0000 7f5fc9462800 20 Filter name: none 2024-05-15T14:47:54.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.248+0000 7f5df5ffb640 20 reqs_thread_entry: start 2024-05-15T14:47:54.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.248+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.meta+users.uid+foo.client.0 : miss 2024-05-15T14:47:54.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.248+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.248+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=443 2024-05-15T14:47:54.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.248+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-05-15T14:47:54.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.248+0000 7f5fc9462800 10 adding MyZone.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-05-15T14:47:54.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.248+0000 7f5fc9462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:54.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-22:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20 : miss 2024-05-15T14:47:54.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=403 2024-05-15T14:47:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-22:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20 info.flags=0x17 2024-05-15T14:47:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 10 adding MyZone.rgw.meta+root+.bucket.meta.vwwrqh-22:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20 to cache LRU end 2024-05-15T14:47:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 10 updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:47:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 10 updating xattr: name=user.rgw.bucket-notification bl.length()=394 2024-05-15T14:47:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.249+0000 7f5fc9462800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-22:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20 2024-05-15T14:47:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.250+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-3 2024-05-15T14:47:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.250+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-4 2024-05-15T14:47:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.250+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-8 2024-05-15T14:47:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.251+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-0 2024-05-15T14:47:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.251+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-1 2024-05-15T14:47:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.252+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-5 2024-05-15T14:47:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.252+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-9 2024-05-15T14:47:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.252+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-2 2024-05-15T14:47:54.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.253+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-6 2024-05-15T14:47:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.253+0000 7f5fc9462800 10 cls_bucket_list_unordered: got key-7 2024-05-15T14:47:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.254+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-3 state=0x56468b431588 s->prefetch_data=0 2024-05-15T14:47:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.254+0000 7f5fc9462800 10 manifest: total_size = 3013236 2024-05-15T14:47:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.254+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6223194633802494284 2024-05-15T14:47:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.254+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-3 state=0x56468b431588 s->prefetch_data=0 2024-05-15T14:47:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.254+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431588 2024-05-15T14:47:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.254+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.0 2024-05-15T14:47:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.256+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-4 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.257+0000 7f5fc9462800 10 manifest: total_size = 3009425 2024-05-15T14:47:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.257+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.18408134833083105201 2024-05-15T14:47:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.257+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-4 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.257+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431558 2024-05-15T14:47:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.257+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.1 2024-05-15T14:47:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.258+0000 7f5eaa7fc640 20 handle_completion(): completion ok for obj=key-3 2024-05-15T14:47:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.260+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-8 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.260+0000 7f5fc9462800 10 manifest: total_size = 3013908 2024-05-15T14:47:54.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.260+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6705993409325035858 2024-05-15T14:47:54.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.260+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-8 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.260+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431558 2024-05-15T14:47:54.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.260+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.1 2024-05-15T14:47:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.261+0000 7f5ea9ffb640 20 handle_completion(): completion ok for obj=key-4 2024-05-15T14:47:54.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.262+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-0 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.263+0000 7f5fc9462800 10 manifest: total_size = 3011200 2024-05-15T14:47:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.263+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.14743036326614574210 2024-05-15T14:47:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.263+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-0 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.263+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431558 2024-05-15T14:47:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.263+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.3 2024-05-15T14:47:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.264+0000 7f5eaa7fc640 20 handle_completion(): completion ok for obj=key-8 2024-05-15T14:47:54.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.265+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-1 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.266+0000 7f5fc9462800 10 manifest: total_size = 3011742 2024-05-15T14:47:54.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.266+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.9358908119871088509 2024-05-15T14:47:54.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.266+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-1 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.266+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431558 2024-05-15T14:47:54.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.266+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.4 2024-05-15T14:47:54.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.266+0000 7f5ea9ffb640 20 handle_completion(): completion ok for obj=key-0 2024-05-15T14:47:54.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.268+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-5 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.269+0000 7f5fc9462800 10 manifest: total_size = 3010404 2024-05-15T14:47:54.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.269+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11972432511663112536 2024-05-15T14:47:54.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.269+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-5 state=0x56468b431558 s->prefetch_data=0 2024-05-15T14:47:54.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.269+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431558 2024-05-15T14:47:54.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.269+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.5 2024-05-15T14:47:54.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.270+0000 7f5eaa7fc640 20 handle_completion(): completion ok for obj=key-1 2024-05-15T14:47:54.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.272+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-9 state=0x56468b431048 s->prefetch_data=0 2024-05-15T14:47:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.272+0000 7f5fc9462800 10 manifest: total_size = 3012168 2024-05-15T14:47:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.272+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6429357357383680934 2024-05-15T14:47:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.272+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-9 state=0x56468b431048 s->prefetch_data=0 2024-05-15T14:47:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.272+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431048 2024-05-15T14:47:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.272+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.5 2024-05-15T14:47:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.273+0000 7f5ea9ffb640 20 handle_completion(): completion ok for obj=key-5 2024-05-15T14:47:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.275+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-2 state=0x56468b431048 s->prefetch_data=0 2024-05-15T14:47:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.275+0000 7f5fc9462800 10 manifest: total_size = 3010295 2024-05-15T14:47:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.275+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1866438142908728929 2024-05-15T14:47:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.275+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-2 state=0x56468b431048 s->prefetch_data=0 2024-05-15T14:47:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.275+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431048 2024-05-15T14:47:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.275+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.7 2024-05-15T14:47:54.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.276+0000 7f5eaa7fc640 20 handle_completion(): completion ok for obj=key-9 2024-05-15T14:47:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.278+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-6 state=0x56468b431048 s->prefetch_data=0 2024-05-15T14:47:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.278+0000 7f5fc9462800 10 manifest: total_size = 3011101 2024-05-15T14:47:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.278+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.3112258591347021911 2024-05-15T14:47:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.278+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-6 state=0x56468b431048 s->prefetch_data=0 2024-05-15T14:47:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.278+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431048 2024-05-15T14:47:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.278+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.8 2024-05-15T14:47:54.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.279+0000 7f5ea9ffb640 20 handle_completion(): completion ok for obj=key-2 2024-05-15T14:47:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.281+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-7 state=0x56468b431048 s->prefetch_data=0 2024-05-15T14:47:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.281+0000 7f5fc9462800 10 manifest: total_size = 3011764 2024-05-15T14:47:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.281+0000 7f5fc9462800 20 get_obj_state: setting s->obj_tag to d844ce7e-fd85-4b58-a5b6-40865194449a.4586.17190930395122904635 2024-05-15T14:47:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.281+0000 7f5fc9462800 20 get_obj_state: octx=0x56468b3b5060 obj=vwwrqh-22:key-7 state=0x56468b431048 s->prefetch_data=0 2024-05-15T14:47:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.281+0000 7f5fc9462800 20 prepare_atomic_modification: state is not atomic. state=0x56468b431048 2024-05-15T14:47:54.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.281+0000 7f5fc9462800 20 bucket index object: :.dir.d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20.9 2024-05-15T14:47:54.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.282+0000 7f5eaa7fc640 20 handle_completion(): completion ok for obj=key-6 2024-05-15T14:47:54.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.284+0000 7f5fc9462800 20 list_objects_ordered: starting attempt 1 2024-05-15T14:47:54.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.284+0000 7f5fc9462800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-15T14:47:54.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.285+0000 7f5ea9ffb640 20 handle_completion(): completion ok for obj=key-7 2024-05-15T14:47:54.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.285+0000 7f5fc9462800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-15T14:47:54.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.285+0000 7f5fc9462800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-15T14:47:54.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.285+0000 7f5fc9462800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-15T14:47:54.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.285+0000 7f5fc9462800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-15T14:47:54.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.285+0000 7f5fc9462800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":vwwrqh-22[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20])"; uploads.size()=0; is_truncated=0 2024-05-15T14:47:54.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.286+0000 7f5fc9462800 1 ERROR: failed to remove topic bucket mapping for bucket: vwwrqh-22 and topic: vwwrqh-22_topic_1 with ret:-2 2024-05-15T14:47:54.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.286+0000 7f5fc9462800 1 ERROR: unable to remove notifications from bucket vwwrqh-22. ret=-2 2024-05-15T14:47:54.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.288+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.meta+root+vwwrqh-22 : miss 2024-05-15T14:47:54.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.288+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.288+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=189 2024-05-15T14:47:54.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.288+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.meta+root+vwwrqh-22 info.flags=0x11 2024-05-15T14:47:54.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.288+0000 7f5fc9462800 10 adding MyZone.rgw.meta+root+vwwrqh-22 to cache LRU end 2024-05-15T14:47:54.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.289+0000 7f5fc9462800 10 removing MyZone.rgw.meta+root+vwwrqh-22 from cache 2024-05-15T14:47:54.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.289+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 1, obj: MyZone.rgw.meta:root:vwwrqh-22, ofs0, ns] 2024-05-15T14:47:54.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.290+0000 7f5eaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724977 cookie 94860983318272 notifier 9902 bl.length()=152 2024-05-15T14:47:54.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.291+0000 7f5fc9462800 10 removing MyZone.rgw.meta+root+.bucket.meta.vwwrqh-22:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20 from cache 2024-05-15T14:47:54.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.291+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.6 cni=[op: 1, obj: MyZone.rgw.meta:root:.bucket.meta.vwwrqh-22:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20, ofs0, ns] 2024-05-15T14:47:54.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.292+0000 7f5ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724994 cookie 94860983335488 notifier 9902 bl.length()=210 2024-05-15T14:47:54.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.294+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.log++pubsub..bucket.vwwrqh-22/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20 : miss 2024-05-15T14:47:54.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.294+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.294+0000 7f5fc9462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:54.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.294+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.log++pubsub..bucket.vwwrqh-22/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20 info.flags=0x0 2024-05-15T14:47:54.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.294+0000 7f5fc9462800 10 adding MyZone.rgw.log++pubsub..bucket.vwwrqh-22/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.20 to cache LRU end 2024-05-15T14:47:54.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.296+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 : miss 2024-05-15T14:47:54.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.296+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.297+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=400 2024-05-15T14:47:54.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.297+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 info.flags=0x17 2024-05-15T14:47:54.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.297+0000 7f5fc9462800 10 adding MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 to cache LRU end 2024-05-15T14:47:54.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.297+0000 7f5fc9462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:54.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.297+0000 7f5fc9462800 10 updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:47:54.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.297+0000 7f5fc9462800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 2024-05-15T14:47:54.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.301+0000 7f5fc9462800 20 list_objects_ordered: starting attempt 1 2024-05-15T14:47:54.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.301+0000 7f5fc9462800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-15T14:47:54.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.302+0000 7f5fc9462800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-15T14:47:54.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.302+0000 7f5fc9462800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-15T14:47:54.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.302+0000 7f5fc9462800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-15T14:47:54.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.302+0000 7f5fc9462800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-15T14:47:54.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.302+0000 7f5fc9462800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":vwwrqh-3[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1])"; uploads.size()=0; is_truncated=0 2024-05-15T14:47:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.303+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.meta+root+vwwrqh-3 : miss 2024-05-15T14:47:54.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.303+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.304+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:47:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.304+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.meta+root+vwwrqh-3 info.flags=0x11 2024-05-15T14:47:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.304+0000 7f5fc9462800 10 adding MyZone.rgw.meta+root+vwwrqh-3 to cache LRU end 2024-05-15T14:47:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.305+0000 7f5fc9462800 10 removing MyZone.rgw.meta+root+vwwrqh-3 from cache 2024-05-15T14:47:54.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.305+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.5 cni=[op: 1, obj: MyZone.rgw.meta:root:vwwrqh-3, ofs0, ns] 2024-05-15T14:47:54.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.305+0000 7f5ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724995 cookie 94860983362960 notifier 9902 bl.length()=151 2024-05-15T14:47:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.307+0000 7f5fc9462800 10 removing MyZone.rgw.meta+root+.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 from cache 2024-05-15T14:47:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.307+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.2 cni=[op: 1, obj: MyZone.rgw.meta:root:.bucket.meta.vwwrqh-3:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1, ofs0, ns] 2024-05-15T14:47:54.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.307+0000 7f5eaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724572 cookie 94860983341920 notifier 9902 bl.length()=208 2024-05-15T14:47:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.310+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.log++pubsub..bucket.vwwrqh-3/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 : miss 2024-05-15T14:47:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.310+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.310+0000 7f5fc9462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.310+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.log++pubsub..bucket.vwwrqh-3/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 info.flags=0x0 2024-05-15T14:47:54.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.310+0000 7f5fc9462800 10 adding MyZone.rgw.log++pubsub..bucket.vwwrqh-3/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.1 to cache LRU end 2024-05-15T14:47:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.312+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-8:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6 : miss 2024-05-15T14:47:54.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.312+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.313+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=400 2024-05-15T14:47:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.313+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-8:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6 info.flags=0x17 2024-05-15T14:47:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.313+0000 7f5fc9462800 10 adding MyZone.rgw.meta+root+.bucket.meta.vwwrqh-8:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6 to cache LRU end 2024-05-15T14:47:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.313+0000 7f5fc9462800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T14:47:54.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.313+0000 7f5fc9462800 10 updating xattr: name=user.rgw.acl bl.length()=185 2024-05-15T14:47:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.313+0000 7f5fc9462800 10 updating xattr: name=user.rgw.bucket-notification bl.length()=365 2024-05-15T14:47:54.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.313+0000 7f5fc9462800 10 chain_cache_entry: cache_locator=MyZone.rgw.meta+root+.bucket.meta.vwwrqh-8:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6 2024-05-15T14:47:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.317+0000 7f5fc9462800 20 list_objects_ordered: starting attempt 1 2024-05-15T14:47:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.317+0000 7f5fc9462800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-15T14:47:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.317+0000 7f5fc9462800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-15T14:47:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.317+0000 7f5fc9462800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-15T14:47:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.317+0000 7f5fc9462800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-15T14:47:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.317+0000 7f5fc9462800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-15T14:47:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.317+0000 7f5fc9462800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":vwwrqh-8[d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6])"; uploads.size()=0; is_truncated=0 2024-05-15T14:47:54.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.318+0000 7f5fc9462800 1 ERROR: failed to remove topic bucket mapping for bucket: vwwrqh-8 and topic: vwwrqh-8_topic with ret:-2 2024-05-15T14:47:54.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.318+0000 7f5fc9462800 1 ERROR: unable to remove notifications from bucket vwwrqh-8. ret=-2 2024-05-15T14:47:54.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.320+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.meta+root+vwwrqh-8 : miss 2024-05-15T14:47:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.320+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.320+0000 7f5fc9462800 20 rados_obj.operate() r=0 bl.length=186 2024-05-15T14:47:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.320+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.meta+root+vwwrqh-8 info.flags=0x11 2024-05-15T14:47:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.320+0000 7f5fc9462800 10 adding MyZone.rgw.meta+root+vwwrqh-8 to cache LRU end 2024-05-15T14:47:54.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.321+0000 7f5fc9462800 10 removing MyZone.rgw.meta+root+vwwrqh-8 from cache 2024-05-15T14:47:54.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.321+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.5 cni=[op: 1, obj: MyZone.rgw.meta:root:vwwrqh-8, ofs0, ns] 2024-05-15T14:47:54.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.321+0000 7f5ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724996 cookie 94860983362960 notifier 9902 bl.length()=151 2024-05-15T14:47:54.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.323+0000 7f5fc9462800 10 removing MyZone.rgw.meta+root+.bucket.meta.vwwrqh-8:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6 from cache 2024-05-15T14:47:54.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.323+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.2 cni=[op: 1, obj: MyZone.rgw.meta:root:.bucket.meta.vwwrqh-8:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6, ofs0, ns] 2024-05-15T14:47:54.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.323+0000 7f5eaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724573 cookie 94860983341920 notifier 9902 bl.length()=208 2024-05-15T14:47:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.326+0000 7f5fc9462800 10 cache get: name=MyZone.rgw.log++pubsub..bucket.vwwrqh-8/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6 : miss 2024-05-15T14:47:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.326+0000 7f5fc9462800 20 rados->read ofs=0 len=0 2024-05-15T14:47:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.326+0000 7f5fc9462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:47:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.326+0000 7f5fc9462800 10 cache put: name=MyZone.rgw.log++pubsub..bucket.vwwrqh-8/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6 info.flags=0x0 2024-05-15T14:47:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.326+0000 7f5fc9462800 10 adding MyZone.rgw.log++pubsub..bucket.vwwrqh-8/d844ce7e-fd85-4b58-a5b6-40865194449a.4586.6 to cache LRU end 2024-05-15T14:47:54.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.328+0000 7f5fc9462800 10 removing key index: MHWQSYCRCOLJHPGBGYLV 2024-05-15T14:47:54.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.329+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.1 cni=[op: 1, obj: MyZone.rgw.meta:users.keys:MHWQSYCRCOLJHPGBGYLV, ofs0, ns] 2024-05-15T14:47:54.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.329+0000 7f5ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724550 cookie 94860983338288 notifier 9902 bl.length()=169 2024-05-15T14:47:54.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.330+0000 7f5fc9462800 10 removing email index: 2024-05-15T14:47:54.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.330+0000 7f5fc9462800 10 removing user buckets index 2024-05-15T14:47:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.331+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.1 cni=[op: 1, obj: MyZone.rgw.meta:users.uid:foo.client.0.buckets, ofs0, ns] 2024-05-15T14:47:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.331+0000 7f5eaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724551 cookie 94860983338288 notifier 9902 bl.length()=168 2024-05-15T14:47:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.332+0000 7f5fc9462800 10 removing user index: foo.client.0 2024-05-15T14:47:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.333+0000 7f5fc9462800 10 removing MyZone.rgw.meta+users.uid+foo.client.0 from cache 2024-05-15T14:47:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.333+0000 7f5fc9462800 10 distributing notification oid=MyZone.rgw.control:notify.0 cni=[op: 1, obj: MyZone.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-05-15T14:47:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.333+0000 7f5eaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724978 cookie 94860983318272 notifier 9902 bl.length()=160 2024-05-15T14:47:54.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.335+0000 7f5e7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:47:54.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.337+0000 7f5fc9462800 20 remove_watcher() i=0 2024-05-15T14:47:54.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.337+0000 7f5fc9462800 2 removed watcher, disabling cache 2024-05-15T14:47:54.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.338+0000 7f5fc9462800 20 remove_watcher() i=1 2024-05-15T14:47:54.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.339+0000 7f5fc9462800 20 remove_watcher() i=2 2024-05-15T14:47:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.340+0000 7f5fc9462800 20 remove_watcher() i=3 2024-05-15T14:47:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.341+0000 7f5fc9462800 20 remove_watcher() i=4 2024-05-15T14:47:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.341+0000 7f5fc9462800 20 remove_watcher() i=5 2024-05-15T14:47:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.343+0000 7f5fc9462800 20 remove_watcher() i=6 2024-05-15T14:47:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:47:54.344+0000 7f5fc9462800 20 remove_watcher() i=7 2024-05-15T14:47:54.357 INFO:tasks.notification_tests:Pre-processing completed... 2024-05-15T14:47:54.358 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/.aws/models/s3/2006-03-01/service-2.sdk-extras.json 2024-05-15T14:47:54.374 DEBUG:teuthology.orchestra.run.smithi018:> cd /home/ubuntu/ && rmdir -p .aws/models/s3/2006-03-01/ 2024-05-15T14:47:54.434 INFO:tasks.notification_tests:Removing bucket-notifications-tests... 2024-05-15T14:47:54.434 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/ceph 2024-05-15T14:47:54.832 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa/tasks/notification_tests.py", line 309, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa/tasks/notification_tests.py", line 45, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa/tasks/notification_tests.py", line 238, in run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (bucket notification tests against different endpoints) on smithi018 with status 1: "BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a '!kafka_test,!amqp_test,!amqp_ssl_test,!kafka_security_test,!modification_required,!manual_test'" 2024-05-15T14:47:55.094 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e5faa567103245e4b07a2ab9a5a525ae Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa/tasks/notification_tests.py", line 309, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa/tasks/notification_tests.py", line 45, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bf560a26040628fcc6ec3e608f9c4451acdef5e2/qa/tasks/notification_tests.py", line 238, in run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (bucket notification tests against different endpoints) on smithi018 with status 1: "BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a '!kafka_test,!amqp_test,!amqp_ssl_test,!kafka_security_test,!modification_required,!manual_test'" 2024-05-15T14:47:55.097 DEBUG:teuthology.run_tasks:Unwinding manager notification-tests 2024-05-15T14:47:55.107 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-15T14:47:55.115 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-15T14:47:55.115 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:47:55.119 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:55.114+0000 7fe33adc7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45182) UID: 0 2024-05-15T14:47:55.120 INFO:tasks.rgw.client.0.smithi018.stdout:2024-05-15T14:47:55.114+0000 7fe33e620880 -1 shutting down 2024-05-15T14:48:25.623 INFO:tasks.rgw.client.0:Stopped 2024-05-15T14:48:25.624 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-15T14:48:25.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/vault-root-token 2024-05-15T14:48:25.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-15T14:48:25.787 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-15T14:48:25.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-15T14:48:25.788 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-15T14:48:25.877 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:48:25.877 INFO:teuthology.orchestra.run.smithi018.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:48:25.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.916+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.918+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:48:25.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.918+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.919+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:48:25.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.919+0000 7f389453f800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:48:25.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.919+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.919+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:48:25.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.919+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.920+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:48:25.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.920+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.920+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:48:25.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.920+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.921+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:48:25.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.921+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.921+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:48:25.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.921+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.922+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:48:25.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.922+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:48:25.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 20 zone MyZone found 2024-05-15T14:48:25.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:48:25.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:48:25.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:48:25.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:48:25.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 20 period zonegroup name MyZoneGroup 2024-05-15T14:48:25.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:48:25.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.923+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.924+0000 7f389453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:48:25.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.924+0000 7f389453f800 20 rados->read ofs=0 len=0 2024-05-15T14:48:25.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.924+0000 7f389453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:48:25.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.924+0000 7f389453f800 20 started sync module instance, tier type = 2024-05-15T14:48:25.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.924+0000 7f389453f800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:48:25.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.934+0000 7f389453f800 20 add_watcher() i=0 2024-05-15T14:48:25.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.934+0000 7f389453f800 20 add_watcher() i=1 2024-05-15T14:48:25.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.934+0000 7f389453f800 20 add_watcher() i=2 2024-05-15T14:48:25.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.934+0000 7f389453f800 20 add_watcher() i=3 2024-05-15T14:48:25.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.934+0000 7f389453f800 20 add_watcher() i=4 2024-05-15T14:48:25.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.934+0000 7f389453f800 20 add_watcher() i=5 2024-05-15T14:48:25.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.934+0000 7f389453f800 20 add_watcher() i=6 2024-05-15T14:48:25.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.935+0000 7f389453f800 20 add_watcher() i=7 2024-05-15T14:48:25.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.935+0000 7f389453f800 2 all 8 watchers are set, enabling cache 2024-05-15T14:48:25.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.937+0000 7f3746fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:48:25.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.937+0000 7f389453f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:48:25.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.937+0000 7f389453f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:48:25.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.973+0000 7f3745fdb640 20 reqs_thread_entry: start 2024-05-15T14:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.973+0000 7f389453f800 20 init_complete bucket index max shards: 11 2024-05-15T14:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.973+0000 7f389453f800 20 Filter name: none 2024-05-15T14:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.973+0000 7f36b77fe640 20 reqs_thread_entry: start 2024-05-15T14:48:25.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.973+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-15T14:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.974+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.975+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:25.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.975+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.976+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-15T14:48:25.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.978+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.978+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:25.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.979+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.980+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-15T14:48:25.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.981+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.981+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:25.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.982+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.983+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-15T14:48:25.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.984+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.985+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:25.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.985+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.986+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-15T14:48:25.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.987+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.988+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:25.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.988+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.990+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-15T14:48:25.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.991+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.992+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:25.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.992+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.993+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-15T14:48:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.994+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.995+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.995+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.996+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-15T14:48:25.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.998+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.998+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:25.999+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.000+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-15T14:48:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.001+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.002+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.002+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.003+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-15T14:48:26.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.005+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.005+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.005+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.006+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-15T14:48:26.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.008+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.008+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.009+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.009+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-15T14:48:26.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.011+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.011+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.011+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.012+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-15T14:48:26.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.014+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.014+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.014+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.015+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-15T14:48:26.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.017+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.017+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.017+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.018+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-15T14:48:26.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.020+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.020+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-15T14:48:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 20 garbage collection: RGWGC::process iterating over entry tag='d844ce7e-fd85-4b58-a5b6-40865194449a.4586.12293398816305842645', time=2024-05-15T16:31:49.539746+0000, chain.objs.size()=14 2024-05-15T14:48:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_1 2024-05-15T14:48:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_2 2024-05-15T14:48:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_3 2024-05-15T14:48:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_4 2024-05-15T14:48:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_5 2024-05-15T14:48:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_6 2024-05-15T14:48:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_7 2024-05-15T14:48:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_8 2024-05-15T14:48:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_9 2024-05-15T14:48:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_10 2024-05-15T14:48:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_11 2024-05-15T14:48:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.021+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_12 2024-05-15T14:48:26.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.024+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_13 2024-05-15T14:48:26.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.025+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.11__shadow_.12eWTBsQPNgmXy_jTzud-yBvtRr73ub_14 2024-05-15T14:48:26.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.027+0000 7f389453f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-15T14:48:26.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.030+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-15T14:48:26.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.032+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.032+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.032+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.033+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-15T14:48:26.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.035+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.035+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.035+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.036+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-15T14:48:26.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.038+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.038+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.038+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.039+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-15T14:48:26.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.040+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.041+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.041+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.042+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-15T14:48:26.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.044+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.044+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.044+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.045+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-15T14:48:26.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.047+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.047+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.047+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.048+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-15T14:48:26.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.050+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.050+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.050+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.051+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-15T14:48:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.052+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.053+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.053+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.054+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-15T14:48:26.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.056+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.056+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.056+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.057+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-15T14:48:26.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.058+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.059+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.059+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.060+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-15T14:48:26.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.062+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.062+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.063+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.064+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-15T14:48:26.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.065+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.065+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.066+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.067+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-15T14:48:26.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.068+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.068+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.069+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.069+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-15T14:48:26.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.071+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.071+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.071+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.072+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-15T14:48:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.074+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.074+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.075+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-15T14:48:26.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.075+0000 7f389453f800 20 garbage collection: RGWGC::process iterating over entry tag='2~yuSj4ZUX7ltpPwic3Z8qRUixSOMJhM-', time=2024-05-15T16:31:43.483862+0000, chain.objs.size()=1 2024-05-15T14:48:26.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.075+0000 7f389453f800 5 garbage collection: RGWGC::process removing MyZone.rgw.buckets.data:d844ce7e-fd85-4b58-a5b6-40865194449a.4586.10__multipart_ooo1.2~yuSj4ZUX7ltpPwic3Z8qRUixSOMJhM-.1 2024-05-15T14:48:26.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.076+0000 7f389453f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-15T14:48:26.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.078+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-15T14:48:26.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.079+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.079+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.080+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.080+0000 7f389453f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-15T14:48:26.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.082+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.082+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:26.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.083+0000 7f389453f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:26.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.085+0000 7f3746fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:48:26.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.087+0000 7f389453f800 20 remove_watcher() i=0 2024-05-15T14:48:26.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.087+0000 7f389453f800 2 removed watcher, disabling cache 2024-05-15T14:48:26.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.088+0000 7f389453f800 20 remove_watcher() i=1 2024-05-15T14:48:26.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.088+0000 7f389453f800 20 remove_watcher() i=2 2024-05-15T14:48:26.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.089+0000 7f389453f800 20 remove_watcher() i=3 2024-05-15T14:48:26.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.090+0000 7f389453f800 20 remove_watcher() i=4 2024-05-15T14:48:26.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.091+0000 7f389453f800 20 remove_watcher() i=5 2024-05-15T14:48:26.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.092+0000 7f389453f800 20 remove_watcher() i=6 2024-05-15T14:48:26.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-05-15T14:48:26.093+0000 7f389453f800 20 remove_watcher() i=7 2024-05-15T14:48:26.106 DEBUG:tasks.rgw.client.1:waiting for process to exit 2024-05-15T14:48:26.107 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:48:26.107 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:48:26.106+0000 7f38ef75c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.1 --cluster ceph -k /etc/ceph/ceph.client.1.keyring --log-file /var/log/ceph/rgw.ceph.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.1.sock --foreground (PID: 41630) UID: 0 2024-05-15T14:48:26.108 INFO:tasks.rgw.client.1.smithi070.stdout:2024-05-15T14:48:26.106+0000 7f38f4f20880 -1 shutting down 2024-05-15T14:48:54.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.1 is failed for ~0s 2024-05-15T14:48:56.616 INFO:tasks.rgw.client.1:Stopped 2024-05-15T14:48:56.616 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.1.sock 2024-05-15T14:48:56.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/vault-root-token 2024-05-15T14:48:56.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-15T14:48:56.771 INFO:tasks.util.rgw:rgwadmin: client.1 : ['gc', 'process', '--include-all'] 2024-05-15T14:48:56.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-15T14:48:56.772 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster ceph gc process --include-all 2024-05-15T14:48:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-05-15T14:48:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T14:48:56.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.895+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.896+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:48:56.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.896+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.897+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:48:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.897+0000 7f1e59551800 20 realm MyRealm c960760b-b2d7-439f-9323-6ff955b035b5 2024-05-15T14:48:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.897+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.897+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:48:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.897+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.898+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=10 2024-05-15T14:48:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.898+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.899+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=1126 2024-05-15T14:48:56.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.899+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.899+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:48:56.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.899+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.900+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=107 2024-05-15T14:48:56.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.900+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T14:48:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 20 rados_obj.operate() r=0 bl.length=1135 2024-05-15T14:48:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 20 zone MyZone found 2024-05-15T14:48:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 4 Realm: MyRealm (c960760b-b2d7-439f-9323-6ff955b035b5) 2024-05-15T14:48:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 4 ZoneGroup: MyZoneGroup (88d155fc-d3b1-427c-898a-ccb610f9ade3) 2024-05-15T14:48:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 4 Zone: MyZone (d844ce7e-fd85-4b58-a5b6-40865194449a) 2024-05-15T14:48:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 4 using period configuration: 450b0ad8-e873-4e0c-9309-d9dacbb20322:10 2024-05-15T14:48:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 20 period zonegroup name MyZoneGroup 2024-05-15T14:48:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 20 using current period zonegroup MyZoneGroup 2024-05-15T14:48:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.901+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.902+0000 7f1e59551800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:48:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.902+0000 7f1e59551800 20 rados->read ofs=0 len=0 2024-05-15T14:48:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.902+0000 7f1e59551800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T14:48:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.902+0000 7f1e59551800 20 started sync module instance, tier type = 2024-05-15T14:48:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.902+0000 7f1e59551800 20 started zone id=d844ce7e-fd85-4b58-a5b6-40865194449a (name=MyZone) with tier type = 2024-05-15T14:48:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.912+0000 7f1e59551800 20 add_watcher() i=0 2024-05-15T14:48:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.912+0000 7f1e59551800 20 add_watcher() i=1 2024-05-15T14:48:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.912+0000 7f1e59551800 20 add_watcher() i=2 2024-05-15T14:48:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.912+0000 7f1e59551800 20 add_watcher() i=3 2024-05-15T14:48:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.912+0000 7f1e59551800 20 add_watcher() i=4 2024-05-15T14:48:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.912+0000 7f1e59551800 20 add_watcher() i=5 2024-05-15T14:48:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.912+0000 7f1e59551800 20 add_watcher() i=6 2024-05-15T14:48:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.913+0000 7f1e59551800 20 add_watcher() i=7 2024-05-15T14:48:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.913+0000 7f1e59551800 2 all 8 watchers are set, enabling cache 2024-05-15T14:48:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.915+0000 7f1d0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:48:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.915+0000 7f1e59551800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T14:48:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.915+0000 7f1e59551800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T14:48:56.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.950+0000 7f1d0cfe1640 20 reqs_thread_entry: start 2024-05-15T14:48:56.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.950+0000 7f1e59551800 20 init_complete bucket index max shards: 11 2024-05-15T14:48:56.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.950+0000 7f1e59551800 20 Filter name: none 2024-05-15T14:48:56.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.951+0000 7f1c867fc640 20 reqs_thread_entry: start 2024-05-15T14:48:56.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.951+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-15T14:48:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.952+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.953+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.953+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.955+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-15T14:48:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.956+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.957+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.957+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.958+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-15T14:48:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.959+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.960+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.960+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.961+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-15T14:48:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.962+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.963+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.963+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.964+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-15T14:48:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.965+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.966+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.966+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.967+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-15T14:48:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.969+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.969+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.969+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.970+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-15T14:48:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.972+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.972+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.972+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.973+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-15T14:48:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.975+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.975+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.975+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.976+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-15T14:48:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.978+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.978+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.978+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.979+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-15T14:48:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.981+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.981+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.981+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.982+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-15T14:48:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.983+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.984+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.984+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.985+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-15T14:48:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.987+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.987+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.987+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.988+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-15T14:48:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.990+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.990+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.990+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.991+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-15T14:48:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.993+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.993+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.994+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.995+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-15T14:48:56.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.997+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.997+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:56.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.997+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.998+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-15T14:48:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:56.999+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.000+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.000+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.001+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-15T14:48:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.002+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.003+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.003+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.004+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-15T14:48:57.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.005+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.005+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.006+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.007+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-15T14:48:57.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.008+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.009+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.009+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.010+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-15T14:48:57.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.011+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.012+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.012+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.013+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-15T14:48:57.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.014+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.014+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.014+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.015+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-15T14:48:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.017+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.017+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.017+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.018+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-15T14:48:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.020+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.020+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.021+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.022+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-15T14:48:57.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.023+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.023+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.024+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.025+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-15T14:48:57.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.026+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.027+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.027+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.028+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-15T14:48:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.030+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.030+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.030+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.031+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-15T14:48:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.033+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.033+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.033+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.034+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-15T14:48:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.036+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.036+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.036+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.037+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-15T14:48:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.039+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.040+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.040+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.041+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-15T14:48:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.042+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.043+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.043+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.044+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-15T14:48:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.045+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.046+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.046+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.047+0000 7f1e59551800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-15T14:48:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.048+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.049+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T14:48:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.049+0000 7f1e59551800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T14:48:57.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.051+0000 7f1d0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T14:48:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.053+0000 7f1e59551800 20 remove_watcher() i=0 2024-05-15T14:48:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.053+0000 7f1e59551800 2 removed watcher, disabling cache 2024-05-15T14:48:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.054+0000 7f1e59551800 20 remove_watcher() i=1 2024-05-15T14:48:57.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.055+0000 7f1e59551800 20 remove_watcher() i=2 2024-05-15T14:48:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.056+0000 7f1e59551800 20 remove_watcher() i=3 2024-05-15T14:48:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.057+0000 7f1e59551800 20 remove_watcher() i=4 2024-05-15T14:48:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.058+0000 7f1e59551800 20 remove_watcher() i=5 2024-05-15T14:48:57.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.059+0000 7f1e59551800 20 remove_watcher() i=6 2024-05-15T14:48:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-15T14:48:57.060+0000 7f1e59551800 20 remove_watcher() i=7 2024-05-15T14:48:57.072 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-05-15T14:48:57.083 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-15T14:48:57.121 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T14:48:57.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:48:57.452 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:48:57.460 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:48:57.463 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":669,"stamp":"2024-05-15T14:48:56.769703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620444,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":2181945,"num_read_kb":7080143,"num_write":21230,"num_write_kb":1254163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6230,"ondisk_log_size":6230,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275416,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699304,"statfs":{"total":773094113280,"available":772812087296,"internally_reserved":0,"allocated":5316608,"data_stored":2974704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003758"},"pg_stats":[{"pgid":"3.3f","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.520606+0000","last_change":"2024-05-15T14:27:50.850244+0000","last_active":"2024-05-15T14:46:37.520606+0000","last_peered":"2024-05-15T14:46:37.520606+0000","last_clean":"2024-05-15T14:46:37.520606+0000","last_became_active":"2024-05-15T14:27:50.849951+0000","last_became_peered":"2024-05-15T14:27:50.849951+0000","last_unstale":"2024-05-15T14:46:37.520606+0000","last_undegraded":"2024-05-15T14:46:37.520606+0000","last_fullsized":"2024-05-15T14:46:37.520606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'2","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.860511+0000","last_change":"2024-05-15T14:27:52.844115+0000","last_active":"2024-05-15T14:47:53.860511+0000","last_peered":"2024-05-15T14:47:53.860511+0000","last_clean":"2024-05-15T14:47:53.860511+0000","last_became_active":"2024-05-15T14:27:52.843836+0000","last_became_peered":"2024-05-15T14:27:52.843836+0000","last_unstale":"2024-05-15T14:47:53.860511+0000","last_undegraded":"2024-05-15T14:47:53.860511+0000","last_fullsized":"2024-05-15T14:47:53.860511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421276+0000","last_change":"2024-05-15T14:27:50.837638+0000","last_active":"2024-05-15T14:46:37.421276+0000","last_peered":"2024-05-15T14:46:37.421276+0000","last_clean":"2024-05-15T14:46:37.421276+0000","last_became_active":"2024-05-15T14:27:50.837321+0000","last_became_peered":"2024-05-15T14:27:50.837321+0000","last_unstale":"2024-05-15T14:46:37.421276+0000","last_undegraded":"2024-05-15T14:46:37.421276+0000","last_fullsized":"2024-05-15T14:46:37.421276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":50,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"39'10","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304257+0000","last_change":"2024-05-15T14:27:52.841298+0000","last_active":"2024-05-15T14:47:54.304257+0000","last_peered":"2024-05-15T14:47:54.304257+0000","last_clean":"2024-05-15T14:47:54.304257+0000","last_became_active":"2024-05-15T14:27:52.840977+0000","last_became_peered":"2024-05-15T14:27:52.840977+0000","last_unstale":"2024-05-15T14:47:54.304257+0000","last_undegraded":"2024-05-15T14:47:54.304257+0000","last_fullsized":"2024-05-15T14:47:54.304257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"39'8","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422141+0000","last_change":"2024-05-15T14:27:50.846251+0000","last_active":"2024-05-15T14:46:37.422141+0000","last_peered":"2024-05-15T14:46:37.422141+0000","last_clean":"2024-05-15T14:46:37.422141+0000","last_became_active":"2024-05-15T14:27:50.844989+0000","last_became_peered":"2024-05-15T14:27:50.844989+0000","last_unstale":"2024-05-15T14:46:37.422141+0000","last_undegraded":"2024-05-15T14:46:37.422141+0000","last_fullsized":"2024-05-15T14:46:37.422141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'24","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.833658+0000","last_change":"2024-05-15T14:27:52.850744+0000","last_active":"2024-05-15T14:47:53.833658+0000","last_peered":"2024-05-15T14:47:53.833658+0000","last_clean":"2024-05-15T14:47:53.833658+0000","last_became_active":"2024-05-15T14:27:52.850449+0000","last_became_peered":"2024-05-15T14:27:52.850449+0000","last_unstale":"2024-05-15T14:47:53.833658+0000","last_undegraded":"2024-05-15T14:47:53.833658+0000","last_fullsized":"2024-05-15T14:47:53.833658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":101,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"39'22","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.426566+0000","last_change":"2024-05-15T14:27:50.852104+0000","last_active":"2024-05-15T14:47:57.426566+0000","last_peered":"2024-05-15T14:47:57.426566+0000","last_clean":"2024-05-15T14:47:57.426566+0000","last_became_active":"2024-05-15T14:27:50.851846+0000","last_became_peered":"2024-05-15T14:27:50.851846+0000","last_unstale":"2024-05-15T14:47:57.426566+0000","last_undegraded":"2024-05-15T14:47:57.426566+0000","last_fullsized":"2024-05-15T14:47:57.426566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":27630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"39'4","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.806419+0000","last_change":"2024-05-15T14:27:52.854744+0000","last_active":"2024-05-15T14:47:53.806419+0000","last_peered":"2024-05-15T14:47:53.806419+0000","last_clean":"2024-05-15T14:47:53.806419+0000","last_became_active":"2024-05-15T14:27:52.854481+0000","last_became_peered":"2024-05-15T14:27:52.854481+0000","last_unstale":"2024-05-15T14:47:53.806419+0000","last_undegraded":"2024-05-15T14:47:53.806419+0000","last_fullsized":"2024-05-15T14:47:53.806419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"39'8","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.510681+0000","last_change":"2024-05-15T14:27:50.853255+0000","last_active":"2024-05-15T14:45:22.510681+0000","last_peered":"2024-05-15T14:45:22.510681+0000","last_clean":"2024-05-15T14:45:22.510681+0000","last_became_active":"2024-05-15T14:27:50.851756+0000","last_became_peered":"2024-05-15T14:27:50.851756+0000","last_unstale":"2024-05-15T14:45:22.510681+0000","last_undegraded":"2024-05-15T14:45:22.510681+0000","last_fullsized":"2024-05-15T14:45:22.510681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:50.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14,"num_write":40,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"39'8","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.411312+0000","last_change":"2024-05-15T14:27:52.845713+0000","last_active":"2024-05-15T14:45:57.411312+0000","last_peered":"2024-05-15T14:45:57.411312+0000","last_clean":"2024-05-15T14:45:57.411312+0000","last_became_active":"2024-05-15T14:27:52.844904+0000","last_became_peered":"2024-05-15T14:27:52.844904+0000","last_unstale":"2024-05-15T14:45:57.411312+0000","last_undegraded":"2024-05-15T14:45:57.411312+0000","last_fullsized":"2024-05-15T14:45:57.411312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:52.927880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"39'8","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026317+0000","last_change":"2024-05-15T14:27:50.847389+0000","last_active":"2024-05-15T14:48:26.026317+0000","last_peered":"2024-05-15T14:48:26.026317+0000","last_clean":"2024-05-15T14:48:26.026317+0000","last_became_active":"2024-05-15T14:27:50.847121+0000","last_became_peered":"2024-05-15T14:27:50.847121+0000","last_unstale":"2024-05-15T14:48:26.026317+0000","last_undegraded":"2024-05-15T14:48:26.026317+0000","last_fullsized":"2024-05-15T14:48:26.026317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:48.618636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":24,"num_write_kb":14074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'100","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327789+0000","last_change":"2024-05-15T14:27:52.848754+0000","last_active":"2024-05-15T14:47:54.327789+0000","last_peered":"2024-05-15T14:47:54.327789+0000","last_clean":"2024-05-15T14:47:54.327789+0000","last_became_active":"2024-05-15T14:27:52.848482+0000","last_became_peered":"2024-05-15T14:27:52.848482+0000","last_unstale":"2024-05-15T14:47:54.327789+0000","last_undegraded":"2024-05-15T14:47:54.327789+0000","last_fullsized":"2024-05-15T14:47:54.327789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":302,"num_write":142,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"39'10","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.510650+0000","last_change":"2024-05-15T14:27:50.852930+0000","last_active":"2024-05-15T14:45:22.510650+0000","last_peered":"2024-05-15T14:45:22.510650+0000","last_clean":"2024-05-15T14:45:22.510650+0000","last_became_active":"2024-05-15T14:27:50.852659+0000","last_became_peered":"2024-05-15T14:27:50.852659+0000","last_unstale":"2024-05-15T14:45:22.510650+0000","last_undegraded":"2024-05-15T14:45:22.510650+0000","last_fullsized":"2024-05-15T14:45:22.510650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840691+0000","last_change":"2024-05-15T14:27:52.839571+0000","last_active":"2024-05-15T14:47:53.840691+0000","last_peered":"2024-05-15T14:47:53.840691+0000","last_clean":"2024-05-15T14:47:53.840691+0000","last_became_active":"2024-05-15T14:27:52.839017+0000","last_became_peered":"2024-05-15T14:27:52.839017+0000","last_unstale":"2024-05-15T14:47:53.840691+0000","last_undegraded":"2024-05-15T14:47:53.840691+0000","last_fullsized":"2024-05-15T14:47:53.840691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.277374+0000","last_change":"2024-05-15T14:27:50.854894+0000","last_active":"2024-05-15T14:47:54.277374+0000","last_peered":"2024-05-15T14:47:54.277374+0000","last_clean":"2024-05-15T14:47:54.277374+0000","last_became_active":"2024-05-15T14:27:50.854408+0000","last_became_peered":"2024-05-15T14:27:50.854408+0000","last_unstale":"2024-05-15T14:47:54.277374+0000","last_undegraded":"2024-05-15T14:47:54.277374+0000","last_fullsized":"2024-05-15T14:47:54.277374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25,"num_write":70,"num_write_kb":17643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509693+0000","last_change":"2024-05-15T14:27:52.853989+0000","last_active":"2024-05-15T14:46:37.509693+0000","last_peered":"2024-05-15T14:46:37.509693+0000","last_clean":"2024-05-15T14:46:37.509693+0000","last_became_active":"2024-05-15T14:27:52.853688+0000","last_became_peered":"2024-05-15T14:27:52.853688+0000","last_unstale":"2024-05-15T14:46:37.509693+0000","last_undegraded":"2024-05-15T14:46:37.509693+0000","last_fullsized":"2024-05-15T14:46:37.509693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:01.973008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"39'4","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416117+0000","last_change":"2024-05-15T14:27:52.850830+0000","last_active":"2024-05-15T14:46:32.416117+0000","last_peered":"2024-05-15T14:46:32.416117+0000","last_clean":"2024-05-15T14:46:32.416117+0000","last_became_active":"2024-05-15T14:27:52.850532+0000","last_became_peered":"2024-05-15T14:27:52.850532+0000","last_unstale":"2024-05-15T14:46:32.416117+0000","last_undegraded":"2024-05-15T14:46:32.416117+0000","last_fullsized":"2024-05-15T14:46:32.416117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:35.585753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.267909+0000","last_change":"2024-05-15T14:27:50.852471+0000","last_active":"2024-05-15T14:47:54.267909+0000","last_peered":"2024-05-15T14:47:54.267909+0000","last_clean":"2024-05-15T14:47:54.267909+0000","last_became_active":"2024-05-15T14:27:50.852229+0000","last_became_peered":"2024-05-15T14:27:50.852229+0000","last_unstale":"2024-05-15T14:47:54.267909+0000","last_undegraded":"2024-05-15T14:47:54.267909+0000","last_fullsized":"2024-05-15T14:47:54.267909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:31.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"39'34","reported_seq":129,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.865681+0000","last_change":"2024-05-15T14:27:52.858540+0000","last_active":"2024-05-15T14:47:53.865681+0000","last_peered":"2024-05-15T14:47:53.865681+0000","last_clean":"2024-05-15T14:47:53.865681+0000","last_became_active":"2024-05-15T14:27:52.858331+0000","last_became_peered":"2024-05-15T14:27:52.858331+0000","last_unstale":"2024-05-15T14:47:53.865681+0000","last_undegraded":"2024-05-15T14:47:53.865681+0000","last_fullsized":"2024-05-15T14:47:53.865681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":123,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403413+0000","last_change":"2024-05-15T14:27:50.849840+0000","last_active":"2024-05-15T14:44:47.403413+0000","last_peered":"2024-05-15T14:44:47.403413+0000","last_clean":"2024-05-15T14:44:47.403413+0000","last_became_active":"2024-05-15T14:27:50.849526+0000","last_became_peered":"2024-05-15T14:27:50.849526+0000","last_unstale":"2024-05-15T14:44:47.403413+0000","last_undegraded":"2024-05-15T14:44:47.403413+0000","last_fullsized":"2024-05-15T14:44:47.403413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"39'6","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.859181+0000","last_change":"2024-05-15T14:27:52.840106+0000","last_active":"2024-05-15T14:47:53.859181+0000","last_peered":"2024-05-15T14:47:53.859181+0000","last_clean":"2024-05-15T14:47:53.859181+0000","last_became_active":"2024-05-15T14:27:52.838137+0000","last_became_peered":"2024-05-15T14:27:52.838137+0000","last_unstale":"2024-05-15T14:47:53.859181+0000","last_undegraded":"2024-05-15T14:47:53.859181+0000","last_fullsized":"2024-05-15T14:47:53.859181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403404+0000","last_change":"2024-05-15T14:27:50.842514+0000","last_active":"2024-05-15T14:44:47.403404+0000","last_peered":"2024-05-15T14:44:47.403404+0000","last_clean":"2024-05-15T14:44:47.403404+0000","last_became_active":"2024-05-15T14:27:50.842240+0000","last_became_peered":"2024-05-15T14:27:50.842240+0000","last_unstale":"2024-05-15T14:44:47.403404+0000","last_undegraded":"2024-05-15T14:44:47.403404+0000","last_fullsized":"2024-05-15T14:44:47.403404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:45:32.046811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":70,"num_write_kb":11769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"39'44","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.497397+0000","last_change":"2024-05-15T14:27:52.855297+0000","last_active":"2024-05-15T14:44:47.497397+0000","last_peered":"2024-05-15T14:44:47.497397+0000","last_clean":"2024-05-15T14:44:47.497397+0000","last_became_active":"2024-05-15T14:27:52.854742+0000","last_became_peered":"2024-05-15T14:27:52.854742+0000","last_unstale":"2024-05-15T14:44:47.497397+0000","last_undegraded":"2024-05-15T14:44:47.497397+0000","last_fullsized":"2024-05-15T14:44:47.497397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:51:10.843632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":128,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404810+0000","last_change":"2024-05-15T14:27:50.840673+0000","last_active":"2024-05-15T14:44:47.404810+0000","last_peered":"2024-05-15T14:44:47.404810+0000","last_clean":"2024-05-15T14:44:47.404810+0000","last_became_active":"2024-05-15T14:27:50.840405+0000","last_became_peered":"2024-05-15T14:27:50.840405+0000","last_unstale":"2024-05-15T14:44:47.404810+0000","last_undegraded":"2024-05-15T14:44:47.404810+0000","last_fullsized":"2024-05-15T14:44:47.404810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'52","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304178+0000","last_change":"2024-05-15T14:27:52.851060+0000","last_active":"2024-05-15T14:47:54.304178+0000","last_peered":"2024-05-15T14:47:54.304178+0000","last_clean":"2024-05-15T14:47:54.304178+0000","last_became_active":"2024-05-15T14:27:52.850696+0000","last_became_peered":"2024-05-15T14:27:52.850696+0000","last_unstale":"2024-05-15T14:47:54.304178+0000","last_undegraded":"2024-05-15T14:47:54.304178+0000","last_fullsized":"2024-05-15T14:47:54.304178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:06.868623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":72,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.262053+0000","last_change":"2024-05-15T14:27:50.849634+0000","last_active":"2024-05-15T14:47:54.262053+0000","last_peered":"2024-05-15T14:47:54.262053+0000","last_clean":"2024-05-15T14:47:54.262053+0000","last_became_active":"2024-05-15T14:27:50.848542+0000","last_became_peered":"2024-05-15T14:27:50.848542+0000","last_unstale":"2024-05-15T14:47:54.262053+0000","last_undegraded":"2024-05-15T14:47:54.262053+0000","last_fullsized":"2024-05-15T14:47:54.262053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:09.157377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":70,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"39'28","reported_seq":116,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404838+0000","last_change":"2024-05-15T14:27:52.861455+0000","last_active":"2024-05-15T14:44:47.404838+0000","last_peered":"2024-05-15T14:44:47.404838+0000","last_clean":"2024-05-15T14:44:47.404838+0000","last_became_active":"2024-05-15T14:27:52.861166+0000","last_became_peered":"2024-05-15T14:27:52.861166+0000","last_unstale":"2024-05-15T14:44:47.404838+0000","last_undegraded":"2024-05-15T14:44:47.404838+0000","last_fullsized":"2024-05-15T14:44:47.404838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":102,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.406163+0000","last_change":"2024-05-15T14:27:50.837948+0000","last_active":"2024-05-15T14:44:17.406163+0000","last_peered":"2024-05-15T14:44:17.406163+0000","last_clean":"2024-05-15T14:44:17.406163+0000","last_became_active":"2024-05-15T14:27:50.837594+0000","last_became_peered":"2024-05-15T14:27:50.837594+0000","last_unstale":"2024-05-15T14:44:17.406163+0000","last_undegraded":"2024-05-15T14:44:17.406163+0000","last_fullsized":"2024-05-15T14:44:17.406163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.517789+0000","last_change":"2024-05-15T14:31:16.589931+0000","last_active":"2024-05-15T14:45:47.517789+0000","last_peered":"2024-05-15T14:45:47.517789+0000","last_clean":"2024-05-15T14:45:47.517789+0000","last_became_active":"2024-05-15T14:31:16.589649+0000","last_became_peered":"2024-05-15T14:31:16.589649+0000","last_unstale":"2024-05-15T14:45:47.517789+0000","last_undegraded":"2024-05-15T14:45:47.517789+0000","last_fullsized":"2024-05-15T14:45:47.517789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:29:34.232384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"39'24","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.830825+0000","last_change":"2024-05-15T14:28:02.891667+0000","last_active":"2024-05-15T14:47:53.830825+0000","last_peered":"2024-05-15T14:47:53.830825+0000","last_clean":"2024-05-15T14:47:53.830825+0000","last_became_active":"2024-05-15T14:28:02.891340+0000","last_became_peered":"2024-05-15T14:28:02.891340+0000","last_unstale":"2024-05-15T14:47:53.830825+0000","last_undegraded":"2024-05-15T14:47:53.830825+0000","last_fullsized":"2024-05-15T14:47:53.830825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:35.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":38,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"39'78","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328201+0000","last_change":"2024-05-15T14:27:52.863225+0000","last_active":"2024-05-15T14:47:54.328201+0000","last_peered":"2024-05-15T14:47:54.328201+0000","last_clean":"2024-05-15T14:47:54.328201+0000","last_became_active":"2024-05-15T14:27:52.862960+0000","last_became_peered":"2024-05-15T14:27:52.862960+0000","last_unstale":"2024-05-15T14:47:54.328201+0000","last_undegraded":"2024-05-15T14:47:54.328201+0000","last_fullsized":"2024-05-15T14:47:54.328201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":231,"num_write":112,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519858+0000","last_change":"2024-05-15T14:27:50.849295+0000","last_active":"2024-05-15T14:46:32.519858+0000","last_peered":"2024-05-15T14:46:32.519858+0000","last_clean":"2024-05-15T14:46:32.519858+0000","last_became_active":"2024-05-15T14:27:50.849039+0000","last_became_peered":"2024-05-15T14:27:50.849039+0000","last_unstale":"2024-05-15T14:46:32.519858+0000","last_undegraded":"2024-05-15T14:46:32.519858+0000","last_fullsized":"2024-05-15T14:46:32.519858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:14.556752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.403978+0000","last_change":"2024-05-15T14:27:56.876839+0000","last_active":"2024-05-15T14:44:52.403978+0000","last_peered":"2024-05-15T14:44:52.403978+0000","last_clean":"2024-05-15T14:44:52.403978+0000","last_became_active":"2024-05-15T14:27:56.876559+0000","last_became_peered":"2024-05-15T14:27:56.876559+0000","last_unstale":"2024-05-15T14:44:52.403978+0000","last_undegraded":"2024-05-15T14:44:52.403978+0000","last_fullsized":"2024-05-15T14:44:52.403978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"39'264","reported_seq":538,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.030050+0000","last_change":"2024-05-15T14:27:58.884292+0000","last_active":"2024-05-15T14:48:26.030050+0000","last_peered":"2024-05-15T14:48:26.030050+0000","last_clean":"2024-05-15T14:48:26.030050+0000","last_became_active":"2024-05-15T14:27:58.883983+0000","last_became_peered":"2024-05-15T14:27:58.883983+0000","last_unstale":"2024-05-15T14:48:26.030050+0000","last_undegraded":"2024-05-15T14:48:26.030050+0000","last_fullsized":"2024-05-15T14:48:26.030050+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:56.197135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":452,"num_read_kb":554,"num_write":242,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.507472+0000","last_change":"2024-05-15T14:28:00.888232+0000","last_active":"2024-05-15T14:44:57.507472+0000","last_peered":"2024-05-15T14:44:57.507472+0000","last_clean":"2024-05-15T14:44:57.507472+0000","last_became_active":"2024-05-15T14:28:00.887947+0000","last_became_peered":"2024-05-15T14:28:00.887947+0000","last_unstale":"2024-05-15T14:44:57.507472+0000","last_undegraded":"2024-05-15T14:44:57.507472+0000","last_fullsized":"2024-05-15T14:44:57.507472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:52.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.410185+0000","last_change":"2024-05-15T14:31:16.588732+0000","last_active":"2024-05-15T14:45:47.410185+0000","last_peered":"2024-05-15T14:45:47.410185+0000","last_clean":"2024-05-15T14:45:47.410185+0000","last_became_active":"2024-05-15T14:31:16.588437+0000","last_became_peered":"2024-05-15T14:31:16.588437+0000","last_unstale":"2024-05-15T14:45:47.410185+0000","last_undegraded":"2024-05-15T14:45:47.410185+0000","last_fullsized":"2024-05-15T14:45:47.410185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:07:39.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"39'109","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.330362+0000","last_change":"2024-05-15T14:28:02.890784+0000","last_active":"2024-05-15T14:47:54.330362+0000","last_peered":"2024-05-15T14:47:54.330362+0000","last_clean":"2024-05-15T14:47:54.330362+0000","last_became_active":"2024-05-15T14:28:02.890477+0000","last_became_peered":"2024-05-15T14:28:02.890477+0000","last_unstale":"2024-05-15T14:47:54.330362+0000","last_undegraded":"2024-05-15T14:47:54.330362+0000","last_fullsized":"2024-05-15T14:47:54.330362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:18.439604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":241,"num_write":191,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"39'4","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.833264+0000","last_change":"2024-05-15T14:27:52.841464+0000","last_active":"2024-05-15T14:47:53.833264+0000","last_peered":"2024-05-15T14:47:53.833264+0000","last_clean":"2024-05-15T14:47:53.833264+0000","last_became_active":"2024-05-15T14:27:52.840847+0000","last_became_peered":"2024-05-15T14:27:52.840847+0000","last_unstale":"2024-05-15T14:47:53.833264+0000","last_undegraded":"2024-05-15T14:47:53.833264+0000","last_fullsized":"2024-05-15T14:47:53.833264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.024900+0000","last_change":"2024-05-15T14:27:50.846344+0000","last_active":"2024-05-15T14:48:26.024900+0000","last_peered":"2024-05-15T14:48:26.024900+0000","last_clean":"2024-05-15T14:48:26.024900+0000","last_became_active":"2024-05-15T14:27:50.845923+0000","last_became_peered":"2024-05-15T14:27:50.845923+0000","last_unstale":"2024-05-15T14:48:26.024900+0000","last_undegraded":"2024-05-15T14:48:26.024900+0000","last_fullsized":"2024-05-15T14:48:26.024900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:38.935625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32,"num_write":82,"num_write_kb":27622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.505308+0000","last_change":"2024-05-15T14:27:56.876632+0000","last_active":"2024-05-15T14:44:17.505308+0000","last_peered":"2024-05-15T14:44:17.505308+0000","last_clean":"2024-05-15T14:44:17.505308+0000","last_became_active":"2024-05-15T14:27:56.876325+0000","last_became_peered":"2024-05-15T14:27:56.876325+0000","last_unstale":"2024-05-15T14:44:17.505308+0000","last_undegraded":"2024-05-15T14:44:17.505308+0000","last_fullsized":"2024-05-15T14:44:17.505308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"39'141","reported_seq":254,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.677666+0000","last_change":"2024-05-15T14:27:58.884267+0000","last_active":"2024-05-15T14:47:52.677666+0000","last_peered":"2024-05-15T14:47:52.677666+0000","last_clean":"2024-05-15T14:47:52.677666+0000","last_became_active":"2024-05-15T14:27:58.883792+0000","last_became_peered":"2024-05-15T14:27:58.883792+0000","last_unstale":"2024-05-15T14:47:52.677666+0000","last_undegraded":"2024-05-15T14:47:52.677666+0000","last_fullsized":"2024-05-15T14:47:52.677666+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:40.853095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":205,"num_write":143,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.405883+0000","last_change":"2024-05-15T14:28:00.886183+0000","last_active":"2024-05-15T14:44:57.405883+0000","last_peered":"2024-05-15T14:44:57.405883+0000","last_clean":"2024-05-15T14:44:57.405883+0000","last_became_active":"2024-05-15T14:28:00.885933+0000","last_became_peered":"2024-05-15T14:28:00.885933+0000","last_unstale":"2024-05-15T14:44:57.405883+0000","last_undegraded":"2024-05-15T14:44:57.405883+0000","last_fullsized":"2024-05-15T14:44:57.405883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:54:06.577512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.522169+0000","last_change":"2024-05-15T14:31:16.594655+0000","last_active":"2024-05-15T14:46:17.522169+0000","last_peered":"2024-05-15T14:46:17.522169+0000","last_clean":"2024-05-15T14:46:17.522169+0000","last_became_active":"2024-05-15T14:31:16.594357+0000","last_became_peered":"2024-05-15T14:31:16.594357+0000","last_unstale":"2024-05-15T14:46:17.522169+0000","last_undegraded":"2024-05-15T14:46:17.522169+0000","last_fullsized":"2024-05-15T14:46:17.522169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:40.584210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"39'16","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.231721+0000","last_change":"2024-05-15T14:28:02.893788+0000","last_active":"2024-05-15T14:46:21.231721+0000","last_peered":"2024-05-15T14:46:21.231721+0000","last_clean":"2024-05-15T14:46:21.231721+0000","last_became_active":"2024-05-15T14:28:02.892764+0000","last_became_peered":"2024-05-15T14:28:02.892764+0000","last_unstale":"2024-05-15T14:46:21.231721+0000","last_undegraded":"2024-05-15T14:46:21.231721+0000","last_fullsized":"2024-05-15T14:46:21.231721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"39'26","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.831811+0000","last_change":"2024-05-15T14:27:52.853179+0000","last_active":"2024-05-15T14:47:53.831811+0000","last_peered":"2024-05-15T14:47:53.831811+0000","last_clean":"2024-05-15T14:47:53.831811+0000","last_became_active":"2024-05-15T14:27:52.852883+0000","last_became_peered":"2024-05-15T14:27:52.852883+0000","last_unstale":"2024-05-15T14:47:53.831811+0000","last_undegraded":"2024-05-15T14:47:53.831811+0000","last_fullsized":"2024-05-15T14:47:53.831811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519834+0000","last_change":"2024-05-15T14:27:50.848690+0000","last_active":"2024-05-15T14:46:32.519834+0000","last_peered":"2024-05-15T14:46:32.519834+0000","last_clean":"2024-05-15T14:46:32.519834+0000","last_became_active":"2024-05-15T14:27:50.848412+0000","last_became_peered":"2024-05-15T14:27:50.848412+0000","last_unstale":"2024-05-15T14:46:32.519834+0000","last_undegraded":"2024-05-15T14:46:32.519834+0000","last_fullsized":"2024-05-15T14:46:32.519834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"39'14","reported_seq":693,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.906177+0000","last_change":"2024-05-15T14:27:56.877306+0000","last_active":"2024-05-15T14:48:25.906177+0000","last_peered":"2024-05-15T14:48:25.906177+0000","last_clean":"2024-05-15T14:48:25.906177+0000","last_became_active":"2024-05-15T14:27:56.877039+0000","last_became_peered":"2024-05-15T14:27:56.877039+0000","last_unstale":"2024-05-15T14:48:25.906177+0000","last_undegraded":"2024-05-15T14:48:25.906177+0000","last_fullsized":"2024-05-15T14:48:25.906177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":633,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"39'242","reported_seq":403,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.698585+0000","last_change":"2024-05-15T14:27:58.888330+0000","last_active":"2024-05-15T14:47:52.698585+0000","last_peered":"2024-05-15T14:47:52.698585+0000","last_clean":"2024-05-15T14:47:52.698585+0000","last_became_active":"2024-05-15T14:27:58.887969+0000","last_became_peered":"2024-05-15T14:27:58.887969+0000","last_unstale":"2024-05-15T14:47:52.698585+0000","last_undegraded":"2024-05-15T14:47:52.698585+0000","last_fullsized":"2024-05-15T14:47:52.698585+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:58.967265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":351,"num_read_kb":343,"num_write":242,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'924","reported_seq":1430,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.089617+0000","last_change":"2024-05-15T14:28:00.893106+0000","last_active":"2024-05-15T14:48:26.089617+0000","last_peered":"2024-05-15T14:48:26.089617+0000","last_clean":"2024-05-15T14:48:26.089617+0000","last_became_active":"2024-05-15T14:28:00.892864+0000","last_became_peered":"2024-05-15T14:28:00.892864+0000","last_unstale":"2024-05-15T14:48:26.089617+0000","last_undegraded":"2024-05-15T14:48:26.089617+0000","last_fullsized":"2024-05-15T14:48:26.089617+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:44.055462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.522137+0000","last_change":"2024-05-15T14:31:16.584361+0000","last_active":"2024-05-15T14:46:17.522137+0000","last_peered":"2024-05-15T14:46:17.522137+0000","last_clean":"2024-05-15T14:46:17.522137+0000","last_became_active":"2024-05-15T14:31:16.583997+0000","last_became_peered":"2024-05-15T14:31:16.583997+0000","last_unstale":"2024-05-15T14:46:17.522137+0000","last_undegraded":"2024-05-15T14:46:17.522137+0000","last_fullsized":"2024-05-15T14:46:17.522137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:37:56.322484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"39'29","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.868517+0000","last_change":"2024-05-15T14:28:02.887587+0000","last_active":"2024-05-15T14:47:53.868517+0000","last_peered":"2024-05-15T14:47:53.868517+0000","last_clean":"2024-05-15T14:47:53.868517+0000","last_became_active":"2024-05-15T14:28:02.887257+0000","last_became_peered":"2024-05-15T14:28:02.887257+0000","last_unstale":"2024-05-15T14:47:53.868517+0000","last_undegraded":"2024-05-15T14:47:53.868517+0000","last_fullsized":"2024-05-15T14:47:53.868517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":53,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"39'24","reported_seq":108,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.359438+0000","last_change":"2024-05-15T14:27:52.852418+0000","last_active":"2024-05-15T14:46:21.359438+0000","last_peered":"2024-05-15T14:46:21.359438+0000","last_clean":"2024-05-15T14:46:21.359438+0000","last_became_active":"2024-05-15T14:27:52.851979+0000","last_became_peered":"2024-05-15T14:27:52.851979+0000","last_unstale":"2024-05-15T14:46:21.359438+0000","last_undegraded":"2024-05-15T14:46:21.359438+0000","last_fullsized":"2024-05-15T14:46:21.359438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:38.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":90,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"39'6","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.415609+0000","last_change":"2024-05-15T14:27:50.841076+0000","last_active":"2024-05-15T14:46:32.415609+0000","last_peered":"2024-05-15T14:46:32.415609+0000","last_clean":"2024-05-15T14:46:32.415609+0000","last_became_active":"2024-05-15T14:27:50.840772+0000","last_became_peered":"2024-05-15T14:27:50.840772+0000","last_unstale":"2024-05-15T14:46:32.415609+0000","last_undegraded":"2024-05-15T14:46:32.415609+0000","last_fullsized":"2024-05-15T14:46:32.415609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:48:10.102924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":30,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.404007+0000","last_change":"2024-05-15T14:27:56.878098+0000","last_active":"2024-05-15T14:44:52.404007+0000","last_peered":"2024-05-15T14:44:52.404007+0000","last_clean":"2024-05-15T14:44:52.404007+0000","last_became_active":"2024-05-15T14:27:56.877825+0000","last_became_peered":"2024-05-15T14:27:56.877825+0000","last_unstale":"2024-05-15T14:44:52.404007+0000","last_undegraded":"2024-05-15T14:44:52.404007+0000","last_fullsized":"2024-05-15T14:44:52.404007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"39'273","reported_seq":23277,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.006669+0000","last_change":"2024-05-15T14:27:58.887851+0000","last_active":"2024-05-15T14:48:26.006669+0000","last_peered":"2024-05-15T14:48:26.006669+0000","last_clean":"2024-05-15T14:48:26.006669+0000","last_became_active":"2024-05-15T14:27:58.887424+0000","last_became_peered":"2024-05-15T14:27:58.887424+0000","last_unstale":"2024-05-15T14:48:26.006669+0000","last_undegraded":"2024-05-15T14:48:26.006669+0000","last_fullsized":"2024-05-15T14:48:26.006669+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:51.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57540,"num_read_kb":170980,"num_write":272,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'924","reported_seq":2595,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.093366+0000","last_change":"2024-05-15T14:28:00.887805+0000","last_active":"2024-05-15T14:48:26.093366+0000","last_peered":"2024-05-15T14:48:26.093366+0000","last_clean":"2024-05-15T14:48:26.093366+0000","last_became_active":"2024-05-15T14:28:00.887493+0000","last_became_peered":"2024-05-15T14:28:00.887493+0000","last_unstale":"2024-05-15T14:48:26.093366+0000","last_undegraded":"2024-05-15T14:48:26.093366+0000","last_fullsized":"2024-05-15T14:48:26.093366+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:53.511634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.417667+0000","last_change":"2024-05-15T14:31:16.592231+0000","last_active":"2024-05-15T14:45:57.417667+0000","last_peered":"2024-05-15T14:45:57.417667+0000","last_clean":"2024-05-15T14:45:57.417667+0000","last_became_active":"2024-05-15T14:31:16.591945+0000","last_became_peered":"2024-05-15T14:31:16.591945+0000","last_unstale":"2024-05-15T14:45:57.417667+0000","last_undegraded":"2024-05-15T14:45:57.417667+0000","last_fullsized":"2024-05-15T14:45:57.417667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:40:04.556406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"39'16","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304202+0000","last_change":"2024-05-15T14:27:52.842530+0000","last_active":"2024-05-15T14:47:54.304202+0000","last_peered":"2024-05-15T14:47:54.304202+0000","last_clean":"2024-05-15T14:47:54.304202+0000","last_became_active":"2024-05-15T14:27:52.842056+0000","last_became_peered":"2024-05-15T14:27:52.842056+0000","last_unstale":"2024-05-15T14:47:54.304202+0000","last_undegraded":"2024-05-15T14:47:54.304202+0000","last_fullsized":"2024-05-15T14:47:54.304202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.267576+0000","last_change":"2024-05-15T14:27:50.850292+0000","last_active":"2024-05-15T14:47:54.267576+0000","last_peered":"2024-05-15T14:47:54.267576+0000","last_clean":"2024-05-15T14:47:54.267576+0000","last_became_active":"2024-05-15T14:27:50.849981+0000","last_became_peered":"2024-05-15T14:27:50.849981+0000","last_unstale":"2024-05-15T14:47:54.267576+0000","last_undegraded":"2024-05-15T14:47:54.267576+0000","last_fullsized":"2024-05-15T14:47:54.267576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"39'1","reported_seq":128,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.825445+0000","last_change":"2024-05-15T14:27:56.878571+0000","last_active":"2024-05-15T14:46:21.825445+0000","last_peered":"2024-05-15T14:46:21.825445+0000","last_clean":"2024-05-15T14:46:21.825445+0000","last_became_active":"2024-05-15T14:27:56.878269+0000","last_became_peered":"2024-05-15T14:27:56.878269+0000","last_unstale":"2024-05-15T14:46:21.825445+0000","last_undegraded":"2024-05-15T14:46:21.825445+0000","last_fullsized":"2024-05-15T14:46:21.825445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:26.010836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":160,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"39'424","reported_seq":731,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.042504+0000","last_change":"2024-05-15T14:27:58.883936+0000","last_active":"2024-05-15T14:48:26.042504+0000","last_peered":"2024-05-15T14:48:26.042504+0000","last_clean":"2024-05-15T14:48:26.042504+0000","last_became_active":"2024-05-15T14:27:58.883546+0000","last_became_peered":"2024-05-15T14:27:58.883546+0000","last_unstale":"2024-05-15T14:48:26.042504+0000","last_undegraded":"2024-05-15T14:48:26.042504+0000","last_fullsized":"2024-05-15T14:48:26.042504+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.266839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":662,"num_read_kb":650,"num_write":400,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:02.416557+0000","last_change":"2024-05-15T14:28:00.892179+0000","last_active":"2024-05-15T14:46:02.416557+0000","last_peered":"2024-05-15T14:46:02.416557+0000","last_clean":"2024-05-15T14:46:02.416557+0000","last_became_active":"2024-05-15T14:28:00.891863+0000","last_became_peered":"2024-05-15T14:28:00.891863+0000","last_unstale":"2024-05-15T14:46:02.416557+0000","last_undegraded":"2024-05-15T14:46:02.416557+0000","last_fullsized":"2024-05-15T14:46:02.416557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:21:35.957485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"39'26","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.306684+0000","last_change":"2024-05-15T14:28:02.890786+0000","last_active":"2024-05-15T14:47:54.306684+0000","last_peered":"2024-05-15T14:47:54.306684+0000","last_clean":"2024-05-15T14:47:54.306684+0000","last_became_active":"2024-05-15T14:28:02.890450+0000","last_became_peered":"2024-05-15T14:28:02.890450+0000","last_unstale":"2024-05-15T14:47:54.306684+0000","last_undegraded":"2024-05-15T14:47:54.306684+0000","last_fullsized":"2024-05-15T14:47:54.306684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.415229+0000","last_change":"2024-05-15T14:31:16.596637+0000","last_active":"2024-05-15T14:45:52.415229+0000","last_peered":"2024-05-15T14:45:52.415229+0000","last_clean":"2024-05-15T14:45:52.415229+0000","last_became_active":"2024-05-15T14:31:16.596344+0000","last_became_peered":"2024-05-15T14:31:16.596344+0000","last_unstale":"2024-05-15T14:45:52.415229+0000","last_undegraded":"2024-05-15T14:45:52.415229+0000","last_fullsized":"2024-05-15T14:45:52.415229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:45:44.262981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'6","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304209+0000","last_change":"2024-05-15T14:27:52.861403+0000","last_active":"2024-05-15T14:47:54.304209+0000","last_peered":"2024-05-15T14:47:54.304209+0000","last_clean":"2024-05-15T14:47:54.304209+0000","last_became_active":"2024-05-15T14:27:52.861131+0000","last_became_peered":"2024-05-15T14:27:52.861131+0000","last_unstale":"2024-05-15T14:47:54.304209+0000","last_undegraded":"2024-05-15T14:47:54.304209+0000","last_fullsized":"2024-05-15T14:47:54.304209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514795+0000","last_change":"2024-05-15T14:27:50.848143+0000","last_active":"2024-05-15T14:45:52.514795+0000","last_peered":"2024-05-15T14:45:52.514795+0000","last_clean":"2024-05-15T14:45:52.514795+0000","last_became_active":"2024-05-15T14:27:50.847875+0000","last_became_peered":"2024-05-15T14:27:50.847875+0000","last_unstale":"2024-05-15T14:45:52.514795+0000","last_undegraded":"2024-05-15T14:45:52.514795+0000","last_fullsized":"2024-05-15T14:45:52.514795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":11761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"39'1","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:50.280149+0000","last_change":"2024-05-15T14:27:56.881386+0000","last_active":"2024-05-15T14:46:50.280149+0000","last_peered":"2024-05-15T14:46:50.280149+0000","last_clean":"2024-05-15T14:46:50.280149+0000","last_became_active":"2024-05-15T14:27:56.881088+0000","last_became_peered":"2024-05-15T14:27:56.881088+0000","last_unstale":"2024-05-15T14:46:50.280149+0000","last_undegraded":"2024-05-15T14:46:50.280149+0000","last_fullsized":"2024-05-15T14:46:50.280149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:07:36.170847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"39'622","reported_seq":1004,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.083775+0000","last_change":"2024-05-15T14:27:58.883054+0000","last_active":"2024-05-15T14:48:26.083775+0000","last_peered":"2024-05-15T14:48:26.083775+0000","last_clean":"2024-05-15T14:48:26.083775+0000","last_became_active":"2024-05-15T14:27:58.882302+0000","last_became_peered":"2024-05-15T14:27:58.882302+0000","last_unstale":"2024-05-15T14:48:26.083775+0000","last_undegraded":"2024-05-15T14:48:26.083775+0000","last_fullsized":"2024-05-15T14:48:26.083775+0000","mapping_epoch":26,"log_start":"39'598","ondisk_log_start":"39'598","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":598,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:01.547992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1282,"num_read_kb":3196,"num_write":804,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.514379+0000","last_change":"2024-05-15T14:28:00.887671+0000","last_active":"2024-05-15T14:45:22.514379+0000","last_peered":"2024-05-15T14:45:22.514379+0000","last_clean":"2024-05-15T14:45:22.514379+0000","last_became_active":"2024-05-15T14:28:00.887335+0000","last_became_peered":"2024-05-15T14:28:00.887335+0000","last_unstale":"2024-05-15T14:45:22.514379+0000","last_undegraded":"2024-05-15T14:45:22.514379+0000","last_fullsized":"2024-05-15T14:45:22.514379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:16.436035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"39'15","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.314845+0000","last_change":"2024-05-15T14:28:02.889484+0000","last_active":"2024-05-15T14:47:54.314845+0000","last_peered":"2024-05-15T14:47:54.314845+0000","last_clean":"2024-05-15T14:47:54.314845+0000","last_became_active":"2024-05-15T14:28:02.889193+0000","last_became_peered":"2024-05-15T14:28:02.889193+0000","last_unstale":"2024-05-15T14:47:54.314845+0000","last_undegraded":"2024-05-15T14:47:54.314845+0000","last_fullsized":"2024-05-15T14:47:54.314845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:38.654471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.415472+0000","last_change":"2024-05-15T14:31:16.591065+0000","last_active":"2024-05-15T14:46:27.415472+0000","last_peered":"2024-05-15T14:46:27.415472+0000","last_clean":"2024-05-15T14:46:27.415472+0000","last_became_active":"2024-05-15T14:31:16.590510+0000","last_became_peered":"2024-05-15T14:31:16.590510+0000","last_unstale":"2024-05-15T14:46:27.415472+0000","last_undegraded":"2024-05-15T14:46:27.415472+0000","last_fullsized":"2024-05-15T14:46:27.415472+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:15.350673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"39'64","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.296114+0000","last_change":"2024-05-15T14:27:52.861599+0000","last_active":"2024-05-15T14:47:54.296114+0000","last_peered":"2024-05-15T14:47:54.296114+0000","last_clean":"2024-05-15T14:47:54.296114+0000","last_became_active":"2024-05-15T14:27:52.861183+0000","last_became_peered":"2024-05-15T14:27:52.861183+0000","last_unstale":"2024-05-15T14:47:54.296114+0000","last_undegraded":"2024-05-15T14:47:54.296114+0000","last_fullsized":"2024-05-15T14:47:54.296114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:37.266001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":194,"num_write":90,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514768+0000","last_change":"2024-05-15T14:27:50.853049+0000","last_active":"2024-05-15T14:45:52.514768+0000","last_peered":"2024-05-15T14:45:52.514768+0000","last_clean":"2024-05-15T14:45:52.514768+0000","last_became_active":"2024-05-15T14:27:50.852376+0000","last_became_peered":"2024-05-15T14:27:50.852376+0000","last_unstale":"2024-05-15T14:45:52.514768+0000","last_undegraded":"2024-05-15T14:45:52.514768+0000","last_fullsized":"2024-05-15T14:45:52.514768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"25'1","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.359199+0000","last_change":"2024-05-15T14:27:56.881977+0000","last_active":"2024-05-15T14:47:52.359199+0000","last_peered":"2024-05-15T14:47:52.359199+0000","last_clean":"2024-05-15T14:47:52.359199+0000","last_became_active":"2024-05-15T14:27:56.881701+0000","last_became_peered":"2024-05-15T14:27:56.881701+0000","last_unstale":"2024-05-15T14:47:52.359199+0000","last_undegraded":"2024-05-15T14:47:52.359199+0000","last_fullsized":"2024-05-15T14:47:52.359199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:58:05.807690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"39'431","reported_seq":790,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.048598+0000","last_change":"2024-05-15T14:27:58.886060+0000","last_active":"2024-05-15T14:48:26.048598+0000","last_peered":"2024-05-15T14:48:26.048598+0000","last_clean":"2024-05-15T14:48:26.048598+0000","last_became_active":"2024-05-15T14:27:58.885487+0000","last_became_peered":"2024-05-15T14:27:58.885487+0000","last_unstale":"2024-05-15T14:48:26.048598+0000","last_undegraded":"2024-05-15T14:48:26.048598+0000","last_fullsized":"2024-05-15T14:48:26.048598+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:27.428584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":872,"num_read_kb":1334,"num_write":445,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"39'924","reported_seq":1544,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.094334+0000","last_change":"2024-05-15T14:28:00.893226+0000","last_active":"2024-05-15T14:48:26.094334+0000","last_peered":"2024-05-15T14:48:26.094334+0000","last_clean":"2024-05-15T14:48:26.094334+0000","last_became_active":"2024-05-15T14:28:00.892897+0000","last_became_peered":"2024-05-15T14:28:00.892897+0000","last_unstale":"2024-05-15T14:48:26.094334+0000","last_undegraded":"2024-05-15T14:48:26.094334+0000","last_fullsized":"2024-05-15T14:48:26.094334+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:36.428903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"39'14","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.753138+0000","last_change":"2024-05-15T14:28:02.894508+0000","last_active":"2024-05-15T14:47:53.753138+0000","last_peered":"2024-05-15T14:47:53.753138+0000","last_clean":"2024-05-15T14:47:53.753138+0000","last_became_active":"2024-05-15T14:28:02.894071+0000","last_became_peered":"2024-05-15T14:28:02.894071+0000","last_unstale":"2024-05-15T14:47:53.753138+0000","last_undegraded":"2024-05-15T14:47:53.753138+0000","last_fullsized":"2024-05-15T14:47:53.753138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:44.977557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.415437+0000","last_change":"2024-05-15T14:31:16.591474+0000","last_active":"2024-05-15T14:46:27.415437+0000","last_peered":"2024-05-15T14:46:27.415437+0000","last_clean":"2024-05-15T14:46:27.415437+0000","last_became_active":"2024-05-15T14:31:16.591166+0000","last_became_peered":"2024-05-15T14:31:16.591166+0000","last_unstale":"2024-05-15T14:46:27.415437+0000","last_undegraded":"2024-05-15T14:46:27.415437+0000","last_fullsized":"2024-05-15T14:46:27.415437+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:19:18.238793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'114","reported_seq":206,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328155+0000","last_change":"2024-05-15T14:27:52.860101+0000","last_active":"2024-05-15T14:47:54.328155+0000","last_peered":"2024-05-15T14:47:54.328155+0000","last_clean":"2024-05-15T14:47:54.328155+0000","last_became_active":"2024-05-15T14:27:52.859814+0000","last_became_peered":"2024-05-15T14:27:52.859814+0000","last_unstale":"2024-05-15T14:47:54.328155+0000","last_undegraded":"2024-05-15T14:47:54.328155+0000","last_fullsized":"2024-05-15T14:47:54.328155+0000","mapping_epoch":20,"log_start":"39'100","ondisk_log_start":"39'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":332,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411210+0000","last_change":"2024-05-15T14:27:50.849872+0000","last_active":"2024-05-15T14:45:52.411210+0000","last_peered":"2024-05-15T14:45:52.411210+0000","last_clean":"2024-05-15T14:45:52.411210+0000","last_became_active":"2024-05-15T14:27:50.849548+0000","last_became_peered":"2024-05-15T14:27:50.849548+0000","last_unstale":"2024-05-15T14:45:52.411210+0000","last_undegraded":"2024-05-15T14:45:52.411210+0000","last_fullsized":"2024-05-15T14:45:52.411210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"39'5","reported_seq":646,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:45.632505+0000","last_change":"2024-05-15T14:27:56.871956+0000","last_active":"2024-05-15T14:48:45.632505+0000","last_peered":"2024-05-15T14:48:45.632505+0000","last_clean":"2024-05-15T14:48:45.632505+0000","last_became_active":"2024-05-15T14:27:56.871644+0000","last_became_peered":"2024-05-15T14:27:56.871644+0000","last_unstale":"2024-05-15T14:48:45.632505+0000","last_undegraded":"2024-05-15T14:48:45.632505+0000","last_fullsized":"2024-05-15T14:48:45.632505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:48:16.147799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":148,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'275","reported_seq":560,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.054464+0000","last_change":"2024-05-15T14:27:58.881240+0000","last_active":"2024-05-15T14:48:26.054464+0000","last_peered":"2024-05-15T14:48:26.054464+0000","last_clean":"2024-05-15T14:48:26.054464+0000","last_became_active":"2024-05-15T14:27:58.880926+0000","last_became_peered":"2024-05-15T14:27:58.880926+0000","last_unstale":"2024-05-15T14:48:26.054464+0000","last_undegraded":"2024-05-15T14:48:26.054464+0000","last_fullsized":"2024-05-15T14:48:26.054464+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:51.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":466,"num_read_kb":455,"num_write":228,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.501382+0000","last_change":"2024-05-15T14:28:00.886629+0000","last_active":"2024-05-15T14:45:22.501382+0000","last_peered":"2024-05-15T14:45:22.501382+0000","last_clean":"2024-05-15T14:45:22.501382+0000","last_became_active":"2024-05-15T14:28:00.886359+0000","last_became_peered":"2024-05-15T14:28:00.886359+0000","last_unstale":"2024-05-15T14:45:22.501382+0000","last_undegraded":"2024-05-15T14:45:22.501382+0000","last_fullsized":"2024-05-15T14:45:22.501382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:28.468952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"39'29","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.250372+0000","last_change":"2024-05-15T14:28:02.892567+0000","last_active":"2024-05-15T14:47:54.250372+0000","last_peered":"2024-05-15T14:47:54.250372+0000","last_clean":"2024-05-15T14:47:54.250372+0000","last_became_active":"2024-05-15T14:28:02.892287+0000","last_became_peered":"2024-05-15T14:28:02.892287+0000","last_unstale":"2024-05-15T14:47:54.250372+0000","last_undegraded":"2024-05-15T14:47:54.250372+0000","last_fullsized":"2024-05-15T14:47:54.250372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:17:18.538337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518593+0000","last_change":"2024-05-15T14:31:16.590519+0000","last_active":"2024-05-15T14:45:52.518593+0000","last_peered":"2024-05-15T14:45:52.518593+0000","last_clean":"2024-05-15T14:45:52.518593+0000","last_became_active":"2024-05-15T14:31:16.590227+0000","last_became_peered":"2024-05-15T14:31:16.590227+0000","last_unstale":"2024-05-15T14:45:52.518593+0000","last_undegraded":"2024-05-15T14:45:52.518593+0000","last_fullsized":"2024-05-15T14:45:52.518593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:21.771432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411633+0000","last_change":"2024-05-15T14:27:52.851931+0000","last_active":"2024-05-15T14:45:52.411633+0000","last_peered":"2024-05-15T14:45:52.411633+0000","last_clean":"2024-05-15T14:45:52.411633+0000","last_became_active":"2024-05-15T14:27:52.851589+0000","last_became_peered":"2024-05-15T14:27:52.851589+0000","last_unstale":"2024-05-15T14:45:52.411633+0000","last_undegraded":"2024-05-15T14:45:52.411633+0000","last_fullsized":"2024-05-15T14:45:52.411633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:38.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"39'14","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026953+0000","last_change":"2024-05-15T14:27:50.850680+0000","last_active":"2024-05-15T14:48:26.026953+0000","last_peered":"2024-05-15T14:48:26.026953+0000","last_clean":"2024-05-15T14:48:26.026953+0000","last_became_active":"2024-05-15T14:27:50.850389+0000","last_became_peered":"2024-05-15T14:27:50.850389+0000","last_unstale":"2024-05-15T14:48:26.026953+0000","last_undegraded":"2024-05-15T14:48:26.026953+0000","last_fullsized":"2024-05-15T14:48:26.026953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":19,"num_write":54,"num_write_kb":19955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"25'1","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.358730+0000","last_change":"2024-05-15T14:27:56.877565+0000","last_active":"2024-05-15T14:47:52.358730+0000","last_peered":"2024-05-15T14:47:52.358730+0000","last_clean":"2024-05-15T14:47:52.358730+0000","last_became_active":"2024-05-15T14:27:56.876626+0000","last_became_peered":"2024-05-15T14:27:56.876626+0000","last_unstale":"2024-05-15T14:47:52.358730+0000","last_undegraded":"2024-05-15T14:47:52.358730+0000","last_fullsized":"2024-05-15T14:47:52.358730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:59:42.209397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"39'362","reported_seq":584,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.986164+0000","last_change":"2024-05-15T14:27:58.885446+0000","last_active":"2024-05-15T14:48:25.986164+0000","last_peered":"2024-05-15T14:48:25.986164+0000","last_clean":"2024-05-15T14:48:25.986164+0000","last_became_active":"2024-05-15T14:27:58.885156+0000","last_became_peered":"2024-05-15T14:27:58.885156+0000","last_unstale":"2024-05-15T14:48:25.986164+0000","last_undegraded":"2024-05-15T14:48:25.986164+0000","last_fullsized":"2024-05-15T14:48:25.986164+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":660,"num_write":561,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:07.418800+0000","last_change":"2024-05-15T14:28:00.885938+0000","last_active":"2024-05-15T14:46:07.418800+0000","last_peered":"2024-05-15T14:46:07.418800+0000","last_clean":"2024-05-15T14:46:07.418800+0000","last_became_active":"2024-05-15T14:28:00.885582+0000","last_became_peered":"2024-05-15T14:28:00.885582+0000","last_unstale":"2024-05-15T14:46:07.418800+0000","last_undegraded":"2024-05-15T14:46:07.418800+0000","last_fullsized":"2024-05-15T14:46:07.418800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:22:45.934449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"39'24","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.863377+0000","last_change":"2024-05-15T14:28:02.891692+0000","last_active":"2024-05-15T14:47:53.863377+0000","last_peered":"2024-05-15T14:47:53.863377+0000","last_clean":"2024-05-15T14:47:53.863377+0000","last_became_active":"2024-05-15T14:28:02.891419+0000","last_became_peered":"2024-05-15T14:28:02.891419+0000","last_unstale":"2024-05-15T14:47:53.863377+0000","last_undegraded":"2024-05-15T14:47:53.863377+0000","last_fullsized":"2024-05-15T14:47:53.863377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:00.406575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.411559+0000","last_change":"2024-05-15T14:31:16.594272+0000","last_active":"2024-05-15T14:45:22.411559+0000","last_peered":"2024-05-15T14:45:22.411559+0000","last_clean":"2024-05-15T14:45:22.411559+0000","last_became_active":"2024-05-15T14:31:16.593942+0000","last_became_peered":"2024-05-15T14:31:16.593942+0000","last_unstale":"2024-05-15T14:45:22.411559+0000","last_undegraded":"2024-05-15T14:45:22.411559+0000","last_fullsized":"2024-05-15T14:45:22.411559+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:22.878653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'62","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840310+0000","last_change":"2024-05-15T14:27:52.854103+0000","last_active":"2024-05-15T14:47:53.840310+0000","last_peered":"2024-05-15T14:47:53.840310+0000","last_clean":"2024-05-15T14:47:53.840310+0000","last_became_active":"2024-05-15T14:27:52.853828+0000","last_became_peered":"2024-05-15T14:27:52.853828+0000","last_unstale":"2024-05-15T14:47:53.840310+0000","last_undegraded":"2024-05-15T14:47:53.840310+0000","last_fullsized":"2024-05-15T14:47:53.840310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":210,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407053+0000","last_change":"2024-05-15T14:27:50.838852+0000","last_active":"2024-05-15T14:45:17.407053+0000","last_peered":"2024-05-15T14:45:17.407053+0000","last_clean":"2024-05-15T14:45:17.407053+0000","last_became_active":"2024-05-15T14:27:50.838561+0000","last_became_peered":"2024-05-15T14:27:50.838561+0000","last_unstale":"2024-05-15T14:45:17.407053+0000","last_undegraded":"2024-05-15T14:45:17.407053+0000","last_fullsized":"2024-05-15T14:45:17.407053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:04.000024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.415863+0000","last_change":"2024-05-15T14:27:56.885185+0000","last_active":"2024-05-15T14:45:57.415863+0000","last_peered":"2024-05-15T14:45:57.415863+0000","last_clean":"2024-05-15T14:45:57.415863+0000","last_became_active":"2024-05-15T14:27:56.884903+0000","last_became_peered":"2024-05-15T14:27:56.884903+0000","last_unstale":"2024-05-15T14:45:57.415863+0000","last_undegraded":"2024-05-15T14:45:57.415863+0000","last_fullsized":"2024-05-15T14:45:57.415863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:07.170918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"39'341","reported_seq":600,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.072557+0000","last_change":"2024-05-15T14:27:58.876510+0000","last_active":"2024-05-15T14:48:26.072557+0000","last_peered":"2024-05-15T14:48:26.072557+0000","last_clean":"2024-05-15T14:48:26.072557+0000","last_became_active":"2024-05-15T14:27:58.876221+0000","last_became_peered":"2024-05-15T14:27:58.876221+0000","last_unstale":"2024-05-15T14:48:26.072557+0000","last_undegraded":"2024-05-15T14:48:26.072557+0000","last_fullsized":"2024-05-15T14:48:26.072557+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:51.509862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":522,"num_write":318,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'924","reported_seq":1397,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.090607+0000","last_change":"2024-05-15T14:28:00.884330+0000","last_active":"2024-05-15T14:48:26.090607+0000","last_peered":"2024-05-15T14:48:26.090607+0000","last_clean":"2024-05-15T14:48:26.090607+0000","last_became_active":"2024-05-15T14:28:00.884042+0000","last_became_peered":"2024-05-15T14:28:00.884042+0000","last_unstale":"2024-05-15T14:48:26.090607+0000","last_undegraded":"2024-05-15T14:48:26.090607+0000","last_fullsized":"2024-05-15T14:48:26.090607+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:27.911745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"39'23","reported_seq":62,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.291705+0000","last_change":"2024-05-15T14:28:02.888922+0000","last_active":"2024-05-15T14:47:54.291705+0000","last_peered":"2024-05-15T14:47:54.291705+0000","last_clean":"2024-05-15T14:47:54.291705+0000","last_became_active":"2024-05-15T14:28:02.888602+0000","last_became_peered":"2024-05-15T14:28:02.888602+0000","last_unstale":"2024-05-15T14:47:54.291705+0000","last_undegraded":"2024-05-15T14:47:54.291705+0000","last_fullsized":"2024-05-15T14:47:54.291705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:10.939156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514713+0000","last_change":"2024-05-15T14:31:16.591991+0000","last_active":"2024-05-15T14:45:52.514713+0000","last_peered":"2024-05-15T14:45:52.514713+0000","last_clean":"2024-05-15T14:45:52.514713+0000","last_became_active":"2024-05-15T14:31:16.591677+0000","last_became_peered":"2024-05-15T14:31:16.591677+0000","last_unstale":"2024-05-15T14:45:52.514713+0000","last_undegraded":"2024-05-15T14:45:52.514713+0000","last_fullsized":"2024-05-15T14:45:52.514713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:14:24.885155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'72","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327549+0000","last_change":"2024-05-15T14:27:52.844483+0000","last_active":"2024-05-15T14:47:54.327549+0000","last_peered":"2024-05-15T14:47:54.327549+0000","last_clean":"2024-05-15T14:47:54.327549+0000","last_became_active":"2024-05-15T14:27:52.844221+0000","last_became_peered":"2024-05-15T14:27:52.844221+0000","last_unstale":"2024-05-15T14:47:54.327549+0000","last_undegraded":"2024-05-15T14:47:54.327549+0000","last_fullsized":"2024-05-15T14:47:54.327549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":255,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.277035+0000","last_change":"2024-05-15T14:27:50.849342+0000","last_active":"2024-05-15T14:47:54.277035+0000","last_peered":"2024-05-15T14:47:54.277035+0000","last_clean":"2024-05-15T14:47:54.277035+0000","last_became_active":"2024-05-15T14:27:50.846927+0000","last_became_peered":"2024-05-15T14:27:50.846927+0000","last_unstale":"2024-05-15T14:47:54.277035+0000","last_undegraded":"2024-05-15T14:47:54.277035+0000","last_fullsized":"2024-05-15T14:47:54.277035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":82,"num_write_kb":24687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'6","reported_seq":801,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.907076+0000","last_change":"2024-05-15T14:27:56.882327+0000","last_active":"2024-05-15T14:48:25.907076+0000","last_peered":"2024-05-15T14:48:25.907076+0000","last_clean":"2024-05-15T14:48:25.907076+0000","last_became_active":"2024-05-15T14:27:56.882055+0000","last_became_peered":"2024-05-15T14:27:56.882055+0000","last_unstale":"2024-05-15T14:48:25.907076+0000","last_undegraded":"2024-05-15T14:48:25.907076+0000","last_fullsized":"2024-05-15T14:48:25.907076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1072,"num_read_kb":1813,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"39'231","reported_seq":384,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.748891+0000","last_change":"2024-05-15T14:27:58.878945+0000","last_active":"2024-05-15T14:47:53.748891+0000","last_peered":"2024-05-15T14:47:53.748891+0000","last_clean":"2024-05-15T14:47:53.748891+0000","last_became_active":"2024-05-15T14:27:58.878514+0000","last_became_peered":"2024-05-15T14:27:58.878514+0000","last_unstale":"2024-05-15T14:47:53.748891+0000","last_undegraded":"2024-05-15T14:47:53.748891+0000","last_fullsized":"2024-05-15T14:47:53.748891+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:40.853095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":332,"num_write":230,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'924","reported_seq":1429,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.091471+0000","last_change":"2024-05-15T14:28:00.891775+0000","last_active":"2024-05-15T14:48:26.091471+0000","last_peered":"2024-05-15T14:48:26.091471+0000","last_clean":"2024-05-15T14:48:26.091471+0000","last_became_active":"2024-05-15T14:28:00.891535+0000","last_became_peered":"2024-05-15T14:28:00.891535+0000","last_unstale":"2024-05-15T14:48:26.091471+0000","last_undegraded":"2024-05-15T14:48:26.091471+0000","last_fullsized":"2024-05-15T14:48:26.091471+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:03.092896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"39'19","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418124+0000","last_change":"2024-05-15T14:28:02.889970+0000","last_active":"2024-05-15T14:46:47.418124+0000","last_peered":"2024-05-15T14:46:47.418124+0000","last_clean":"2024-05-15T14:46:47.418124+0000","last_became_active":"2024-05-15T14:28:02.889039+0000","last_became_peered":"2024-05-15T14:28:02.889039+0000","last_unstale":"2024-05-15T14:46:47.418124+0000","last_undegraded":"2024-05-15T14:46:47.418124+0000","last_fullsized":"2024-05-15T14:46:47.418124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518620+0000","last_change":"2024-05-15T14:31:16.593519+0000","last_active":"2024-05-15T14:45:52.518620+0000","last_peered":"2024-05-15T14:45:52.518620+0000","last_clean":"2024-05-15T14:45:52.518620+0000","last_became_active":"2024-05-15T14:31:16.593216+0000","last_became_peered":"2024-05-15T14:31:16.593216+0000","last_unstale":"2024-05-15T14:45:52.518620+0000","last_undegraded":"2024-05-15T14:45:52.518620+0000","last_fullsized":"2024-05-15T14:45:52.518620+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:16:24.742213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'24","reported_seq":118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.384978+0000","last_change":"2024-05-15T14:27:52.855239+0000","last_active":"2024-05-15T14:46:21.384978+0000","last_peered":"2024-05-15T14:46:21.384978+0000","last_clean":"2024-05-15T14:46:21.384978+0000","last_became_active":"2024-05-15T14:27:52.854963+0000","last_became_peered":"2024-05-15T14:27:52.854963+0000","last_unstale":"2024-05-15T14:46:21.384978+0000","last_undegraded":"2024-05-15T14:46:21.384978+0000","last_fullsized":"2024-05-15T14:46:21.384978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:02.561338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512454+0000","last_change":"2024-05-15T14:27:50.847492+0000","last_active":"2024-05-15T14:45:12.512454+0000","last_peered":"2024-05-15T14:45:12.512454+0000","last_clean":"2024-05-15T14:45:12.512454+0000","last_became_active":"2024-05-15T14:27:50.847163+0000","last_became_peered":"2024-05-15T14:27:50.847163+0000","last_unstale":"2024-05-15T14:45:12.512454+0000","last_undegraded":"2024-05-15T14:45:12.512454+0000","last_fullsized":"2024-05-15T14:45:12.512454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.412235+0000","last_change":"2024-05-15T14:27:56.880246+0000","last_active":"2024-05-15T14:45:57.412235+0000","last_peered":"2024-05-15T14:45:57.412235+0000","last_clean":"2024-05-15T14:45:57.412235+0000","last_became_active":"2024-05-15T14:27:56.879526+0000","last_became_peered":"2024-05-15T14:27:56.879526+0000","last_unstale":"2024-05-15T14:45:57.412235+0000","last_undegraded":"2024-05-15T14:45:57.412235+0000","last_fullsized":"2024-05-15T14:45:57.412235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"39'405","reported_seq":686,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.033540+0000","last_change":"2024-05-15T14:27:58.883156+0000","last_active":"2024-05-15T14:48:26.033540+0000","last_peered":"2024-05-15T14:48:26.033540+0000","last_clean":"2024-05-15T14:48:26.033540+0000","last_became_active":"2024-05-15T14:27:58.882886+0000","last_became_peered":"2024-05-15T14:27:58.882886+0000","last_unstale":"2024-05-15T14:48:26.033540+0000","last_undegraded":"2024-05-15T14:48:26.033540+0000","last_fullsized":"2024-05-15T14:48:26.033540+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:42.051812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":654,"num_read_kb":644,"num_write":480,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:02.412107+0000","last_change":"2024-05-15T14:28:00.885713+0000","last_active":"2024-05-15T14:46:02.412107+0000","last_peered":"2024-05-15T14:46:02.412107+0000","last_clean":"2024-05-15T14:46:02.412107+0000","last_became_active":"2024-05-15T14:28:00.885434+0000","last_became_peered":"2024-05-15T14:28:00.885434+0000","last_unstale":"2024-05-15T14:46:02.412107+0000","last_undegraded":"2024-05-15T14:46:02.412107+0000","last_fullsized":"2024-05-15T14:46:02.412107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:30.563508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"39'18","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288457+0000","last_change":"2024-05-15T14:28:02.890234+0000","last_active":"2024-05-15T14:47:54.288457+0000","last_peered":"2024-05-15T14:47:54.288457+0000","last_clean":"2024-05-15T14:47:54.288457+0000","last_became_active":"2024-05-15T14:28:02.889918+0000","last_became_peered":"2024-05-15T14:28:02.889918+0000","last_unstale":"2024-05-15T14:47:54.288457+0000","last_undegraded":"2024-05-15T14:47:54.288457+0000","last_fullsized":"2024-05-15T14:47:54.288457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:16:02.299835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.523316+0000","last_change":"2024-05-15T14:31:16.594123+0000","last_active":"2024-05-15T14:46:27.523316+0000","last_peered":"2024-05-15T14:46:27.523316+0000","last_clean":"2024-05-15T14:46:27.523316+0000","last_became_active":"2024-05-15T14:31:16.593813+0000","last_became_peered":"2024-05-15T14:31:16.593813+0000","last_unstale":"2024-05-15T14:46:27.523316+0000","last_undegraded":"2024-05-15T14:46:27.523316+0000","last_fullsized":"2024-05-15T14:46:27.523316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:36.647120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'64","reported_seq":184,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840377+0000","last_change":"2024-05-15T14:27:52.846883+0000","last_active":"2024-05-15T14:47:53.840377+0000","last_peered":"2024-05-15T14:47:53.840377+0000","last_clean":"2024-05-15T14:47:53.840377+0000","last_became_active":"2024-05-15T14:27:52.846508+0000","last_became_peered":"2024-05-15T14:27:52.846508+0000","last_unstale":"2024-05-15T14:47:53.840377+0000","last_undegraded":"2024-05-15T14:47:53.840377+0000","last_fullsized":"2024-05-15T14:47:53.840377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:40.944809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":231,"num_write":88,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514066+0000","last_change":"2024-05-15T14:27:43.806336+0000","last_active":"2024-05-15T14:45:47.514066+0000","last_peered":"2024-05-15T14:45:47.514066+0000","last_clean":"2024-05-15T14:45:47.514066+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:45:47.514066+0000","last_undegraded":"2024-05-15T14:45:47.514066+0000","last_fullsized":"2024-05-15T14:45:47.514066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_clean_scrub_stamp":"2024-05-15T14:27:42.789461+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:25.195322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416082+0000","last_change":"2024-05-15T14:27:44.808919+0000","last_active":"2024-05-15T14:46:32.416082+0000","last_peered":"2024-05-15T14:46:32.416082+0000","last_clean":"2024-05-15T14:46:32.416082+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:46:32.416082+0000","last_undegraded":"2024-05-15T14:46:32.416082+0000","last_fullsized":"2024-05-15T14:46:32.416082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"39'26","reported_seq":112,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.258707+0000","last_change":"2024-05-15T14:27:50.850434+0000","last_active":"2024-05-15T14:47:54.258707+0000","last_peered":"2024-05-15T14:47:54.258707+0000","last_clean":"2024-05-15T14:47:54.258707+0000","last_became_active":"2024-05-15T14:27:50.849731+0000","last_became_peered":"2024-05-15T14:27:50.849731+0000","last_unstale":"2024-05-15T14:47:54.258707+0000","last_undegraded":"2024-05-15T14:47:54.258707+0000","last_fullsized":"2024-05-15T14:47:54.258707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":50,"num_write":130,"num_write_kb":35292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.521236+0000","last_change":"2024-05-15T14:27:56.878884+0000","last_active":"2024-05-15T14:46:42.521236+0000","last_peered":"2024-05-15T14:46:42.521236+0000","last_clean":"2024-05-15T14:46:42.521236+0000","last_became_active":"2024-05-15T14:27:56.878611+0000","last_became_peered":"2024-05-15T14:27:56.878611+0000","last_unstale":"2024-05-15T14:46:42.521236+0000","last_undegraded":"2024-05-15T14:46:42.521236+0000","last_fullsized":"2024-05-15T14:46:42.521236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:39.394172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"39'341","reported_seq":3164,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.066914+0000","last_change":"2024-05-15T14:27:58.884541+0000","last_active":"2024-05-15T14:48:26.066914+0000","last_peered":"2024-05-15T14:48:26.066914+0000","last_clean":"2024-05-15T14:48:26.066914+0000","last_became_active":"2024-05-15T14:27:58.884237+0000","last_became_peered":"2024-05-15T14:27:58.884237+0000","last_unstale":"2024-05-15T14:48:26.066914+0000","last_undegraded":"2024-05-15T14:48:26.066914+0000","last_fullsized":"2024-05-15T14:48:26.066914+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":8031,"num_read_kb":5511,"num_write":255,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.413851+0000","last_change":"2024-05-15T14:28:00.887075+0000","last_active":"2024-05-15T14:45:22.413851+0000","last_peered":"2024-05-15T14:45:22.413851+0000","last_clean":"2024-05-15T14:45:22.413851+0000","last_became_active":"2024-05-15T14:28:00.886539+0000","last_became_peered":"2024-05-15T14:28:00.886539+0000","last_unstale":"2024-05-15T14:45:22.413851+0000","last_undegraded":"2024-05-15T14:45:22.413851+0000","last_fullsized":"2024-05-15T14:45:22.413851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:29.042984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"39'21","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.728874+0000","last_change":"2024-05-15T14:28:02.892380+0000","last_active":"2024-05-15T14:47:53.728874+0000","last_peered":"2024-05-15T14:47:53.728874+0000","last_clean":"2024-05-15T14:47:53.728874+0000","last_became_active":"2024-05-15T14:28:02.892076+0000","last_became_peered":"2024-05-15T14:28:02.892076+0000","last_unstale":"2024-05-15T14:47:53.728874+0000","last_undegraded":"2024-05-15T14:47:53.728874+0000","last_fullsized":"2024-05-15T14:47:53.728874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:04.849548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.b","version":"39'3","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.409808+0000","last_change":"2024-05-15T14:31:16.592642+0000","last_active":"2024-05-15T14:44:47.409808+0000","last_peered":"2024-05-15T14:44:47.409808+0000","last_clean":"2024-05-15T14:44:47.409808+0000","last_became_active":"2024-05-15T14:31:16.592325+0000","last_became_peered":"2024-05-15T14:31:16.592325+0000","last_unstale":"2024-05-15T14:44:47.409808+0000","last_undegraded":"2024-05-15T14:44:47.409808+0000","last_fullsized":"2024-05-15T14:44:47.409808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:15.350673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'26","reported_seq":131,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.335536+0000","last_change":"2024-05-15T14:27:52.859118+0000","last_active":"2024-05-15T14:46:21.335536+0000","last_peered":"2024-05-15T14:46:21.335536+0000","last_clean":"2024-05-15T14:46:21.335536+0000","last_became_active":"2024-05-15T14:27:52.858631+0000","last_became_peered":"2024-05-15T14:27:52.858631+0000","last_unstale":"2024-05-15T14:46:21.335536+0000","last_undegraded":"2024-05-15T14:46:21.335536+0000","last_fullsized":"2024-05-15T14:46:21.335536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514045+0000","last_change":"2024-05-15T14:27:44.810189+0000","last_active":"2024-05-15T14:45:47.514045+0000","last_peered":"2024-05-15T14:45:47.514045+0000","last_clean":"2024-05-15T14:45:47.514045+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:45:47.514045+0000","last_undegraded":"2024-05-15T14:45:47.514045+0000","last_fullsized":"2024-05-15T14:45:47.514045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:29.474022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'9","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.076855+0000","last_change":"2024-05-15T14:27:50.833876+0000","last_active":"2024-05-15T14:48:26.076855+0000","last_peered":"2024-05-15T14:48:26.076855+0000","last_clean":"2024-05-15T14:48:26.076855+0000","last_became_active":"2024-05-15T14:27:50.833509+0000","last_became_peered":"2024-05-15T14:27:50.833509+0000","last_unstale":"2024-05-15T14:48:26.076855+0000","last_undegraded":"2024-05-15T14:48:26.076855+0000","last_fullsized":"2024-05-15T14:48:26.076855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":37,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407312+0000","last_change":"2024-05-15T14:27:56.876813+0000","last_active":"2024-05-15T14:45:17.407312+0000","last_peered":"2024-05-15T14:45:17.407312+0000","last_clean":"2024-05-15T14:45:17.407312+0000","last_became_active":"2024-05-15T14:27:56.876526+0000","last_became_peered":"2024-05-15T14:27:56.876526+0000","last_unstale":"2024-05-15T14:45:17.407312+0000","last_undegraded":"2024-05-15T14:45:17.407312+0000","last_fullsized":"2024-05-15T14:45:17.407312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:54.193440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"39'1087","reported_seq":2199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.228944+0000","last_change":"2024-05-15T14:27:58.887397+0000","last_active":"2024-05-15T14:48:26.228944+0000","last_peered":"2024-05-15T14:48:26.228944+0000","last_clean":"2024-05-15T14:48:26.228944+0000","last_became_active":"2024-05-15T14:27:58.887083+0000","last_became_peered":"2024-05-15T14:27:58.887083+0000","last_unstale":"2024-05-15T14:48:26.228944+0000","last_undegraded":"2024-05-15T14:48:26.228944+0000","last_fullsized":"2024-05-15T14:48:26.228944+0000","mapping_epoch":26,"log_start":"39'1000","ondisk_log_start":"39'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":1000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:41.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1707,"num_read_kb":1691,"num_write":402,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.521852+0000","last_change":"2024-05-15T14:28:00.890674+0000","last_active":"2024-05-15T14:46:47.521852+0000","last_peered":"2024-05-15T14:46:47.521852+0000","last_clean":"2024-05-15T14:46:47.521852+0000","last_became_active":"2024-05-15T14:28:00.890321+0000","last_became_peered":"2024-05-15T14:28:00.890321+0000","last_unstale":"2024-05-15T14:46:47.521852+0000","last_undegraded":"2024-05-15T14:46:47.521852+0000","last_fullsized":"2024-05-15T14:46:47.521852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:17.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"39'19","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.433552+0000","last_change":"2024-05-15T14:28:02.883575+0000","last_active":"2024-05-15T14:47:53.433552+0000","last_peered":"2024-05-15T14:47:53.433552+0000","last_clean":"2024-05-15T14:47:53.433552+0000","last_became_active":"2024-05-15T14:28:02.883249+0000","last_became_peered":"2024-05-15T14:28:02.883249+0000","last_unstale":"2024-05-15T14:47:53.433552+0000","last_undegraded":"2024-05-15T14:47:53.433552+0000","last_fullsized":"2024-05-15T14:47:53.433552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:15.023309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416034+0000","last_change":"2024-05-15T14:31:16.593784+0000","last_active":"2024-05-15T14:46:32.416034+0000","last_peered":"2024-05-15T14:46:32.416034+0000","last_clean":"2024-05-15T14:46:32.416034+0000","last_became_active":"2024-05-15T14:31:16.593500+0000","last_became_peered":"2024-05-15T14:31:16.593500+0000","last_unstale":"2024-05-15T14:46:32.416034+0000","last_undegraded":"2024-05-15T14:46:32.416034+0000","last_fullsized":"2024-05-15T14:46:32.416034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:01.704595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"39'14","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410547+0000","last_change":"2024-05-15T14:27:52.844475+0000","last_active":"2024-05-15T14:45:12.410547+0000","last_peered":"2024-05-15T14:45:12.410547+0000","last_clean":"2024-05-15T14:45:12.410547+0000","last_became_active":"2024-05-15T14:27:52.844149+0000","last_became_peered":"2024-05-15T14:27:52.844149+0000","last_unstale":"2024-05-15T14:45:12.410547+0000","last_undegraded":"2024-05-15T14:45:12.410547+0000","last_fullsized":"2024-05-15T14:45:12.410547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:37.250864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.508491+0000","last_change":"2024-05-15T14:27:45.305663+0000","last_active":"2024-05-15T14:46:27.508491+0000","last_peered":"2024-05-15T14:46:27.508491+0000","last_clean":"2024-05-15T14:46:27.508491+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:46:27.508491+0000","last_undegraded":"2024-05-15T14:46:27.508491+0000","last_fullsized":"2024-05-15T14:46:27.508491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.415809+0000","last_change":"2024-05-15T14:27:50.845090+0000","last_active":"2024-05-15T14:45:57.415809+0000","last_peered":"2024-05-15T14:45:57.415809+0000","last_clean":"2024-05-15T14:45:57.415809+0000","last_became_active":"2024-05-15T14:27:50.844771+0000","last_became_peered":"2024-05-15T14:27:50.844771+0000","last_unstale":"2024-05-15T14:45:57.415809+0000","last_undegraded":"2024-05-15T14:45:57.415809+0000","last_fullsized":"2024-05-15T14:45:57.415809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:04.000024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"39'12","reported_seq":720,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.907972+0000","last_change":"2024-05-15T14:27:56.880418+0000","last_active":"2024-05-15T14:48:25.907972+0000","last_peered":"2024-05-15T14:48:25.907972+0000","last_clean":"2024-05-15T14:48:25.907972+0000","last_became_active":"2024-05-15T14:27:56.880109+0000","last_became_peered":"2024-05-15T14:27:56.880109+0000","last_unstale":"2024-05-15T14:48:25.907972+0000","last_undegraded":"2024-05-15T14:48:25.907972+0000","last_fullsized":"2024-05-15T14:48:25.907972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:59.299924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":688,"num_read_kb":700,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"39'271","reported_seq":763,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.707634+0000","last_change":"2024-05-15T14:27:58.888770+0000","last_active":"2024-05-15T14:47:52.707634+0000","last_peered":"2024-05-15T14:47:52.707634+0000","last_clean":"2024-05-15T14:47:52.707634+0000","last_became_active":"2024-05-15T14:27:58.888477+0000","last_became_peered":"2024-05-15T14:27:58.888477+0000","last_unstale":"2024-05-15T14:47:52.707634+0000","last_undegraded":"2024-05-15T14:47:52.707634+0000","last_fullsized":"2024-05-15T14:47:52.707634+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:12.868288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":392,"num_write":265,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.423189+0000","last_change":"2024-05-15T14:28:00.880873+0000","last_active":"2024-05-15T14:46:47.423189+0000","last_peered":"2024-05-15T14:46:47.423189+0000","last_clean":"2024-05-15T14:46:47.423189+0000","last_became_active":"2024-05-15T14:28:00.880488+0000","last_became_peered":"2024-05-15T14:28:00.880488+0000","last_unstale":"2024-05-15T14:46:47.423189+0000","last_undegraded":"2024-05-15T14:46:47.423189+0000","last_fullsized":"2024-05-15T14:46:47.423189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:05.734987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'21","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.357011+0000","last_change":"2024-05-15T14:28:02.894486+0000","last_active":"2024-05-15T14:46:21.357011+0000","last_peered":"2024-05-15T14:46:21.357011+0000","last_clean":"2024-05-15T14:46:21.357011+0000","last_became_active":"2024-05-15T14:28:02.893812+0000","last_became_peered":"2024-05-15T14:28:02.893812+0000","last_unstale":"2024-05-15T14:46:21.357011+0000","last_undegraded":"2024-05-15T14:46:21.357011+0000","last_fullsized":"2024-05-15T14:46:21.357011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:44.592465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":112,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.420985+0000","last_change":"2024-05-15T14:31:16.589892+0000","last_active":"2024-05-15T14:46:27.420985+0000","last_peered":"2024-05-15T14:46:27.420985+0000","last_clean":"2024-05-15T14:46:27.420985+0000","last_became_active":"2024-05-15T14:31:16.589610+0000","last_became_peered":"2024-05-15T14:31:16.589610+0000","last_unstale":"2024-05-15T14:46:27.420985+0000","last_undegraded":"2024-05-15T14:46:27.420985+0000","last_fullsized":"2024-05-15T14:46:27.420985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:19:18.238793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"39'4","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421245+0000","last_change":"2024-05-15T14:27:52.840002+0000","last_active":"2024-05-15T14:46:37.421245+0000","last_peered":"2024-05-15T14:46:37.421245+0000","last_clean":"2024-05-15T14:46:37.421245+0000","last_became_active":"2024-05-15T14:27:52.839722+0000","last_became_peered":"2024-05-15T14:27:52.839722+0000","last_unstale":"2024-05-15T14:46:37.421245+0000","last_undegraded":"2024-05-15T14:46:37.421245+0000","last_fullsized":"2024-05-15T14:46:37.421245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:19.868710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416067+0000","last_change":"2024-05-15T14:27:44.810023+0000","last_active":"2024-05-15T14:46:32.416067+0000","last_peered":"2024-05-15T14:46:32.416067+0000","last_clean":"2024-05-15T14:46:32.416067+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:46:32.416067+0000","last_undegraded":"2024-05-15T14:46:32.416067+0000","last_fullsized":"2024-05-15T14:46:32.416067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'16","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416855+0000","last_change":"2024-05-15T14:27:50.837385+0000","last_active":"2024-05-15T14:46:37.416855+0000","last_peered":"2024-05-15T14:46:37.416855+0000","last_clean":"2024-05-15T14:46:37.416855+0000","last_became_active":"2024-05-15T14:27:50.836731+0000","last_became_peered":"2024-05-15T14:27:50.836731+0000","last_unstale":"2024-05-15T14:46:37.416855+0000","last_undegraded":"2024-05-15T14:46:37.416855+0000","last_fullsized":"2024-05-15T14:46:37.416855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.423213+0000","last_change":"2024-05-15T14:27:56.880397+0000","last_active":"2024-05-15T14:46:47.423213+0000","last_peered":"2024-05-15T14:46:47.423213+0000","last_clean":"2024-05-15T14:46:47.423213+0000","last_became_active":"2024-05-15T14:27:56.880118+0000","last_became_peered":"2024-05-15T14:27:56.880118+0000","last_unstale":"2024-05-15T14:46:47.423213+0000","last_undegraded":"2024-05-15T14:46:47.423213+0000","last_fullsized":"2024-05-15T14:46:47.423213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:58.838634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"39'330","reported_seq":83275,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.651627+0000","last_change":"2024-05-15T14:27:58.882371+0000","last_active":"2024-05-15T14:47:52.651627+0000","last_peered":"2024-05-15T14:47:52.651627+0000","last_clean":"2024-05-15T14:47:52.651627+0000","last_became_active":"2024-05-15T14:27:58.882039+0000","last_became_peered":"2024-05-15T14:27:58.882039+0000","last_unstale":"2024-05-15T14:47:52.651627+0000","last_undegraded":"2024-05-15T14:47:52.651627+0000","last_fullsized":"2024-05-15T14:47:52.651627+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:34.425254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207654,"num_read_kb":557003,"num_write":353,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.407638+0000","last_change":"2024-05-15T14:28:00.887372+0000","last_active":"2024-05-15T14:45:22.407638+0000","last_peered":"2024-05-15T14:45:22.407638+0000","last_clean":"2024-05-15T14:45:22.407638+0000","last_became_active":"2024-05-15T14:28:00.887095+0000","last_became_peered":"2024-05-15T14:28:00.887095+0000","last_unstale":"2024-05-15T14:45:22.407638+0000","last_undegraded":"2024-05-15T14:45:22.407638+0000","last_fullsized":"2024-05-15T14:45:22.407638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:30.018180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"39'14","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.259616+0000","last_change":"2024-05-15T14:28:02.892539+0000","last_active":"2024-05-15T14:46:21.259616+0000","last_peered":"2024-05-15T14:46:21.259616+0000","last_clean":"2024-05-15T14:46:21.259616+0000","last_became_active":"2024-05-15T14:28:02.892255+0000","last_became_peered":"2024-05-15T14:28:02.892255+0000","last_unstale":"2024-05-15T14:46:21.259616+0000","last_undegraded":"2024-05-15T14:46:21.259616+0000","last_fullsized":"2024-05-15T14:46:21.259616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:27.053905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.404020+0000","last_change":"2024-05-15T14:31:16.593868+0000","last_active":"2024-05-15T14:44:52.404020+0000","last_peered":"2024-05-15T14:44:52.404020+0000","last_clean":"2024-05-15T14:44:52.404020+0000","last_became_active":"2024-05-15T14:31:16.593582+0000","last_became_peered":"2024-05-15T14:31:16.593582+0000","last_unstale":"2024-05-15T14:44:52.404020+0000","last_undegraded":"2024-05-15T14:44:52.404020+0000","last_fullsized":"2024-05-15T14:44:52.404020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:38:46.732341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'44","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327700+0000","last_change":"2024-05-15T14:27:52.851444+0000","last_active":"2024-05-15T14:47:54.327700+0000","last_peered":"2024-05-15T14:47:54.327700+0000","last_clean":"2024-05-15T14:47:54.327700+0000","last_became_active":"2024-05-15T14:27:52.851166+0000","last_became_peered":"2024-05-15T14:27:52.851166+0000","last_unstale":"2024-05-15T14:47:54.327700+0000","last_undegraded":"2024-05-15T14:47:54.327700+0000","last_fullsized":"2024-05-15T14:47:54.327700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:55.341565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":125,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"39'8","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.286095+0000","last_change":"2024-05-15T14:28:37.941507+0000","last_active":"2024-05-15T14:47:54.286095+0000","last_peered":"2024-05-15T14:47:54.286095+0000","last_clean":"2024-05-15T14:47:54.286095+0000","last_became_active":"2024-05-15T14:28:37.941149+0000","last_became_peered":"2024-05-15T14:28:37.941149+0000","last_unstale":"2024-05-15T14:47:54.286095+0000","last_undegraded":"2024-05-15T14:47:54.286095+0000","last_fullsized":"2024-05-15T14:47:54.286095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:15.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11,"num_write":32,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420426+0000","last_change":"2024-05-15T14:27:45.305199+0000","last_active":"2024-05-15T14:46:32.420426+0000","last_peered":"2024-05-15T14:46:32.420426+0000","last_clean":"2024-05-15T14:46:32.420426+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:46:32.420426+0000","last_undegraded":"2024-05-15T14:46:32.420426+0000","last_fullsized":"2024-05-15T14:46:32.420426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.422662+0000","last_change":"2024-05-15T14:27:56.881338+0000","last_active":"2024-05-15T14:46:42.422662+0000","last_peered":"2024-05-15T14:46:42.422662+0000","last_clean":"2024-05-15T14:46:42.422662+0000","last_became_active":"2024-05-15T14:27:56.881083+0000","last_became_peered":"2024-05-15T14:27:56.881083+0000","last_unstale":"2024-05-15T14:46:42.422662+0000","last_undegraded":"2024-05-15T14:46:42.422662+0000","last_fullsized":"2024-05-15T14:46:42.422662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:32.643557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"39'477","reported_seq":926,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.069846+0000","last_change":"2024-05-15T14:27:58.884245+0000","last_active":"2024-05-15T14:48:26.069846+0000","last_peered":"2024-05-15T14:48:26.069846+0000","last_clean":"2024-05-15T14:48:26.069846+0000","last_became_active":"2024-05-15T14:27:58.883886+0000","last_became_peered":"2024-05-15T14:27:58.883886+0000","last_unstale":"2024-05-15T14:48:26.069846+0000","last_undegraded":"2024-05-15T14:48:26.069846+0000","last_fullsized":"2024-05-15T14:48:26.069846+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:12.868288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1019,"num_read_kb":1275,"num_write":493,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418087+0000","last_change":"2024-05-15T14:28:00.884599+0000","last_active":"2024-05-15T14:46:47.418087+0000","last_peered":"2024-05-15T14:46:47.418087+0000","last_clean":"2024-05-15T14:46:47.418087+0000","last_became_active":"2024-05-15T14:28:00.884315+0000","last_became_peered":"2024-05-15T14:28:00.884315+0000","last_unstale":"2024-05-15T14:46:47.418087+0000","last_undegraded":"2024-05-15T14:46:47.418087+0000","last_fullsized":"2024-05-15T14:46:47.418087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:29.042984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"39'35","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.812135+0000","last_change":"2024-05-15T14:28:02.889405+0000","last_active":"2024-05-15T14:47:53.812135+0000","last_peered":"2024-05-15T14:47:53.812135+0000","last_clean":"2024-05-15T14:47:53.812135+0000","last_became_active":"2024-05-15T14:28:02.889093+0000","last_became_peered":"2024-05-15T14:28:02.889093+0000","last_unstale":"2024-05-15T14:47:53.812135+0000","last_undegraded":"2024-05-15T14:47:53.812135+0000","last_fullsized":"2024-05-15T14:47:53.812135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:25.077865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":151,"num_write":63,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.500408+0000","last_change":"2024-05-15T14:31:38.627137+0000","last_active":"2024-05-15T14:45:12.500408+0000","last_peered":"2024-05-15T14:45:12.500408+0000","last_clean":"2024-05-15T14:45:12.500408+0000","last_became_active":"2024-05-15T14:31:38.626777+0000","last_became_peered":"2024-05-15T14:31:38.626777+0000","last_unstale":"2024-05-15T14:45:12.500408+0000","last_undegraded":"2024-05-15T14:45:12.500408+0000","last_fullsized":"2024-05-15T14:45:12.500408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:25.663025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'50","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422119+0000","last_change":"2024-05-15T14:27:52.846446+0000","last_active":"2024-05-15T14:46:37.422119+0000","last_peered":"2024-05-15T14:46:37.422119+0000","last_clean":"2024-05-15T14:46:37.422119+0000","last_became_active":"2024-05-15T14:27:52.846171+0000","last_became_peered":"2024-05-15T14:27:52.846171+0000","last_unstale":"2024-05-15T14:46:37.422119+0000","last_undegraded":"2024-05-15T14:46:37.422119+0000","last_fullsized":"2024-05-15T14:46:37.422119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":163,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421256+0000","last_change":"2024-05-15T14:27:50.845054+0000","last_active":"2024-05-15T14:46:37.421256+0000","last_peered":"2024-05-15T14:46:37.421256+0000","last_clean":"2024-05-15T14:46:37.421256+0000","last_became_active":"2024-05-15T14:27:50.844741+0000","last_became_peered":"2024-05-15T14:27:50.844741+0000","last_unstale":"2024-05-15T14:46:37.421256+0000","last_undegraded":"2024-05-15T14:46:37.421256+0000","last_fullsized":"2024-05-15T14:46:37.421256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:59:36.164522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":80,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519875+0000","last_change":"2024-05-15T14:27:45.305329+0000","last_active":"2024-05-15T14:46:32.519875+0000","last_peered":"2024-05-15T14:46:32.519875+0000","last_clean":"2024-05-15T14:46:32.519875+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:46:32.519875+0000","last_undegraded":"2024-05-15T14:46:32.519875+0000","last_fullsized":"2024-05-15T14:46:32.519875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:38:59.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416750+0000","last_change":"2024-05-15T14:27:56.881115+0000","last_active":"2024-05-15T14:46:42.416750+0000","last_peered":"2024-05-15T14:46:42.416750+0000","last_clean":"2024-05-15T14:46:42.416750+0000","last_became_active":"2024-05-15T14:27:56.880842+0000","last_became_peered":"2024-05-15T14:27:56.880842+0000","last_unstale":"2024-05-15T14:46:42.416750+0000","last_undegraded":"2024-05-15T14:46:42.416750+0000","last_fullsized":"2024-05-15T14:46:42.416750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:23.904400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"39'491","reported_seq":504318,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.715981+0000","last_change":"2024-05-15T14:27:58.882555+0000","last_active":"2024-05-15T14:47:52.715981+0000","last_peered":"2024-05-15T14:47:52.715981+0000","last_clean":"2024-05-15T14:47:52.715981+0000","last_became_active":"2024-05-15T14:27:58.882284+0000","last_became_peered":"2024-05-15T14:27:58.882284+0000","last_unstale":"2024-05-15T14:47:52.715981+0000","last_undegraded":"2024-05-15T14:47:52.715981+0000","last_fullsized":"2024-05-15T14:47:52.715981+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:50.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1259744,"num_read_kb":3777635,"num_write":703,"num_write_kb":2009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"39'924","reported_seq":1369,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.088738+0000","last_change":"2024-05-15T14:28:00.892454+0000","last_active":"2024-05-15T14:48:26.088738+0000","last_peered":"2024-05-15T14:48:26.088738+0000","last_clean":"2024-05-15T14:48:26.088738+0000","last_became_active":"2024-05-15T14:28:00.891484+0000","last_became_peered":"2024-05-15T14:28:00.891484+0000","last_unstale":"2024-05-15T14:48:26.088738+0000","last_undegraded":"2024-05-15T14:48:26.088738+0000","last_fullsized":"2024-05-15T14:48:26.088738+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:42.711145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"39'18","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.426893+0000","last_change":"2024-05-15T14:28:02.891735+0000","last_active":"2024-05-15T14:47:52.426893+0000","last_peered":"2024-05-15T14:47:52.426893+0000","last_clean":"2024-05-15T14:47:52.426893+0000","last_became_active":"2024-05-15T14:28:02.891380+0000","last_became_peered":"2024-05-15T14:28:02.891380+0000","last_unstale":"2024-05-15T14:47:52.426893+0000","last_undegraded":"2024-05-15T14:47:52.426893+0000","last_fullsized":"2024-05-15T14:47:52.426893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:22.867716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":35,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.505963+0000","last_change":"2024-05-15T14:31:16.594082+0000","last_active":"2024-05-15T14:44:47.505963+0000","last_peered":"2024-05-15T14:44:47.505963+0000","last_clean":"2024-05-15T14:44:47.505963+0000","last_became_active":"2024-05-15T14:31:16.593811+0000","last_became_peered":"2024-05-15T14:31:16.593811+0000","last_unstale":"2024-05-15T14:44:47.505963+0000","last_undegraded":"2024-05-15T14:44:47.505963+0000","last_fullsized":"2024-05-15T14:44:47.505963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:50:49.314475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"39'18","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509629+0000","last_change":"2024-05-15T14:28:37.942802+0000","last_active":"2024-05-15T14:46:37.509629+0000","last_peered":"2024-05-15T14:46:37.509629+0000","last_clean":"2024-05-15T14:46:37.509629+0000","last_became_active":"2024-05-15T14:28:37.942459+0000","last_became_peered":"2024-05-15T14:28:37.942459+0000","last_unstale":"2024-05-15T14:46:37.509629+0000","last_undegraded":"2024-05-15T14:46:37.509629+0000","last_fullsized":"2024-05-15T14:46:37.509629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512553+0000","last_change":"2024-05-15T14:27:50.854562+0000","last_active":"2024-05-15T14:45:12.512553+0000","last_peered":"2024-05-15T14:45:12.512553+0000","last_clean":"2024-05-15T14:45:12.512553+0000","last_became_active":"2024-05-15T14:27:50.854248+0000","last_became_peered":"2024-05-15T14:27:50.854248+0000","last_unstale":"2024-05-15T14:45:12.512553+0000","last_undegraded":"2024-05-15T14:45:12.512553+0000","last_fullsized":"2024-05-15T14:45:12.512553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:38.281851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":50,"num_write_kb":8823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:02.409522+0000","last_change":"2024-05-15T14:27:44.808690+0000","last_active":"2024-05-15T14:45:02.409522+0000","last_peered":"2024-05-15T14:45:02.409522+0000","last_clean":"2024-05-15T14:45:02.409522+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:45:02.409522+0000","last_undegraded":"2024-05-15T14:45:02.409522+0000","last_fullsized":"2024-05-15T14:45:02.409522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'1","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.417441+0000","last_change":"2024-05-15T14:27:56.876363+0000","last_active":"2024-05-15T14:46:42.417441+0000","last_peered":"2024-05-15T14:46:42.417441+0000","last_clean":"2024-05-15T14:46:42.417441+0000","last_became_active":"2024-05-15T14:27:56.875993+0000","last_became_peered":"2024-05-15T14:27:56.875993+0000","last_unstale":"2024-05-15T14:46:42.417441+0000","last_undegraded":"2024-05-15T14:46:42.417441+0000","last_fullsized":"2024-05-15T14:46:42.417441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"39'225","reported_seq":383,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.703454+0000","last_change":"2024-05-15T14:27:58.885451+0000","last_active":"2024-05-15T14:47:52.703454+0000","last_peered":"2024-05-15T14:47:52.703454+0000","last_clean":"2024-05-15T14:47:52.703454+0000","last_became_active":"2024-05-15T14:27:58.885090+0000","last_became_peered":"2024-05-15T14:27:58.885090+0000","last_unstale":"2024-05-15T14:47:52.703454+0000","last_undegraded":"2024-05-15T14:47:52.703454+0000","last_fullsized":"2024-05-15T14:47:52.703454+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.266839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"39'924","reported_seq":1442,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.234813+0000","last_change":"2024-05-15T14:28:00.887968+0000","last_active":"2024-05-15T14:48:26.234813+0000","last_peered":"2024-05-15T14:48:26.234813+0000","last_clean":"2024-05-15T14:48:26.234813+0000","last_became_active":"2024-05-15T14:28:00.884286+0000","last_became_peered":"2024-05-15T14:28:00.884286+0000","last_unstale":"2024-05-15T14:48:26.234813+0000","last_undegraded":"2024-05-15T14:48:26.234813+0000","last_fullsized":"2024-05-15T14:48:26.234813+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:52.523948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"39'24","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.774098+0000","last_change":"2024-05-15T14:28:02.892844+0000","last_active":"2024-05-15T14:47:53.774098+0000","last_peered":"2024-05-15T14:47:53.774098+0000","last_clean":"2024-05-15T14:47:53.774098+0000","last_became_active":"2024-05-15T14:28:02.891822+0000","last_became_peered":"2024-05-15T14:28:02.891822+0000","last_unstale":"2024-05-15T14:47:53.774098+0000","last_undegraded":"2024-05-15T14:47:53.774098+0000","last_fullsized":"2024-05-15T14:47:53.774098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.509354+0000","last_change":"2024-05-15T14:31:16.596256+0000","last_active":"2024-05-15T14:44:47.509354+0000","last_peered":"2024-05-15T14:44:47.509354+0000","last_clean":"2024-05-15T14:44:47.509354+0000","last_became_active":"2024-05-15T14:31:16.595913+0000","last_became_peered":"2024-05-15T14:31:16.595913+0000","last_unstale":"2024-05-15T14:44:47.509354+0000","last_undegraded":"2024-05-15T14:44:47.509354+0000","last_fullsized":"2024-05-15T14:44:47.509354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:23:10.278842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"39'16","reported_seq":115,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416789+0000","last_change":"2024-05-15T14:27:52.848596+0000","last_active":"2024-05-15T14:46:37.416789+0000","last_peered":"2024-05-15T14:46:37.416789+0000","last_clean":"2024-05-15T14:46:37.416789+0000","last_became_active":"2024-05-15T14:27:52.848087+0000","last_became_peered":"2024-05-15T14:27:52.848087+0000","last_unstale":"2024-05-15T14:46:37.416789+0000","last_undegraded":"2024-05-15T14:46:37.416789+0000","last_fullsized":"2024-05-15T14:46:37.416789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.412695+0000","last_change":"2024-05-15T14:27:50.840684+0000","last_active":"2024-05-15T14:45:12.412695+0000","last_peered":"2024-05-15T14:45:12.412695+0000","last_clean":"2024-05-15T14:45:12.412695+0000","last_became_active":"2024-05-15T14:27:50.840365+0000","last_became_peered":"2024-05-15T14:27:50.840365+0000","last_unstale":"2024-05-15T14:45:12.412695+0000","last_undegraded":"2024-05-15T14:45:12.412695+0000","last_fullsized":"2024-05-15T14:45:12.412695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:31.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:07.405827+0000","last_change":"2024-05-15T14:27:44.808595+0000","last_active":"2024-05-15T14:45:07.405827+0000","last_peered":"2024-05-15T14:45:07.405827+0000","last_clean":"2024-05-15T14:45:07.405827+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:45:07.405827+0000","last_undegraded":"2024-05-15T14:45:07.405827+0000","last_fullsized":"2024-05-15T14:45:07.405827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"39'12","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.595287+0000","last_change":"2024-05-15T14:27:56.875443+0000","last_active":"2024-05-15T14:47:21.595287+0000","last_peered":"2024-05-15T14:47:21.595287+0000","last_clean":"2024-05-15T14:47:21.595287+0000","last_became_active":"2024-05-15T14:27:56.875166+0000","last_became_peered":"2024-05-15T14:27:56.875166+0000","last_unstale":"2024-05-15T14:47:21.595287+0000","last_undegraded":"2024-05-15T14:47:21.595287+0000","last_fullsized":"2024-05-15T14:47:21.595287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'539","reported_seq":951,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.019444+0000","last_change":"2024-05-15T14:27:58.881816+0000","last_active":"2024-05-15T14:48:26.019444+0000","last_peered":"2024-05-15T14:48:26.019444+0000","last_clean":"2024-05-15T14:48:26.019444+0000","last_became_active":"2024-05-15T14:27:58.881529+0000","last_became_peered":"2024-05-15T14:27:58.881529+0000","last_unstale":"2024-05-15T14:48:26.019444+0000","last_undegraded":"2024-05-15T14:48:26.019444+0000","last_fullsized":"2024-05-15T14:48:26.019444+0000","mapping_epoch":26,"log_start":"39'500","ondisk_log_start":"39'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:44.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":949,"num_read_kb":979,"num_write":696,"num_write_kb":2669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.526053+0000","last_change":"2024-05-15T14:28:00.892129+0000","last_active":"2024-05-15T14:46:47.526053+0000","last_peered":"2024-05-15T14:46:47.526053+0000","last_clean":"2024-05-15T14:46:47.526053+0000","last_became_active":"2024-05-15T14:28:00.890685+0000","last_became_peered":"2024-05-15T14:28:00.890685+0000","last_unstale":"2024-05-15T14:46:47.526053+0000","last_undegraded":"2024-05-15T14:46:47.526053+0000","last_fullsized":"2024-05-15T14:46:47.526053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:33.793001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"39'29","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.787639+0000","last_change":"2024-05-15T14:28:02.893523+0000","last_active":"2024-05-15T14:47:53.787639+0000","last_peered":"2024-05-15T14:47:53.787639+0000","last_clean":"2024-05-15T14:47:53.787639+0000","last_became_active":"2024-05-15T14:28:02.893174+0000","last_became_peered":"2024-05-15T14:28:02.893174+0000","last_unstale":"2024-05-15T14:47:53.787639+0000","last_undegraded":"2024-05-15T14:47:53.787639+0000","last_fullsized":"2024-05-15T14:47:53.787639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.413812+0000","last_change":"2024-05-15T14:31:16.593175+0000","last_active":"2024-05-15T14:45:22.413812+0000","last_peered":"2024-05-15T14:45:22.413812+0000","last_clean":"2024-05-15T14:45:22.413812+0000","last_became_active":"2024-05-15T14:31:16.592898+0000","last_became_peered":"2024-05-15T14:31:16.592898+0000","last_unstale":"2024-05-15T14:45:22.413812+0000","last_undegraded":"2024-05-15T14:45:22.413812+0000","last_fullsized":"2024-05-15T14:45:22.413812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:15.668825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'26","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.789319+0000","last_change":"2024-05-15T14:28:02.893742+0000","last_active":"2024-05-15T14:47:53.789319+0000","last_peered":"2024-05-15T14:47:53.789319+0000","last_clean":"2024-05-15T14:47:53.789319+0000","last_became_active":"2024-05-15T14:28:02.892547+0000","last_became_peered":"2024-05-15T14:28:02.892547+0000","last_unstale":"2024-05-15T14:47:53.789319+0000","last_undegraded":"2024-05-15T14:47:53.789319+0000","last_fullsized":"2024-05-15T14:47:53.789319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:30:24.259350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":37,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"39'44","reported_seq":129,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416184+0000","last_change":"2024-05-15T14:27:52.842978+0000","last_active":"2024-05-15T14:46:32.416184+0000","last_peered":"2024-05-15T14:46:32.416184+0000","last_clean":"2024-05-15T14:46:32.416184+0000","last_became_active":"2024-05-15T14:27:52.842733+0000","last_became_peered":"2024-05-15T14:27:52.842733+0000","last_unstale":"2024-05-15T14:46:32.416184+0000","last_undegraded":"2024-05-15T14:46:32.416184+0000","last_fullsized":"2024-05-15T14:46:32.416184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":143,"num_write":62,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"39'22","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:17.514606+0000","last_change":"2024-05-15T14:28:37.941321+0000","last_active":"2024-05-15T14:47:17.514606+0000","last_peered":"2024-05-15T14:47:17.514606+0000","last_clean":"2024-05-15T14:47:17.514606+0000","last_became_active":"2024-05-15T14:28:37.940961+0000","last_became_peered":"2024-05-15T14:28:37.940961+0000","last_unstale":"2024-05-15T14:47:17.514606+0000","last_undegraded":"2024-05-15T14:47:17.514606+0000","last_fullsized":"2024-05-15T14:47:17.514606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:20.511289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":33493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'2","reported_seq":1004,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.918986+0000","last_change":"2024-05-15T14:27:56.879335+0000","last_active":"2024-05-15T14:48:25.918986+0000","last_peered":"2024-05-15T14:48:25.918986+0000","last_clean":"2024-05-15T14:48:25.918986+0000","last_became_active":"2024-05-15T14:27:56.879047+0000","last_became_peered":"2024-05-15T14:27:56.879047+0000","last_unstale":"2024-05-15T14:48:25.918986+0000","last_undegraded":"2024-05-15T14:48:25.918986+0000","last_fullsized":"2024-05-15T14:48:25.918986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:55.716648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"39'700","reported_seq":1150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.045495+0000","last_change":"2024-05-15T14:27:58.882036+0000","last_active":"2024-05-15T14:48:26.045495+0000","last_peered":"2024-05-15T14:48:26.045495+0000","last_clean":"2024-05-15T14:48:26.045495+0000","last_became_active":"2024-05-15T14:27:58.881703+0000","last_became_peered":"2024-05-15T14:27:58.881703+0000","last_unstale":"2024-05-15T14:48:26.045495+0000","last_undegraded":"2024-05-15T14:48:26.045495+0000","last_fullsized":"2024-05-15T14:48:26.045495+0000","mapping_epoch":26,"log_start":"39'600","ondisk_log_start":"39'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1566,"num_read_kb":3600,"num_write":907,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.505836+0000","last_change":"2024-05-15T14:28:00.884111+0000","last_active":"2024-05-15T14:44:22.505836+0000","last_peered":"2024-05-15T14:44:22.505836+0000","last_clean":"2024-05-15T14:44:22.505836+0000","last_became_active":"2024-05-15T14:28:00.883811+0000","last_became_peered":"2024-05-15T14:28:00.883811+0000","last_unstale":"2024-05-15T14:44:22.505836+0000","last_undegraded":"2024-05-15T14:44:22.505836+0000","last_fullsized":"2024-05-15T14:44:22.505836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:25.050335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.415259+0000","last_change":"2024-05-15T14:31:16.592460+0000","last_active":"2024-05-15T14:45:52.415259+0000","last_peered":"2024-05-15T14:45:52.415259+0000","last_clean":"2024-05-15T14:45:52.415259+0000","last_became_active":"2024-05-15T14:31:16.592053+0000","last_became_peered":"2024-05-15T14:31:16.592053+0000","last_unstale":"2024-05-15T14:45:52.415259+0000","last_undegraded":"2024-05-15T14:45:52.415259+0000","last_fullsized":"2024-05-15T14:45:52.415259+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:36.246607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"39'29","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.772545+0000","last_change":"2024-05-15T14:28:02.894336+0000","last_active":"2024-05-15T14:47:53.772545+0000","last_peered":"2024-05-15T14:47:53.772545+0000","last_clean":"2024-05-15T14:47:53.772545+0000","last_became_active":"2024-05-15T14:28:02.894053+0000","last_became_peered":"2024-05-15T14:28:02.894053+0000","last_unstale":"2024-05-15T14:47:53.772545+0000","last_undegraded":"2024-05-15T14:47:53.772545+0000","last_fullsized":"2024-05-15T14:47:53.772545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:49:32.038155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"39'12","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420386+0000","last_change":"2024-05-15T14:27:52.849694+0000","last_active":"2024-05-15T14:46:32.420386+0000","last_peered":"2024-05-15T14:46:32.420386+0000","last_clean":"2024-05-15T14:46:32.420386+0000","last_became_active":"2024-05-15T14:27:52.849013+0000","last_became_peered":"2024-05-15T14:27:52.849013+0000","last_unstale":"2024-05-15T14:46:32.420386+0000","last_undegraded":"2024-05-15T14:46:32.420386+0000","last_fullsized":"2024-05-15T14:46:32.420386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:16.565935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"39'12","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.505977+0000","last_change":"2024-05-15T14:27:50.853302+0000","last_active":"2024-05-15T14:44:47.505977+0000","last_peered":"2024-05-15T14:44:47.505977+0000","last_clean":"2024-05-15T14:44:47.505977+0000","last_became_active":"2024-05-15T14:27:50.852755+0000","last_became_peered":"2024-05-15T14:27:50.852755+0000","last_unstale":"2024-05-15T14:44:47.505977+0000","last_undegraded":"2024-05-15T14:44:47.505977+0000","last_fullsized":"2024-05-15T14:44:47.505977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.505272+0000","last_change":"2024-05-15T14:27:56.883749+0000","last_active":"2024-05-15T14:44:17.505272+0000","last_peered":"2024-05-15T14:44:17.505272+0000","last_clean":"2024-05-15T14:44:17.505272+0000","last_became_active":"2024-05-15T14:27:56.883312+0000","last_became_peered":"2024-05-15T14:27:56.883312+0000","last_unstale":"2024-05-15T14:44:17.505272+0000","last_undegraded":"2024-05-15T14:44:17.505272+0000","last_fullsized":"2024-05-15T14:44:17.505272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'158","reported_seq":222582,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.527715+0000","last_change":"2024-05-15T14:27:58.884965+0000","last_active":"2024-05-15T14:47:52.527715+0000","last_peered":"2024-05-15T14:47:52.527715+0000","last_clean":"2024-05-15T14:47:52.527715+0000","last_became_active":"2024-05-15T14:27:58.884647+0000","last_became_peered":"2024-05-15T14:27:58.884647+0000","last_unstale":"2024-05-15T14:47:52.527715+0000","last_undegraded":"2024-05-15T14:47:52.527715+0000","last_fullsized":"2024-05-15T14:47:52.527715+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:11.016089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555956,"num_read_kb":2334405,"num_write":176,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.502471+0000","last_change":"2024-05-15T14:28:00.889155+0000","last_active":"2024-05-15T14:44:22.502471+0000","last_peered":"2024-05-15T14:44:22.502471+0000","last_clean":"2024-05-15T14:44:22.502471+0000","last_became_active":"2024-05-15T14:28:00.888834+0000","last_became_peered":"2024-05-15T14:28:00.888834+0000","last_unstale":"2024-05-15T14:44:22.502471+0000","last_undegraded":"2024-05-15T14:44:22.502471+0000","last_fullsized":"2024-05-15T14:44:22.502471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:51.080731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.419945+0000","last_change":"2024-05-15T14:31:16.594403+0000","last_active":"2024-05-15T14:46:17.419945+0000","last_peered":"2024-05-15T14:46:17.419945+0000","last_clean":"2024-05-15T14:46:17.419945+0000","last_became_active":"2024-05-15T14:31:16.594114+0000","last_became_peered":"2024-05-15T14:31:16.594114+0000","last_unstale":"2024-05-15T14:46:17.419945+0000","last_undegraded":"2024-05-15T14:46:17.419945+0000","last_fullsized":"2024-05-15T14:46:17.419945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:24.367502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"39'28","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.331459+0000","last_change":"2024-05-15T14:28:02.890351+0000","last_active":"2024-05-15T14:47:54.331459+0000","last_peered":"2024-05-15T14:47:54.331459+0000","last_clean":"2024-05-15T14:47:54.331459+0000","last_became_active":"2024-05-15T14:28:02.890071+0000","last_became_peered":"2024-05-15T14:28:02.890071+0000","last_unstale":"2024-05-15T14:47:54.331459+0000","last_undegraded":"2024-05-15T14:47:54.331459+0000","last_fullsized":"2024-05-15T14:47:54.331459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":114,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'10","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.523980+0000","last_change":"2024-05-15T14:27:52.852243+0000","last_active":"2024-05-15T14:46:32.523980+0000","last_peered":"2024-05-15T14:46:32.523980+0000","last_clean":"2024-05-15T14:46:32.523980+0000","last_became_active":"2024-05-15T14:27:52.851940+0000","last_became_peered":"2024-05-15T14:27:52.851940+0000","last_unstale":"2024-05-15T14:46:32.523980+0000","last_undegraded":"2024-05-15T14:46:32.523980+0000","last_fullsized":"2024-05-15T14:46:32.523980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403389+0000","last_change":"2024-05-15T14:27:50.846653+0000","last_active":"2024-05-15T14:44:47.403389+0000","last_peered":"2024-05-15T14:44:47.403389+0000","last_clean":"2024-05-15T14:44:47.403389+0000","last_became_active":"2024-05-15T14:27:50.846362+0000","last_became_peered":"2024-05-15T14:27:50.846362+0000","last_unstale":"2024-05-15T14:44:47.403389+0000","last_undegraded":"2024-05-15T14:44:47.403389+0000","last_fullsized":"2024-05-15T14:44:47.403389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"39'11","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.464655+0000","last_change":"2024-05-15T14:27:56.878406+0000","last_active":"2024-05-15T14:47:21.464655+0000","last_peered":"2024-05-15T14:47:21.464655+0000","last_clean":"2024-05-15T14:47:21.464655+0000","last_became_active":"2024-05-15T14:27:56.877413+0000","last_became_peered":"2024-05-15T14:27:56.877413+0000","last_unstale":"2024-05-15T14:47:21.464655+0000","last_undegraded":"2024-05-15T14:47:21.464655+0000","last_fullsized":"2024-05-15T14:47:21.464655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:59.085552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"39'246","reported_seq":460,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.003273+0000","last_change":"2024-05-15T14:27:58.881927+0000","last_active":"2024-05-15T14:48:26.003273+0000","last_peered":"2024-05-15T14:48:26.003273+0000","last_clean":"2024-05-15T14:48:26.003273+0000","last_became_active":"2024-05-15T14:27:58.881581+0000","last_became_peered":"2024-05-15T14:27:58.881581+0000","last_unstale":"2024-05-15T14:48:26.003273+0000","last_undegraded":"2024-05-15T14:48:26.003273+0000","last_fullsized":"2024-05-15T14:48:26.003273+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:40.707496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":385,"num_write":222,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.400519+0000","last_change":"2024-05-15T14:28:00.888057+0000","last_active":"2024-05-15T14:44:22.400519+0000","last_peered":"2024-05-15T14:44:22.400519+0000","last_clean":"2024-05-15T14:44:22.400519+0000","last_became_active":"2024-05-15T14:28:00.887738+0000","last_became_peered":"2024-05-15T14:28:00.887738+0000","last_unstale":"2024-05-15T14:44:22.400519+0000","last_undegraded":"2024-05-15T14:44:22.400519+0000","last_fullsized":"2024-05-15T14:44:22.400519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:59.723993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.419981+0000","last_change":"2024-05-15T14:31:16.591389+0000","last_active":"2024-05-15T14:46:17.419981+0000","last_peered":"2024-05-15T14:46:17.419981+0000","last_clean":"2024-05-15T14:46:17.419981+0000","last_became_active":"2024-05-15T14:31:16.590502+0000","last_became_peered":"2024-05-15T14:31:16.590502+0000","last_unstale":"2024-05-15T14:46:17.419981+0000","last_undegraded":"2024-05-15T14:46:17.419981+0000","last_fullsized":"2024-05-15T14:46:17.419981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:58:48.832872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'26","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.780086+0000","last_change":"2024-05-15T14:28:02.895306+0000","last_active":"2024-05-15T14:47:53.780086+0000","last_peered":"2024-05-15T14:47:53.780086+0000","last_clean":"2024-05-15T14:47:53.780086+0000","last_became_active":"2024-05-15T14:28:02.894280+0000","last_became_peered":"2024-05-15T14:28:02.894280+0000","last_unstale":"2024-05-15T14:47:53.780086+0000","last_undegraded":"2024-05-15T14:47:53.780086+0000","last_fullsized":"2024-05-15T14:47:53.780086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"39'66","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814583+0000","last_change":"2024-05-15T14:27:52.862502+0000","last_active":"2024-05-15T14:47:53.814583+0000","last_peered":"2024-05-15T14:47:53.814583+0000","last_clean":"2024-05-15T14:47:53.814583+0000","last_became_active":"2024-05-15T14:27:52.862259+0000","last_became_peered":"2024-05-15T14:27:52.862259+0000","last_unstale":"2024-05-15T14:47:53.814583+0000","last_undegraded":"2024-05-15T14:47:53.814583+0000","last_fullsized":"2024-05-15T14:47:53.814583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":205,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"39'8","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.409935+0000","last_change":"2024-05-15T14:27:50.844225+0000","last_active":"2024-05-15T14:44:47.409935+0000","last_peered":"2024-05-15T14:44:47.409935+0000","last_clean":"2024-05-15T14:44:47.409935+0000","last_became_active":"2024-05-15T14:27:50.843223+0000","last_became_peered":"2024-05-15T14:27:50.843223+0000","last_unstale":"2024-05-15T14:44:47.409935+0000","last_undegraded":"2024-05-15T14:44:47.409935+0000","last_fullsized":"2024-05-15T14:44:47.409935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"39'9","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.466203+0000","last_change":"2024-05-15T14:27:56.880459+0000","last_active":"2024-05-15T14:47:21.466203+0000","last_peered":"2024-05-15T14:47:21.466203+0000","last_clean":"2024-05-15T14:47:21.466203+0000","last_became_active":"2024-05-15T14:27:56.879589+0000","last_became_peered":"2024-05-15T14:27:56.879589+0000","last_unstale":"2024-05-15T14:47:21.466203+0000","last_undegraded":"2024-05-15T14:47:21.466203+0000","last_fullsized":"2024-05-15T14:47:21.466203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:15.202251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"39'199","reported_seq":391,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.993044+0000","last_change":"2024-05-15T14:27:58.885088+0000","last_active":"2024-05-15T14:48:25.993044+0000","last_peered":"2024-05-15T14:48:25.993044+0000","last_clean":"2024-05-15T14:48:25.993044+0000","last_became_active":"2024-05-15T14:27:58.884831+0000","last_became_peered":"2024-05-15T14:27:58.884831+0000","last_unstale":"2024-05-15T14:48:25.993044+0000","last_undegraded":"2024-05-15T14:48:25.993044+0000","last_fullsized":"2024-05-15T14:48:25.993044+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:27.597755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":320,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.406922+0000","last_change":"2024-05-15T14:28:00.887876+0000","last_active":"2024-05-15T14:44:22.406922+0000","last_peered":"2024-05-15T14:44:22.406922+0000","last_clean":"2024-05-15T14:44:22.406922+0000","last_became_active":"2024-05-15T14:28:00.887513+0000","last_became_peered":"2024-05-15T14:28:00.887513+0000","last_unstale":"2024-05-15T14:44:22.406922+0000","last_undegraded":"2024-05-15T14:44:22.406922+0000","last_fullsized":"2024-05-15T14:44:22.406922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:42.711145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407243+0000","last_change":"2024-05-15T14:31:16.594526+0000","last_active":"2024-05-15T14:45:17.407243+0000","last_peered":"2024-05-15T14:45:17.407243+0000","last_clean":"2024-05-15T14:45:17.407243+0000","last_became_active":"2024-05-15T14:31:16.594193+0000","last_became_peered":"2024-05-15T14:31:16.594193+0000","last_unstale":"2024-05-15T14:45:17.407243+0000","last_undegraded":"2024-05-15T14:45:17.407243+0000","last_fullsized":"2024-05-15T14:45:17.407243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:15:13.565975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"39'20","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814088+0000","last_change":"2024-05-15T14:27:52.847892+0000","last_active":"2024-05-15T14:47:53.814088+0000","last_peered":"2024-05-15T14:47:53.814088+0000","last_clean":"2024-05-15T14:47:53.814088+0000","last_became_active":"2024-05-15T14:27:52.847609+0000","last_became_peered":"2024-05-15T14:27:52.847609+0000","last_unstale":"2024-05-15T14:47:53.814088+0000","last_undegraded":"2024-05-15T14:47:53.814088+0000","last_fullsized":"2024-05-15T14:47:53.814088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:45.470476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":78,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.509233+0000","last_change":"2024-05-15T14:27:50.850851+0000","last_active":"2024-05-15T14:44:47.509233+0000","last_peered":"2024-05-15T14:44:47.509233+0000","last_clean":"2024-05-15T14:44:47.509233+0000","last_became_active":"2024-05-15T14:27:50.850524+0000","last_became_peered":"2024-05-15T14:27:50.850524+0000","last_unstale":"2024-05-15T14:44:47.509233+0000","last_undegraded":"2024-05-15T14:44:47.509233+0000","last_fullsized":"2024-05-15T14:44:47.509233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":18802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"39'11","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.908765+0000","last_change":"2024-05-15T14:27:56.882053+0000","last_active":"2024-05-15T14:48:25.908765+0000","last_peered":"2024-05-15T14:48:25.908765+0000","last_clean":"2024-05-15T14:48:25.908765+0000","last_became_active":"2024-05-15T14:27:56.881789+0000","last_became_peered":"2024-05-15T14:27:56.881789+0000","last_unstale":"2024-05-15T14:48:25.908765+0000","last_undegraded":"2024-05-15T14:48:25.908765+0000","last_fullsized":"2024-05-15T14:48:25.908765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:42.831889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":178,"num_write":22,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"39'270","reported_seq":550,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.063817+0000","last_change":"2024-05-15T14:27:58.887437+0000","last_active":"2024-05-15T14:48:26.063817+0000","last_peered":"2024-05-15T14:48:26.063817+0000","last_clean":"2024-05-15T14:48:26.063817+0000","last_became_active":"2024-05-15T14:27:58.887134+0000","last_became_peered":"2024-05-15T14:27:58.887134+0000","last_unstale":"2024-05-15T14:48:26.063817+0000","last_undegraded":"2024-05-15T14:48:26.063817+0000","last_fullsized":"2024-05-15T14:48:26.063817+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:48.300102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":460,"num_read_kb":450,"num_write":224,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.409142+0000","last_change":"2024-05-15T14:28:00.885482+0000","last_active":"2024-05-15T14:45:32.409142+0000","last_peered":"2024-05-15T14:45:32.409142+0000","last_clean":"2024-05-15T14:45:32.409142+0000","last_became_active":"2024-05-15T14:28:00.885174+0000","last_became_peered":"2024-05-15T14:28:00.885174+0000","last_unstale":"2024-05-15T14:45:32.409142+0000","last_undegraded":"2024-05-15T14:45:32.409142+0000","last_fullsized":"2024-05-15T14:45:32.409142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:03.551642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"39'30","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.322341+0000","last_change":"2024-05-15T14:28:02.894975+0000","last_active":"2024-05-15T14:47:54.322341+0000","last_peered":"2024-05-15T14:47:54.322341+0000","last_clean":"2024-05-15T14:47:54.322341+0000","last_became_active":"2024-05-15T14:28:02.894515+0000","last_became_peered":"2024-05-15T14:28:02.894515+0000","last_unstale":"2024-05-15T14:47:54.322341+0000","last_undegraded":"2024-05-15T14:47:54.322341+0000","last_fullsized":"2024-05-15T14:47:54.322341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:48.703371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.510012+0000","last_change":"2024-05-15T14:31:16.589730+0000","last_active":"2024-05-15T14:45:17.510012+0000","last_peered":"2024-05-15T14:45:17.510012+0000","last_clean":"2024-05-15T14:45:17.510012+0000","last_became_active":"2024-05-15T14:31:16.589442+0000","last_became_peered":"2024-05-15T14:31:16.589442+0000","last_unstale":"2024-05-15T14:45:17.510012+0000","last_undegraded":"2024-05-15T14:45:17.510012+0000","last_fullsized":"2024-05-15T14:45:17.510012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:32:21.556315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"39'56","reported_seq":140,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814321+0000","last_change":"2024-05-15T14:27:52.845888+0000","last_active":"2024-05-15T14:47:53.814321+0000","last_peered":"2024-05-15T14:47:53.814321+0000","last_clean":"2024-05-15T14:47:53.814321+0000","last_became_active":"2024-05-15T14:27:52.845557+0000","last_became_peered":"2024-05-15T14:27:52.845557+0000","last_unstale":"2024-05-15T14:47:53.814321+0000","last_undegraded":"2024-05-15T14:47:53.814321+0000","last_fullsized":"2024-05-15T14:47:53.814321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":171,"num_write":80,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"39'10","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.408489+0000","last_change":"2024-05-15T14:27:50.850506+0000","last_active":"2024-05-15T14:44:52.408489+0000","last_peered":"2024-05-15T14:44:52.408489+0000","last_clean":"2024-05-15T14:44:52.408489+0000","last_became_active":"2024-05-15T14:27:50.850175+0000","last_became_peered":"2024-05-15T14:27:50.850175+0000","last_unstale":"2024-05-15T14:44:52.408489+0000","last_undegraded":"2024-05-15T14:44:52.408489+0000","last_fullsized":"2024-05-15T14:44:52.408489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416792+0000","last_change":"2024-05-15T14:27:56.879893+0000","last_active":"2024-05-15T14:46:42.416792+0000","last_peered":"2024-05-15T14:46:42.416792+0000","last_clean":"2024-05-15T14:46:42.416792+0000","last_became_active":"2024-05-15T14:27:56.879634+0000","last_became_peered":"2024-05-15T14:27:56.879634+0000","last_unstale":"2024-05-15T14:46:42.416792+0000","last_undegraded":"2024-05-15T14:46:42.416792+0000","last_fullsized":"2024-05-15T14:46:42.416792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:06.597029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"39'500","reported_seq":1244,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.997567+0000","last_change":"2024-05-15T14:27:58.887413+0000","last_active":"2024-05-15T14:48:25.997567+0000","last_peered":"2024-05-15T14:48:25.997567+0000","last_clean":"2024-05-15T14:48:25.997567+0000","last_became_active":"2024-05-15T14:27:58.887144+0000","last_became_peered":"2024-05-15T14:27:58.887144+0000","last_unstale":"2024-05-15T14:48:25.997567+0000","last_undegraded":"2024-05-15T14:48:25.997567+0000","last_fullsized":"2024-05-15T14:48:25.997567+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:56.197135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":997,"num_read_kb":904,"num_write":673,"num_write_kb":1754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.412930+0000","last_change":"2024-05-15T14:28:00.891661+0000","last_active":"2024-05-15T14:45:32.412930+0000","last_peered":"2024-05-15T14:45:32.412930+0000","last_clean":"2024-05-15T14:45:32.412930+0000","last_became_active":"2024-05-15T14:28:00.891343+0000","last_became_peered":"2024-05-15T14:28:00.891343+0000","last_unstale":"2024-05-15T14:45:32.412930+0000","last_undegraded":"2024-05-15T14:45:32.412930+0000","last_fullsized":"2024-05-15T14:45:32.412930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:29.432233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"39'31","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.248871+0000","last_change":"2024-05-15T14:28:02.890221+0000","last_active":"2024-05-15T14:46:21.248871+0000","last_peered":"2024-05-15T14:46:21.248871+0000","last_clean":"2024-05-15T14:46:21.248871+0000","last_became_active":"2024-05-15T14:28:02.889940+0000","last_became_peered":"2024-05-15T14:28:02.889940+0000","last_unstale":"2024-05-15T14:46:21.248871+0000","last_undegraded":"2024-05-15T14:46:21.248871+0000","last_fullsized":"2024-05-15T14:46:21.248871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:48.842803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":111,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407852+0000","last_change":"2024-05-15T14:31:16.590555+0000","last_active":"2024-05-15T14:45:17.407852+0000","last_peered":"2024-05-15T14:45:17.407852+0000","last_clean":"2024-05-15T14:45:17.407852+0000","last_became_active":"2024-05-15T14:31:16.590270+0000","last_became_peered":"2024-05-15T14:31:16.590270+0000","last_unstale":"2024-05-15T14:45:17.407852+0000","last_undegraded":"2024-05-15T14:45:17.407852+0000","last_fullsized":"2024-05-15T14:45:17.407852+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:01:05.887839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'14","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.807073+0000","last_change":"2024-05-15T14:27:52.861766+0000","last_active":"2024-05-15T14:47:53.807073+0000","last_peered":"2024-05-15T14:47:53.807073+0000","last_clean":"2024-05-15T14:47:53.807073+0000","last_became_active":"2024-05-15T14:27:52.861459+0000","last_became_peered":"2024-05-15T14:27:52.861459+0000","last_unstale":"2024-05-15T14:47:53.807073+0000","last_undegraded":"2024-05-15T14:47:53.807073+0000","last_fullsized":"2024-05-15T14:47:53.807073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408411+0000","last_change":"2024-05-15T14:27:50.836665+0000","last_active":"2024-05-15T14:45:22.408411+0000","last_peered":"2024-05-15T14:45:22.408411+0000","last_clean":"2024-05-15T14:45:22.408411+0000","last_became_active":"2024-05-15T14:27:50.836343+0000","last_became_peered":"2024-05-15T14:27:50.836343+0000","last_unstale":"2024-05-15T14:45:22.408411+0000","last_undegraded":"2024-05-15T14:45:22.408411+0000","last_fullsized":"2024-05-15T14:45:22.408411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:38.935625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:27.408960+0000","last_change":"2024-05-15T14:27:56.877775+0000","last_active":"2024-05-15T14:45:27.408960+0000","last_peered":"2024-05-15T14:45:27.408960+0000","last_clean":"2024-05-15T14:45:27.408960+0000","last_became_active":"2024-05-15T14:27:56.876994+0000","last_became_peered":"2024-05-15T14:27:56.876994+0000","last_unstale":"2024-05-15T14:45:27.408960+0000","last_undegraded":"2024-05-15T14:45:27.408960+0000","last_fullsized":"2024-05-15T14:45:27.408960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"39'247","reported_seq":467,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.058303+0000","last_change":"2024-05-15T14:27:58.877101+0000","last_active":"2024-05-15T14:48:26.058303+0000","last_peered":"2024-05-15T14:48:26.058303+0000","last_clean":"2024-05-15T14:48:26.058303+0000","last_became_active":"2024-05-15T14:27:58.876807+0000","last_became_peered":"2024-05-15T14:27:58.876807+0000","last_unstale":"2024-05-15T14:48:26.058303+0000","last_undegraded":"2024-05-15T14:48:26.058303+0000","last_fullsized":"2024-05-15T14:48:26.058303+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:27.039335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":390,"num_write":224,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:07.417129+0000","last_change":"2024-05-15T14:28:00.891499+0000","last_active":"2024-05-15T14:46:07.417129+0000","last_peered":"2024-05-15T14:46:07.417129+0000","last_clean":"2024-05-15T14:46:07.417129+0000","last_became_active":"2024-05-15T14:28:00.891181+0000","last_became_peered":"2024-05-15T14:28:00.891181+0000","last_unstale":"2024-05-15T14:46:07.417129+0000","last_undegraded":"2024-05-15T14:46:07.417129+0000","last_fullsized":"2024-05-15T14:46:07.417129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:38:22.090345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"39'31","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.725546+0000","last_change":"2024-05-15T14:28:02.890319+0000","last_active":"2024-05-15T14:47:53.725546+0000","last_peered":"2024-05-15T14:47:53.725546+0000","last_clean":"2024-05-15T14:47:53.725546+0000","last_became_active":"2024-05-15T14:28:02.889976+0000","last_became_peered":"2024-05-15T14:28:02.889976+0000","last_unstale":"2024-05-15T14:47:53.725546+0000","last_undegraded":"2024-05-15T14:47:53.725546+0000","last_fullsized":"2024-05-15T14:47:53.725546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:35.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.509569+0000","last_change":"2024-05-15T14:31:16.592036+0000","last_active":"2024-05-15T14:45:17.509569+0000","last_peered":"2024-05-15T14:45:17.509569+0000","last_clean":"2024-05-15T14:45:17.509569+0000","last_became_active":"2024-05-15T14:31:16.591739+0000","last_became_peered":"2024-05-15T14:31:16.591739+0000","last_unstale":"2024-05-15T14:45:17.509569+0000","last_undegraded":"2024-05-15T14:45:17.509569+0000","last_fullsized":"2024-05-15T14:45:17.509569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:29:51.681101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1c","version":"39'60","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.859800+0000","last_change":"2024-05-15T14:27:52.838848+0000","last_active":"2024-05-15T14:47:53.859800+0000","last_peered":"2024-05-15T14:47:53.859800+0000","last_clean":"2024-05-15T14:47:53.859800+0000","last_became_active":"2024-05-15T14:27:52.838558+0000","last_became_peered":"2024-05-15T14:27:52.838558+0000","last_unstale":"2024-05-15T14:47:53.859800+0000","last_undegraded":"2024-05-15T14:47:53.859800+0000","last_fullsized":"2024-05-15T14:47:53.859800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:39.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":198,"num_write":84,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"39'14","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.431530+0000","last_change":"2024-05-15T14:27:50.834122+0000","last_active":"2024-05-15T14:47:52.431530+0000","last_peered":"2024-05-15T14:47:52.431530+0000","last_clean":"2024-05-15T14:47:52.431530+0000","last_became_active":"2024-05-15T14:27:50.833741+0000","last_became_peered":"2024-05-15T14:27:50.833741+0000","last_unstale":"2024-05-15T14:47:52.431530+0000","last_undegraded":"2024-05-15T14:47:52.431530+0000","last_fullsized":"2024-05-15T14:47:52.431530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20,"num_write":62,"num_write_kb":15860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":276,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:49.987139+0000","last_change":"2024-05-15T14:27:56.884180+0000","last_active":"2024-05-15T14:45:49.987139+0000","last_peered":"2024-05-15T14:45:49.987139+0000","last_clean":"2024-05-15T14:45:49.987139+0000","last_became_active":"2024-05-15T14:27:56.883663+0000","last_became_peered":"2024-05-15T14:27:56.883663+0000","last_unstale":"2024-05-15T14:45:49.987139+0000","last_undegraded":"2024-05-15T14:45:49.987139+0000","last_fullsized":"2024-05-15T14:45:49.987139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:26.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2211,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":456,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"39'289","reported_seq":645,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:55.118121+0000","last_change":"2024-05-15T14:27:58.880803+0000","last_active":"2024-05-15T14:47:55.118121+0000","last_peered":"2024-05-15T14:47:55.118121+0000","last_clean":"2024-05-15T14:47:55.118121+0000","last_became_active":"2024-05-15T14:27:58.880510+0000","last_became_peered":"2024-05-15T14:27:58.880510+0000","last_unstale":"2024-05-15T14:47:55.118121+0000","last_undegraded":"2024-05-15T14:47:55.118121+0000","last_fullsized":"2024-05-15T14:47:55.118121+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:03.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":979,"num_read_kb":1295,"num_write":324,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'924","reported_seq":2554,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.229886+0000","last_change":"2024-05-15T14:28:00.885605+0000","last_active":"2024-05-15T14:48:26.229886+0000","last_peered":"2024-05-15T14:48:26.229886+0000","last_clean":"2024-05-15T14:48:26.229886+0000","last_became_active":"2024-05-15T14:28:00.885293+0000","last_became_peered":"2024-05-15T14:28:00.885293+0000","last_unstale":"2024-05-15T14:48:26.229886+0000","last_undegraded":"2024-05-15T14:48:26.229886+0000","last_fullsized":"2024-05-15T14:48:26.229886+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:25.360934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"39'25","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.696985+0000","last_change":"2024-05-15T14:28:02.893269+0000","last_active":"2024-05-15T14:47:53.696985+0000","last_peered":"2024-05-15T14:47:53.696985+0000","last_clean":"2024-05-15T14:47:53.696985+0000","last_became_active":"2024-05-15T14:28:02.892984+0000","last_became_peered":"2024-05-15T14:28:02.892984+0000","last_unstale":"2024-05-15T14:47:53.696985+0000","last_undegraded":"2024-05-15T14:47:53.696985+0000","last_fullsized":"2024-05-15T14:47:53.696985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:44.714715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":37,"num_write":54,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.411080+0000","last_change":"2024-05-15T14:31:16.594309+0000","last_active":"2024-05-15T14:45:47.411080+0000","last_peered":"2024-05-15T14:45:47.411080+0000","last_clean":"2024-05-15T14:45:47.411080+0000","last_became_active":"2024-05-15T14:31:16.594019+0000","last_became_peered":"2024-05-15T14:31:16.594019+0000","last_unstale":"2024-05-15T14:45:47.411080+0000","last_undegraded":"2024-05-15T14:45:47.411080+0000","last_fullsized":"2024-05-15T14:45:47.411080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:25:09.888037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"39'52","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.320806+0000","last_change":"2024-05-15T14:27:52.854866+0000","last_active":"2024-05-15T14:47:54.320806+0000","last_peered":"2024-05-15T14:47:54.320806+0000","last_clean":"2024-05-15T14:47:54.320806+0000","last_became_active":"2024-05-15T14:27:52.854479+0000","last_became_peered":"2024-05-15T14:27:52.854479+0000","last_unstale":"2024-05-15T14:47:54.320806+0000","last_undegraded":"2024-05-15T14:47:54.320806+0000","last_fullsized":"2024-05-15T14:47:54.320806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":157,"num_write":72,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408007+0000","last_change":"2024-05-15T14:27:50.841154+0000","last_active":"2024-05-15T14:45:22.408007+0000","last_peered":"2024-05-15T14:45:22.408007+0000","last_clean":"2024-05-15T14:45:22.408007+0000","last_became_active":"2024-05-15T14:27:50.840771+0000","last_became_peered":"2024-05-15T14:27:50.840771+0000","last_unstale":"2024-05-15T14:45:22.408007+0000","last_undegraded":"2024-05-15T14:45:22.408007+0000","last_fullsized":"2024-05-15T14:45:22.408007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:18.416733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'25","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.593035+0000","last_change":"2024-05-15T14:27:56.878204+0000","last_active":"2024-05-15T14:47:21.593035+0000","last_peered":"2024-05-15T14:47:21.593035+0000","last_clean":"2024-05-15T14:47:21.593035+0000","last_became_active":"2024-05-15T14:27:56.877367+0000","last_became_peered":"2024-05-15T14:27:56.877367+0000","last_unstale":"2024-05-15T14:47:21.593035+0000","last_undegraded":"2024-05-15T14:47:21.593035+0000","last_fullsized":"2024-05-15T14:47:21.593035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:48.893192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":101,"num_read_kb":87,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"39'408","reported_seq":22976,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.077957+0000","last_change":"2024-05-15T14:27:58.882407+0000","last_active":"2024-05-15T14:48:26.077957+0000","last_peered":"2024-05-15T14:48:26.077957+0000","last_clean":"2024-05-15T14:48:26.077957+0000","last_became_active":"2024-05-15T14:27:58.882139+0000","last_became_peered":"2024-05-15T14:27:58.882139+0000","last_unstale":"2024-05-15T14:48:26.077957+0000","last_undegraded":"2024-05-15T14:48:26.077957+0000","last_fullsized":"2024-05-15T14:48:26.077957+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:49.077081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56365,"num_read_kb":194190,"num_write":402,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.410843+0000","last_change":"2024-05-15T14:28:00.886162+0000","last_active":"2024-05-15T14:44:57.410843+0000","last_peered":"2024-05-15T14:44:57.410843+0000","last_clean":"2024-05-15T14:44:57.410843+0000","last_became_active":"2024-05-15T14:28:00.885872+0000","last_became_peered":"2024-05-15T14:28:00.885872+0000","last_unstale":"2024-05-15T14:44:57.410843+0000","last_undegraded":"2024-05-15T14:44:57.410843+0000","last_fullsized":"2024-05-15T14:44:57.410843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:42.856744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"39'21","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.251279+0000","last_change":"2024-05-15T14:28:02.896566+0000","last_active":"2024-05-15T14:47:54.251279+0000","last_peered":"2024-05-15T14:47:54.251279+0000","last_clean":"2024-05-15T14:47:54.251279+0000","last_became_active":"2024-05-15T14:28:02.896293+0000","last_became_peered":"2024-05-15T14:28:02.896293+0000","last_unstale":"2024-05-15T14:47:54.251279+0000","last_undegraded":"2024-05-15T14:47:54.251279+0000","last_fullsized":"2024-05-15T14:47:54.251279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:31.046554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514146+0000","last_change":"2024-05-15T14:31:16.594407+0000","last_active":"2024-05-15T14:45:47.514146+0000","last_peered":"2024-05-15T14:45:47.514146+0000","last_clean":"2024-05-15T14:45:47.514146+0000","last_became_active":"2024-05-15T14:31:16.594144+0000","last_became_peered":"2024-05-15T14:31:16.594144+0000","last_unstale":"2024-05-15T14:45:47.514146+0000","last_undegraded":"2024-05-15T14:45:47.514146+0000","last_fullsized":"2024-05-15T14:45:47.514146+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:01:05.887839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"39'56","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288903+0000","last_change":"2024-05-15T14:27:52.854982+0000","last_active":"2024-05-15T14:47:54.288903+0000","last_peered":"2024-05-15T14:47:54.288903+0000","last_clean":"2024-05-15T14:47:54.288903+0000","last_became_active":"2024-05-15T14:27:52.854517+0000","last_became_peered":"2024-05-15T14:27:52.854517+0000","last_unstale":"2024-05-15T14:47:54.288903+0000","last_undegraded":"2024-05-15T14:47:54.288903+0000","last_fullsized":"2024-05-15T14:47:54.288903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:03.135228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":183,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408040+0000","last_change":"2024-05-15T14:27:50.840481+0000","last_active":"2024-05-15T14:45:22.408040+0000","last_peered":"2024-05-15T14:45:22.408040+0000","last_clean":"2024-05-15T14:45:22.408040+0000","last_became_active":"2024-05-15T14:27:50.839960+0000","last_became_peered":"2024-05-15T14:27:50.839960+0000","last_unstale":"2024-05-15T14:45:22.408040+0000","last_undegraded":"2024-05-15T14:45:22.408040+0000","last_fullsized":"2024-05-15T14:45:22.408040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:50.553074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.588072+0000","last_change":"2024-05-15T14:27:56.883585+0000","last_active":"2024-05-15T14:47:21.588072+0000","last_peered":"2024-05-15T14:47:21.588072+0000","last_clean":"2024-05-15T14:47:21.588072+0000","last_became_active":"2024-05-15T14:27:56.883267+0000","last_became_peered":"2024-05-15T14:27:56.883267+0000","last_unstale":"2024-05-15T14:47:21.588072+0000","last_undegraded":"2024-05-15T14:47:21.588072+0000","last_fullsized":"2024-05-15T14:47:21.588072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"39'216","reported_seq":413,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.080784+0000","last_change":"2024-05-15T14:27:58.882536+0000","last_active":"2024-05-15T14:48:26.080784+0000","last_peered":"2024-05-15T14:48:26.080784+0000","last_clean":"2024-05-15T14:48:26.080784+0000","last_became_active":"2024-05-15T14:27:58.882239+0000","last_became_peered":"2024-05-15T14:27:58.882239+0000","last_unstale":"2024-05-15T14:48:26.080784+0000","last_undegraded":"2024-05-15T14:48:26.080784+0000","last_fullsized":"2024-05-15T14:48:26.080784+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:44.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":340,"num_read_kb":332,"num_write":192,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:02.405124+0000","last_change":"2024-05-15T14:28:00.887245+0000","last_active":"2024-05-15T14:45:02.405124+0000","last_peered":"2024-05-15T14:45:02.405124+0000","last_clean":"2024-05-15T14:45:02.405124+0000","last_became_active":"2024-05-15T14:28:00.886898+0000","last_became_peered":"2024-05-15T14:28:00.886898+0000","last_unstale":"2024-05-15T14:45:02.405124+0000","last_undegraded":"2024-05-15T14:45:02.405124+0000","last_fullsized":"2024-05-15T14:45:02.405124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:11.178263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"39'12","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.428797+0000","last_change":"2024-05-15T14:28:02.890898+0000","last_active":"2024-05-15T14:47:52.428797+0000","last_peered":"2024-05-15T14:47:52.428797+0000","last_clean":"2024-05-15T14:47:52.428797+0000","last_became_active":"2024-05-15T14:28:02.890595+0000","last_became_peered":"2024-05-15T14:28:02.890595+0000","last_unstale":"2024-05-15T14:47:52.428797+0000","last_undegraded":"2024-05-15T14:47:52.428797+0000","last_fullsized":"2024-05-15T14:47:52.428797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:15:31.656577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.411631+0000","last_change":"2024-05-15T14:31:16.597622+0000","last_active":"2024-05-15T14:45:22.411631+0000","last_peered":"2024-05-15T14:45:22.411631+0000","last_clean":"2024-05-15T14:45:22.411631+0000","last_became_active":"2024-05-15T14:31:16.597207+0000","last_became_peered":"2024-05-15T14:31:16.597207+0000","last_unstale":"2024-05-15T14:45:22.411631+0000","last_undegraded":"2024-05-15T14:45:22.411631+0000","last_fullsized":"2024-05-15T14:45:22.411631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:03:58.603941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"39'94","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288855+0000","last_change":"2024-05-15T14:27:52.852789+0000","last_active":"2024-05-15T14:47:54.288855+0000","last_peered":"2024-05-15T14:47:54.288855+0000","last_clean":"2024-05-15T14:47:54.288855+0000","last_became_active":"2024-05-15T14:27:52.852536+0000","last_became_peered":"2024-05-15T14:27:52.852536+0000","last_unstale":"2024-05-15T14:47:54.288855+0000","last_undegraded":"2024-05-15T14:47:54.288855+0000","last_fullsized":"2024-05-15T14:47:54.288855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":296,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"39'22","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518672+0000","last_change":"2024-05-15T14:27:50.848136+0000","last_active":"2024-05-15T14:45:52.518672+0000","last_peered":"2024-05-15T14:45:52.518672+0000","last_clean":"2024-05-15T14:45:52.518672+0000","last_became_active":"2024-05-15T14:27:50.847850+0000","last_became_peered":"2024-05-15T14:27:50.847850+0000","last_unstale":"2024-05-15T14:45:52.518672+0000","last_undegraded":"2024-05-15T14:45:52.518672+0000","last_fullsized":"2024-05-15T14:45:52.518672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":44,"num_write":110,"num_write_kb":26471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"32'3","reported_seq":1305,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.920310+0000","last_change":"2024-05-15T14:27:56.879855+0000","last_active":"2024-05-15T14:48:25.920310+0000","last_peered":"2024-05-15T14:48:25.920310+0000","last_clean":"2024-05-15T14:48:25.920310+0000","last_became_active":"2024-05-15T14:27:56.879092+0000","last_became_peered":"2024-05-15T14:27:56.879092+0000","last_unstale":"2024-05-15T14:48:25.920310+0000","last_undegraded":"2024-05-15T14:48:25.920310+0000","last_fullsized":"2024-05-15T14:48:25.920310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1591,"num_read_kb":1589,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'230","reported_seq":386,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.051621+0000","last_change":"2024-05-15T14:27:58.883107+0000","last_active":"2024-05-15T14:48:26.051621+0000","last_peered":"2024-05-15T14:48:26.051621+0000","last_clean":"2024-05-15T14:48:26.051621+0000","last_became_active":"2024-05-15T14:27:58.882703+0000","last_became_peered":"2024-05-15T14:27:58.882703+0000","last_unstale":"2024-05-15T14:48:26.051621+0000","last_undegraded":"2024-05-15T14:48:26.051621+0000","last_fullsized":"2024-05-15T14:48:26.051621+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:03.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":436,"num_read_kb":463,"num_write":435,"num_write_kb":1979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.409428+0000","last_change":"2024-05-15T14:28:00.884804+0000","last_active":"2024-05-15T14:45:32.409428+0000","last_peered":"2024-05-15T14:45:32.409428+0000","last_clean":"2024-05-15T14:45:32.409428+0000","last_became_active":"2024-05-15T14:28:00.884499+0000","last_became_peered":"2024-05-15T14:28:00.884499+0000","last_unstale":"2024-05-15T14:45:32.409428+0000","last_undegraded":"2024-05-15T14:45:32.409428+0000","last_fullsized":"2024-05-15T14:45:32.409428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:22:45.934449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"39'18","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.258684+0000","last_change":"2024-05-15T14:28:02.896315+0000","last_active":"2024-05-15T14:46:21.258684+0000","last_peered":"2024-05-15T14:46:21.258684+0000","last_clean":"2024-05-15T14:46:21.258684+0000","last_became_active":"2024-05-15T14:28:02.895999+0000","last_became_peered":"2024-05-15T14:28:02.895999+0000","last_unstale":"2024-05-15T14:46:21.258684+0000","last_undegraded":"2024-05-15T14:46:21.258684+0000","last_fullsized":"2024-05-15T14:46:21.258684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:38.432473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514109+0000","last_change":"2024-05-15T14:31:16.593403+0000","last_active":"2024-05-15T14:45:47.514109+0000","last_peered":"2024-05-15T14:45:47.514109+0000","last_clean":"2024-05-15T14:45:47.514109+0000","last_became_active":"2024-05-15T14:31:16.593126+0000","last_became_peered":"2024-05-15T14:31:16.593126+0000","last_unstale":"2024-05-15T14:45:47.514109+0000","last_undegraded":"2024-05-15T14:45:47.514109+0000","last_fullsized":"2024-05-15T14:45:47.514109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:32.457272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404758+0000","last_change":"2024-05-15T14:27:52.844385+0000","last_active":"2024-05-15T14:44:47.404758+0000","last_peered":"2024-05-15T14:44:47.404758+0000","last_clean":"2024-05-15T14:44:47.404758+0000","last_became_active":"2024-05-15T14:27:52.844112+0000","last_became_peered":"2024-05-15T14:27:52.844112+0000","last_unstale":"2024-05-15T14:44:47.404758+0000","last_undegraded":"2024-05-15T14:44:47.404758+0000","last_fullsized":"2024-05-15T14:44:47.404758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"39'20","reported_seq":98,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422176+0000","last_change":"2024-05-15T14:27:50.844543+0000","last_active":"2024-05-15T14:46:37.422176+0000","last_peered":"2024-05-15T14:46:37.422176+0000","last_clean":"2024-05-15T14:46:37.422176+0000","last_became_active":"2024-05-15T14:27:50.843701+0000","last_became_peered":"2024-05-15T14:27:50.843701+0000","last_unstale":"2024-05-15T14:46:37.422176+0000","last_undegraded":"2024-05-15T14:46:37.422176+0000","last_fullsized":"2024-05-15T14:46:37.422176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":100,"num_write_kb":23517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.408964+0000","last_change":"2024-05-15T14:27:56.883840+0000","last_active":"2024-05-15T14:44:57.408964+0000","last_peered":"2024-05-15T14:44:57.408964+0000","last_clean":"2024-05-15T14:44:57.408964+0000","last_became_active":"2024-05-15T14:27:56.883534+0000","last_became_peered":"2024-05-15T14:27:56.883534+0000","last_unstale":"2024-05-15T14:44:57.408964+0000","last_undegraded":"2024-05-15T14:44:57.408964+0000","last_fullsized":"2024-05-15T14:44:57.408964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:44.326726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"39'319","reported_seq":521,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.060192+0000","last_change":"2024-05-15T14:27:58.886044+0000","last_active":"2024-05-15T14:48:26.060192+0000","last_peered":"2024-05-15T14:48:26.060192+0000","last_clean":"2024-05-15T14:48:26.060192+0000","last_became_active":"2024-05-15T14:27:58.885479+0000","last_became_peered":"2024-05-15T14:27:58.885479+0000","last_unstale":"2024-05-15T14:48:26.060192+0000","last_undegraded":"2024-05-15T14:48:26.060192+0000","last_fullsized":"2024-05-15T14:48:26.060192+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:42.051812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":600,"num_write":516,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.414924+0000","last_change":"2024-05-15T14:28:00.885531+0000","last_active":"2024-05-15T14:45:32.414924+0000","last_peered":"2024-05-15T14:45:32.414924+0000","last_clean":"2024-05-15T14:45:32.414924+0000","last_became_active":"2024-05-15T14:28:00.885171+0000","last_became_peered":"2024-05-15T14:28:00.885171+0000","last_unstale":"2024-05-15T14:45:32.414924+0000","last_undegraded":"2024-05-15T14:45:32.414924+0000","last_fullsized":"2024-05-15T14:45:32.414924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:03.551642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'26","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418188+0000","last_change":"2024-05-15T14:28:02.888549+0000","last_active":"2024-05-15T14:46:47.418188+0000","last_peered":"2024-05-15T14:46:47.418188+0000","last_clean":"2024-05-15T14:46:47.418188+0000","last_became_active":"2024-05-15T14:28:02.888247+0000","last_became_peered":"2024-05-15T14:28:02.888247+0000","last_unstale":"2024-05-15T14:46:47.418188+0000","last_undegraded":"2024-05-15T14:46:47.418188+0000","last_fullsized":"2024-05-15T14:46:47.418188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":30,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"39'16","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410536+0000","last_change":"2024-05-15T14:27:52.844877+0000","last_active":"2024-05-15T14:45:12.410536+0000","last_peered":"2024-05-15T14:45:12.410536+0000","last_clean":"2024-05-15T14:45:12.410536+0000","last_became_active":"2024-05-15T14:27:52.844292+0000","last_became_peered":"2024-05-15T14:27:52.844292+0000","last_unstale":"2024-05-15T14:45:12.410536+0000","last_undegraded":"2024-05-15T14:45:12.410536+0000","last_fullsized":"2024-05-15T14:45:12.410536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:16.074039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"39'20","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.028581+0000","last_change":"2024-05-15T14:27:50.853660+0000","last_active":"2024-05-15T14:48:26.028581+0000","last_peered":"2024-05-15T14:48:26.028581+0000","last_clean":"2024-05-15T14:48:26.028581+0000","last_became_active":"2024-05-15T14:27:50.853042+0000","last_became_peered":"2024-05-15T14:27:50.853042+0000","last_unstale":"2024-05-15T14:48:26.028581+0000","last_undegraded":"2024-05-15T14:48:26.028581+0000","last_fullsized":"2024-05-15T14:48:26.028581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:39:59.963824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":35,"num_write":92,"num_write_kb":30554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"39'20","reported_seq":112,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304259+0000","last_change":"2024-05-15T14:27:52.842491+0000","last_active":"2024-05-15T14:47:54.304259+0000","last_peered":"2024-05-15T14:47:54.304259+0000","last_clean":"2024-05-15T14:47:54.304259+0000","last_became_active":"2024-05-15T14:27:52.840716+0000","last_became_peered":"2024-05-15T14:27:52.840716+0000","last_unstale":"2024-05-15T14:47:54.304259+0000","last_undegraded":"2024-05-15T14:47:54.304259+0000","last_fullsized":"2024-05-15T14:47:54.304259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:20.425917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"39'16","reported_seq":98,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509652+0000","last_change":"2024-05-15T14:28:38.451032+0000","last_active":"2024-05-15T14:46:37.509652+0000","last_peered":"2024-05-15T14:46:37.509652+0000","last_clean":"2024-05-15T14:46:37.509652+0000","last_became_active":"2024-05-15T14:28:38.450578+0000","last_became_peered":"2024-05-15T14:28:38.450578+0000","last_unstale":"2024-05-15T14:46:37.509652+0000","last_undegraded":"2024-05-15T14:46:37.509652+0000","last_fullsized":"2024-05-15T14:46:37.509652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:19.965962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"39'26","reported_seq":110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.385094+0000","last_change":"2024-05-15T14:27:52.841680+0000","last_active":"2024-05-15T14:46:21.385094+0000","last_peered":"2024-05-15T14:46:21.385094+0000","last_clean":"2024-05-15T14:46:21.385094+0000","last_became_active":"2024-05-15T14:27:52.841192+0000","last_became_peered":"2024-05-15T14:27:52.841192+0000","last_unstale":"2024-05-15T14:46:21.385094+0000","last_undegraded":"2024-05-15T14:46:21.385094+0000","last_fullsized":"2024-05-15T14:46:21.385094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":93,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"39'18","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416631+0000","last_change":"2024-05-15T14:28:38.450889+0000","last_active":"2024-05-15T14:46:37.416631+0000","last_peered":"2024-05-15T14:46:37.416631+0000","last_clean":"2024-05-15T14:46:37.416631+0000","last_became_active":"2024-05-15T14:28:38.450592+0000","last_became_peered":"2024-05-15T14:28:38.450592+0000","last_unstale":"2024-05-15T14:46:37.416631+0000","last_undegraded":"2024-05-15T14:46:37.416631+0000","last_fullsized":"2024-05-15T14:46:37.416631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:32.536677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"39'72","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.411796+0000","last_change":"2024-05-15T14:28:37.941694+0000","last_active":"2024-05-15T14:45:57.411796+0000","last_peered":"2024-05-15T14:45:57.411796+0000","last_clean":"2024-05-15T14:45:57.411796+0000","last_became_active":"2024-05-15T14:28:37.941389+0000","last_became_peered":"2024-05-15T14:28:37.941389+0000","last_unstale":"2024-05-15T14:45:57.411796+0000","last_undegraded":"2024-05-15T14:45:57.411796+0000","last_fullsized":"2024-05-15T14:45:57.411796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:12.821111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":236,"num_write":102,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.028033+0000","last_change":"2024-05-15T14:27:50.849038+0000","last_active":"2024-05-15T14:48:26.028033+0000","last_peered":"2024-05-15T14:48:26.028033+0000","last_clean":"2024-05-15T14:48:26.028033+0000","last_became_active":"2024-05-15T14:27:50.848763+0000","last_became_peered":"2024-05-15T14:27:50.848763+0000","last_unstale":"2024-05-15T14:48:26.028033+0000","last_undegraded":"2024-05-15T14:48:26.028033+0000","last_fullsized":"2024-05-15T14:48:26.028033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:50.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":82,"num_write_kb":24675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"39'82","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327631+0000","last_change":"2024-05-15T14:27:52.853939+0000","last_active":"2024-05-15T14:47:54.327631+0000","last_peered":"2024-05-15T14:47:54.327631+0000","last_clean":"2024-05-15T14:47:54.327631+0000","last_became_active":"2024-05-15T14:27:52.851068+0000","last_became_peered":"2024-05-15T14:27:52.851068+0000","last_unstale":"2024-05-15T14:47:54.327631+0000","last_undegraded":"2024-05-15T14:47:54.327631+0000","last_fullsized":"2024-05-15T14:47:54.327631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":322,"num_read_kb":258,"num_write":116,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512532+0000","last_change":"2024-05-15T14:27:50.847365+0000","last_active":"2024-05-15T14:45:12.512532+0000","last_peered":"2024-05-15T14:45:12.512532+0000","last_clean":"2024-05-15T14:45:12.512532+0000","last_became_active":"2024-05-15T14:27:50.847042+0000","last_became_peered":"2024-05-15T14:27:50.847042+0000","last_unstale":"2024-05-15T14:45:12.512532+0000","last_undegraded":"2024-05-15T14:45:12.512532+0000","last_fullsized":"2024-05-15T14:45:12.512532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'66","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327563+0000","last_change":"2024-05-15T14:27:52.847215+0000","last_active":"2024-05-15T14:47:54.327563+0000","last_peered":"2024-05-15T14:47:54.327563+0000","last_clean":"2024-05-15T14:47:54.327563+0000","last_became_active":"2024-05-15T14:27:52.846918+0000","last_became_peered":"2024-05-15T14:27:52.846918+0000","last_unstale":"2024-05-15T14:47:54.327563+0000","last_undegraded":"2024-05-15T14:47:54.327563+0000","last_fullsized":"2024-05-15T14:47:54.327563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":226,"num_write":90,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410488+0000","last_change":"2024-05-15T14:27:50.850495+0000","last_active":"2024-05-15T14:45:12.410488+0000","last_peered":"2024-05-15T14:45:12.410488+0000","last_clean":"2024-05-15T14:45:12.410488+0000","last_became_active":"2024-05-15T14:27:50.849910+0000","last_became_peered":"2024-05-15T14:27:50.849910+0000","last_unstale":"2024-05-15T14:45:12.410488+0000","last_undegraded":"2024-05-15T14:45:12.410488+0000","last_fullsized":"2024-05-15T14:45:12.410488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.524589+0000","last_change":"2024-05-15T14:27:52.862477+0000","last_active":"2024-05-15T14:46:37.524589+0000","last_peered":"2024-05-15T14:46:37.524589+0000","last_clean":"2024-05-15T14:46:37.524589+0000","last_became_active":"2024-05-15T14:27:52.862227+0000","last_became_peered":"2024-05-15T14:27:52.862227+0000","last_unstale":"2024-05-15T14:46:37.524589+0000","last_undegraded":"2024-05-15T14:46:37.524589+0000","last_fullsized":"2024-05-15T14:46:37.524589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"39'14","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.406550+0000","last_change":"2024-05-15T14:28:37.942575+0000","last_active":"2024-05-15T14:45:12.406550+0000","last_peered":"2024-05-15T14:45:12.406550+0000","last_clean":"2024-05-15T14:45:12.406550+0000","last_became_active":"2024-05-15T14:28:37.942198+0000","last_became_peered":"2024-05-15T14:28:37.942198+0000","last_unstale":"2024-05-15T14:45:12.406550+0000","last_undegraded":"2024-05-15T14:45:12.406550+0000","last_fullsized":"2024-05-15T14:45:12.406550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:26:58.883367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416154+0000","last_change":"2024-05-15T14:27:52.841198+0000","last_active":"2024-05-15T14:46:37.416154+0000","last_peered":"2024-05-15T14:46:37.416154+0000","last_clean":"2024-05-15T14:46:37.416154+0000","last_became_active":"2024-05-15T14:27:52.840941+0000","last_became_peered":"2024-05-15T14:27:52.840941+0000","last_unstale":"2024-05-15T14:46:37.416154+0000","last_undegraded":"2024-05-15T14:46:37.416154+0000","last_fullsized":"2024-05-15T14:46:37.416154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:17.311449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512566+0000","last_change":"2024-05-15T14:27:50.849503+0000","last_active":"2024-05-15T14:45:12.512566+0000","last_peered":"2024-05-15T14:45:12.512566+0000","last_clean":"2024-05-15T14:45:12.512566+0000","last_became_active":"2024-05-15T14:27:50.847998+0000","last_became_peered":"2024-05-15T14:27:50.847998+0000","last_unstale":"2024-05-15T14:45:12.512566+0000","last_undegraded":"2024-05-15T14:45:12.512566+0000","last_fullsized":"2024-05-15T14:45:12.512566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:50.553074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"39'8","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.421601+0000","last_change":"2024-05-15T14:27:52.853614+0000","last_active":"2024-05-15T14:46:32.421601+0000","last_peered":"2024-05-15T14:46:32.421601+0000","last_clean":"2024-05-15T14:46:32.421601+0000","last_became_active":"2024-05-15T14:27:52.852947+0000","last_became_peered":"2024-05-15T14:27:52.852947+0000","last_unstale":"2024-05-15T14:46:32.421601+0000","last_undegraded":"2024-05-15T14:46:32.421601+0000","last_fullsized":"2024-05-15T14:46:32.421601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:27.422621+0000","last_change":"2024-05-15T14:27:50.856154+0000","last_active":"2024-05-15T14:47:27.422621+0000","last_peered":"2024-05-15T14:47:27.422621+0000","last_clean":"2024-05-15T14:47:27.422621+0000","last_became_active":"2024-05-15T14:27:50.855927+0000","last_became_peered":"2024-05-15T14:27:50.855927+0000","last_unstale":"2024-05-15T14:47:27.422621+0000","last_undegraded":"2024-05-15T14:47:27.422621+0000","last_fullsized":"2024-05-15T14:47:27.422621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:14.556752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24,"num_write":62,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"39'24","reported_seq":110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416239+0000","last_change":"2024-05-15T14:27:52.854135+0000","last_active":"2024-05-15T14:46:32.416239+0000","last_peered":"2024-05-15T14:46:32.416239+0000","last_clean":"2024-05-15T14:46:32.416239+0000","last_became_active":"2024-05-15T14:27:52.853857+0000","last_became_peered":"2024-05-15T14:27:52.853857+0000","last_unstale":"2024-05-15T14:46:32.416239+0000","last_undegraded":"2024-05-15T14:46:32.416239+0000","last_fullsized":"2024-05-15T14:46:32.416239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":91,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"39'18","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518609+0000","last_change":"2024-05-15T14:27:50.844170+0000","last_active":"2024-05-15T14:45:52.518609+0000","last_peered":"2024-05-15T14:45:52.518609+0000","last_clean":"2024-05-15T14:45:52.518609+0000","last_became_active":"2024-05-15T14:27:50.843874+0000","last_became_peered":"2024-05-15T14:27:50.843874+0000","last_unstale":"2024-05-15T14:45:52.518609+0000","last_undegraded":"2024-05-15T14:45:52.518609+0000","last_fullsized":"2024-05-15T14:45:52.518609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:48.618636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"39'58","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.504998+0000","last_change":"2024-05-15T14:27:52.847675+0000","last_active":"2024-05-15T14:45:52.504998+0000","last_peered":"2024-05-15T14:45:52.504998+0000","last_clean":"2024-05-15T14:45:52.504998+0000","last_became_active":"2024-05-15T14:27:52.847362+0000","last_became_peered":"2024-05-15T14:27:52.847362+0000","last_unstale":"2024-05-15T14:45:52.504998+0000","last_undegraded":"2024-05-15T14:45:52.504998+0000","last_fullsized":"2024-05-15T14:45:52.504998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:06:52.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":172,"num_write":84,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411173+0000","last_change":"2024-05-15T14:27:50.846611+0000","last_active":"2024-05-15T14:45:52.411173+0000","last_peered":"2024-05-15T14:45:52.411173+0000","last_clean":"2024-05-15T14:45:52.411173+0000","last_became_active":"2024-05-15T14:27:50.846291+0000","last_became_peered":"2024-05-15T14:27:50.846291+0000","last_unstale":"2024-05-15T14:45:52.411173+0000","last_undegraded":"2024-05-15T14:45:52.411173+0000","last_fullsized":"2024-05-15T14:45:52.411173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:01.126044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":14702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"39'74","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327403+0000","last_change":"2024-05-15T14:27:52.848460+0000","last_active":"2024-05-15T14:47:54.327403+0000","last_peered":"2024-05-15T14:47:54.327403+0000","last_clean":"2024-05-15T14:47:54.327403+0000","last_became_active":"2024-05-15T14:27:52.848173+0000","last_became_peered":"2024-05-15T14:27:52.848173+0000","last_unstale":"2024-05-15T14:47:54.327403+0000","last_undegraded":"2024-05-15T14:47:54.327403+0000","last_fullsized":"2024-05-15T14:47:54.327403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":248,"num_write":102,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.417142+0000","last_change":"2024-05-15T14:27:50.847115+0000","last_active":"2024-05-15T14:45:52.417142+0000","last_peered":"2024-05-15T14:45:52.417142+0000","last_clean":"2024-05-15T14:45:52.417142+0000","last_became_active":"2024-05-15T14:27:50.846782+0000","last_became_peered":"2024-05-15T14:27:50.846782+0000","last_unstale":"2024-05-15T14:45:52.417142+0000","last_undegraded":"2024-05-15T14:45:52.417142+0000","last_fullsized":"2024-05-15T14:45:52.417142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"39'30","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840678+0000","last_change":"2024-05-15T14:27:52.851930+0000","last_active":"2024-05-15T14:47:53.840678+0000","last_peered":"2024-05-15T14:47:53.840678+0000","last_clean":"2024-05-15T14:47:53.840678+0000","last_became_active":"2024-05-15T14:27:52.851642+0000","last_became_peered":"2024-05-15T14:27:52.851642+0000","last_unstale":"2024-05-15T14:47:53.840678+0000","last_undegraded":"2024-05-15T14:47:53.840678+0000","last_fullsized":"2024-05-15T14:47:53.840678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":127,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.410649+0000","last_change":"2024-05-15T14:27:50.840821+0000","last_active":"2024-05-15T14:45:52.410649+0000","last_peered":"2024-05-15T14:45:52.410649+0000","last_clean":"2024-05-15T14:45:52.410649+0000","last_became_active":"2024-05-15T14:27:50.840467+0000","last_became_peered":"2024-05-15T14:27:50.840467+0000","last_unstale":"2024-05-15T14:45:52.410649+0000","last_undegraded":"2024-05-15T14:45:52.410649+0000","last_fullsized":"2024-05-15T14:45:52.410649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:07:30.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"39'92","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328290+0000","last_change":"2024-05-15T14:27:52.860211+0000","last_active":"2024-05-15T14:47:54.328290+0000","last_peered":"2024-05-15T14:47:54.328290+0000","last_clean":"2024-05-15T14:47:54.328290+0000","last_became_active":"2024-05-15T14:27:52.859926+0000","last_became_peered":"2024-05-15T14:27:52.859926+0000","last_unstale":"2024-05-15T14:47:54.328290+0000","last_undegraded":"2024-05-15T14:47:54.328290+0000","last_fullsized":"2024-05-15T14:47:54.328290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":270,"num_write":132,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"39'24","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.532445+0000","last_change":"2024-05-15T14:27:50.850215+0000","last_active":"2024-05-15T14:48:07.532445+0000","last_peered":"2024-05-15T14:48:07.532445+0000","last_clean":"2024-05-15T14:48:07.532445+0000","last_became_active":"2024-05-15T14:27:50.849936+0000","last_became_peered":"2024-05-15T14:27:50.849936+0000","last_unstale":"2024-05-15T14:48:07.532445+0000","last_undegraded":"2024-05-15T14:48:07.532445+0000","last_fullsized":"2024-05-15T14:48:07.532445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:18.416733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":112,"num_write_kb":36442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"39'62","reported_seq":162,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518575+0000","last_change":"2024-05-15T14:27:52.857096+0000","last_active":"2024-05-15T14:45:52.518575+0000","last_peered":"2024-05-15T14:45:52.518575+0000","last_clean":"2024-05-15T14:45:52.518575+0000","last_became_active":"2024-05-15T14:27:52.856767+0000","last_became_peered":"2024-05-15T14:27:52.856767+0000","last_unstale":"2024-05-15T14:45:52.518575+0000","last_undegraded":"2024-05-15T14:45:52.518575+0000","last_fullsized":"2024-05-15T14:45:52.518575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":205,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"39'18","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.509004+0000","last_change":"2024-05-15T14:27:50.842853+0000","last_active":"2024-05-15T14:46:32.509004+0000","last_peered":"2024-05-15T14:46:32.509004+0000","last_clean":"2024-05-15T14:46:32.509004+0000","last_became_active":"2024-05-15T14:27:50.842512+0000","last_became_peered":"2024-05-15T14:27:50.842512+0000","last_unstale":"2024-05-15T14:46:32.509004+0000","last_undegraded":"2024-05-15T14:46:32.509004+0000","last_fullsized":"2024-05-15T14:46:32.509004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:21.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"39'56","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304223+0000","last_change":"2024-05-15T14:27:52.855227+0000","last_active":"2024-05-15T14:47:54.304223+0000","last_peered":"2024-05-15T14:47:54.304223+0000","last_clean":"2024-05-15T14:47:54.304223+0000","last_became_active":"2024-05-15T14:27:52.854841+0000","last_became_peered":"2024-05-15T14:27:52.854841+0000","last_unstale":"2024-05-15T14:47:54.304223+0000","last_undegraded":"2024-05-15T14:47:54.304223+0000","last_fullsized":"2024-05-15T14:47:54.304223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":78,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"39'20","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416132+0000","last_change":"2024-05-15T14:27:50.848570+0000","last_active":"2024-05-15T14:46:32.416132+0000","last_peered":"2024-05-15T14:46:32.416132+0000","last_clean":"2024-05-15T14:46:32.416132+0000","last_became_active":"2024-05-15T14:27:50.848291+0000","last_became_peered":"2024-05-15T14:27:50.848291+0000","last_unstale":"2024-05-15T14:46:32.416132+0000","last_undegraded":"2024-05-15T14:46:32.416132+0000","last_fullsized":"2024-05-15T14:46:32.416132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":40,"num_write":100,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416004+0000","last_change":"2024-05-15T14:27:50.842699+0000","last_active":"2024-05-15T14:46:32.416004+0000","last_peered":"2024-05-15T14:46:32.416004+0000","last_clean":"2024-05-15T14:46:32.416004+0000","last_became_active":"2024-05-15T14:27:50.842420+0000","last_became_peered":"2024-05-15T14:27:50.842420+0000","last_unstale":"2024-05-15T14:46:32.416004+0000","last_undegraded":"2024-05-15T14:46:32.416004+0000","last_fullsized":"2024-05-15T14:46:32.416004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":90,"num_write_kb":20587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304330+0000","last_change":"2024-05-15T14:27:52.853871+0000","last_active":"2024-05-15T14:47:54.304330+0000","last_peered":"2024-05-15T14:47:54.304330+0000","last_clean":"2024-05-15T14:47:54.304330+0000","last_became_active":"2024-05-15T14:27:52.853329+0000","last_became_peered":"2024-05-15T14:27:52.853329+0000","last_unstale":"2024-05-15T14:47:54.304330+0000","last_undegraded":"2024-05-15T14:47:54.304330+0000","last_fullsized":"2024-05-15T14:47:54.304330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:03.135228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420349+0000","last_change":"2024-05-15T14:27:50.839786+0000","last_active":"2024-05-15T14:46:32.420349+0000","last_peered":"2024-05-15T14:46:32.420349+0000","last_clean":"2024-05-15T14:46:32.420349+0000","last_became_active":"2024-05-15T14:27:50.839496+0000","last_became_peered":"2024-05-15T14:27:50.839496+0000","last_unstale":"2024-05-15T14:46:32.420349+0000","last_undegraded":"2024-05-15T14:46:32.420349+0000","last_fullsized":"2024-05-15T14:46:32.420349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:53.186276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":17647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"39'70","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304247+0000","last_change":"2024-05-15T14:27:52.852295+0000","last_active":"2024-05-15T14:47:54.304247+0000","last_peered":"2024-05-15T14:47:54.304247+0000","last_clean":"2024-05-15T14:47:54.304247+0000","last_became_active":"2024-05-15T14:27:52.851973+0000","last_became_peered":"2024-05-15T14:27:52.851973+0000","last_unstale":"2024-05-15T14:47:54.304247+0000","last_undegraded":"2024-05-15T14:47:54.304247+0000","last_fullsized":"2024-05-15T14:47:54.304247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":234,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3423,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1381,"num_read_kb":1449,"num_write":1045,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":6846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":830,"ondisk_log_size":830,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11724,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":2162624,"num_read_kb":7062025,"num_write":12227,"num_write_kb":15784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1856,"ondisk_log_size":1856,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":14929,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5654,"num_read_kb":6894,"num_write":192,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":29858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9598,"num_read_kb":7988,"num_write":3212,"num_write_kb":1308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2246,"ondisk_log_size":2246,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2611,"num_read_kb":1724,"num_write":4445,"num_write_kb":1235021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575104,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335408,"statfs":{"total":96636764160,"available":96599457792,"internally_reserved":0,"allocated":1118208,"data_stored":815108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575105,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":487424,"data_stored":221551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575104,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44184,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327656,"statfs":{"total":96636764160,"available":96591519744,"internally_reserved":0,"allocated":536576,"data_stored":225223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575105,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":227462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575105,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":532480,"data_stored":222205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575105,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":491520,"data_stored":224011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575105,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":222247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575106,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1118208,"data_stored":816897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":68,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:48:57.476 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:48:57.829 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:48:57.836 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:48:57.838 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":669,"stamp":"2024-05-15T14:48:56.769703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620444,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":2181945,"num_read_kb":7080143,"num_write":21230,"num_write_kb":1254163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6230,"ondisk_log_size":6230,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275416,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699304,"statfs":{"total":773094113280,"available":772812087296,"internally_reserved":0,"allocated":5316608,"data_stored":2974704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003758"},"pg_stats":[{"pgid":"3.3f","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.520606+0000","last_change":"2024-05-15T14:27:50.850244+0000","last_active":"2024-05-15T14:46:37.520606+0000","last_peered":"2024-05-15T14:46:37.520606+0000","last_clean":"2024-05-15T14:46:37.520606+0000","last_became_active":"2024-05-15T14:27:50.849951+0000","last_became_peered":"2024-05-15T14:27:50.849951+0000","last_unstale":"2024-05-15T14:46:37.520606+0000","last_undegraded":"2024-05-15T14:46:37.520606+0000","last_fullsized":"2024-05-15T14:46:37.520606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'2","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.860511+0000","last_change":"2024-05-15T14:27:52.844115+0000","last_active":"2024-05-15T14:47:53.860511+0000","last_peered":"2024-05-15T14:47:53.860511+0000","last_clean":"2024-05-15T14:47:53.860511+0000","last_became_active":"2024-05-15T14:27:52.843836+0000","last_became_peered":"2024-05-15T14:27:52.843836+0000","last_unstale":"2024-05-15T14:47:53.860511+0000","last_undegraded":"2024-05-15T14:47:53.860511+0000","last_fullsized":"2024-05-15T14:47:53.860511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421276+0000","last_change":"2024-05-15T14:27:50.837638+0000","last_active":"2024-05-15T14:46:37.421276+0000","last_peered":"2024-05-15T14:46:37.421276+0000","last_clean":"2024-05-15T14:46:37.421276+0000","last_became_active":"2024-05-15T14:27:50.837321+0000","last_became_peered":"2024-05-15T14:27:50.837321+0000","last_unstale":"2024-05-15T14:46:37.421276+0000","last_undegraded":"2024-05-15T14:46:37.421276+0000","last_fullsized":"2024-05-15T14:46:37.421276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":50,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"39'10","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304257+0000","last_change":"2024-05-15T14:27:52.841298+0000","last_active":"2024-05-15T14:47:54.304257+0000","last_peered":"2024-05-15T14:47:54.304257+0000","last_clean":"2024-05-15T14:47:54.304257+0000","last_became_active":"2024-05-15T14:27:52.840977+0000","last_became_peered":"2024-05-15T14:27:52.840977+0000","last_unstale":"2024-05-15T14:47:54.304257+0000","last_undegraded":"2024-05-15T14:47:54.304257+0000","last_fullsized":"2024-05-15T14:47:54.304257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"39'8","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422141+0000","last_change":"2024-05-15T14:27:50.846251+0000","last_active":"2024-05-15T14:46:37.422141+0000","last_peered":"2024-05-15T14:46:37.422141+0000","last_clean":"2024-05-15T14:46:37.422141+0000","last_became_active":"2024-05-15T14:27:50.844989+0000","last_became_peered":"2024-05-15T14:27:50.844989+0000","last_unstale":"2024-05-15T14:46:37.422141+0000","last_undegraded":"2024-05-15T14:46:37.422141+0000","last_fullsized":"2024-05-15T14:46:37.422141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'24","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.833658+0000","last_change":"2024-05-15T14:27:52.850744+0000","last_active":"2024-05-15T14:47:53.833658+0000","last_peered":"2024-05-15T14:47:53.833658+0000","last_clean":"2024-05-15T14:47:53.833658+0000","last_became_active":"2024-05-15T14:27:52.850449+0000","last_became_peered":"2024-05-15T14:27:52.850449+0000","last_unstale":"2024-05-15T14:47:53.833658+0000","last_undegraded":"2024-05-15T14:47:53.833658+0000","last_fullsized":"2024-05-15T14:47:53.833658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":101,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"39'22","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.426566+0000","last_change":"2024-05-15T14:27:50.852104+0000","last_active":"2024-05-15T14:47:57.426566+0000","last_peered":"2024-05-15T14:47:57.426566+0000","last_clean":"2024-05-15T14:47:57.426566+0000","last_became_active":"2024-05-15T14:27:50.851846+0000","last_became_peered":"2024-05-15T14:27:50.851846+0000","last_unstale":"2024-05-15T14:47:57.426566+0000","last_undegraded":"2024-05-15T14:47:57.426566+0000","last_fullsized":"2024-05-15T14:47:57.426566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":27630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"39'4","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.806419+0000","last_change":"2024-05-15T14:27:52.854744+0000","last_active":"2024-05-15T14:47:53.806419+0000","last_peered":"2024-05-15T14:47:53.806419+0000","last_clean":"2024-05-15T14:47:53.806419+0000","last_became_active":"2024-05-15T14:27:52.854481+0000","last_became_peered":"2024-05-15T14:27:52.854481+0000","last_unstale":"2024-05-15T14:47:53.806419+0000","last_undegraded":"2024-05-15T14:47:53.806419+0000","last_fullsized":"2024-05-15T14:47:53.806419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"39'8","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.510681+0000","last_change":"2024-05-15T14:27:50.853255+0000","last_active":"2024-05-15T14:45:22.510681+0000","last_peered":"2024-05-15T14:45:22.510681+0000","last_clean":"2024-05-15T14:45:22.510681+0000","last_became_active":"2024-05-15T14:27:50.851756+0000","last_became_peered":"2024-05-15T14:27:50.851756+0000","last_unstale":"2024-05-15T14:45:22.510681+0000","last_undegraded":"2024-05-15T14:45:22.510681+0000","last_fullsized":"2024-05-15T14:45:22.510681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:50.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14,"num_write":40,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"39'8","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.411312+0000","last_change":"2024-05-15T14:27:52.845713+0000","last_active":"2024-05-15T14:45:57.411312+0000","last_peered":"2024-05-15T14:45:57.411312+0000","last_clean":"2024-05-15T14:45:57.411312+0000","last_became_active":"2024-05-15T14:27:52.844904+0000","last_became_peered":"2024-05-15T14:27:52.844904+0000","last_unstale":"2024-05-15T14:45:57.411312+0000","last_undegraded":"2024-05-15T14:45:57.411312+0000","last_fullsized":"2024-05-15T14:45:57.411312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:52.927880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"39'8","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026317+0000","last_change":"2024-05-15T14:27:50.847389+0000","last_active":"2024-05-15T14:48:26.026317+0000","last_peered":"2024-05-15T14:48:26.026317+0000","last_clean":"2024-05-15T14:48:26.026317+0000","last_became_active":"2024-05-15T14:27:50.847121+0000","last_became_peered":"2024-05-15T14:27:50.847121+0000","last_unstale":"2024-05-15T14:48:26.026317+0000","last_undegraded":"2024-05-15T14:48:26.026317+0000","last_fullsized":"2024-05-15T14:48:26.026317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:48.618636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":24,"num_write_kb":14074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'100","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327789+0000","last_change":"2024-05-15T14:27:52.848754+0000","last_active":"2024-05-15T14:47:54.327789+0000","last_peered":"2024-05-15T14:47:54.327789+0000","last_clean":"2024-05-15T14:47:54.327789+0000","last_became_active":"2024-05-15T14:27:52.848482+0000","last_became_peered":"2024-05-15T14:27:52.848482+0000","last_unstale":"2024-05-15T14:47:54.327789+0000","last_undegraded":"2024-05-15T14:47:54.327789+0000","last_fullsized":"2024-05-15T14:47:54.327789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":302,"num_write":142,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"39'10","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.510650+0000","last_change":"2024-05-15T14:27:50.852930+0000","last_active":"2024-05-15T14:45:22.510650+0000","last_peered":"2024-05-15T14:45:22.510650+0000","last_clean":"2024-05-15T14:45:22.510650+0000","last_became_active":"2024-05-15T14:27:50.852659+0000","last_became_peered":"2024-05-15T14:27:50.852659+0000","last_unstale":"2024-05-15T14:45:22.510650+0000","last_undegraded":"2024-05-15T14:45:22.510650+0000","last_fullsized":"2024-05-15T14:45:22.510650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840691+0000","last_change":"2024-05-15T14:27:52.839571+0000","last_active":"2024-05-15T14:47:53.840691+0000","last_peered":"2024-05-15T14:47:53.840691+0000","last_clean":"2024-05-15T14:47:53.840691+0000","last_became_active":"2024-05-15T14:27:52.839017+0000","last_became_peered":"2024-05-15T14:27:52.839017+0000","last_unstale":"2024-05-15T14:47:53.840691+0000","last_undegraded":"2024-05-15T14:47:53.840691+0000","last_fullsized":"2024-05-15T14:47:53.840691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.277374+0000","last_change":"2024-05-15T14:27:50.854894+0000","last_active":"2024-05-15T14:47:54.277374+0000","last_peered":"2024-05-15T14:47:54.277374+0000","last_clean":"2024-05-15T14:47:54.277374+0000","last_became_active":"2024-05-15T14:27:50.854408+0000","last_became_peered":"2024-05-15T14:27:50.854408+0000","last_unstale":"2024-05-15T14:47:54.277374+0000","last_undegraded":"2024-05-15T14:47:54.277374+0000","last_fullsized":"2024-05-15T14:47:54.277374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25,"num_write":70,"num_write_kb":17643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509693+0000","last_change":"2024-05-15T14:27:52.853989+0000","last_active":"2024-05-15T14:46:37.509693+0000","last_peered":"2024-05-15T14:46:37.509693+0000","last_clean":"2024-05-15T14:46:37.509693+0000","last_became_active":"2024-05-15T14:27:52.853688+0000","last_became_peered":"2024-05-15T14:27:52.853688+0000","last_unstale":"2024-05-15T14:46:37.509693+0000","last_undegraded":"2024-05-15T14:46:37.509693+0000","last_fullsized":"2024-05-15T14:46:37.509693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:01.973008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"39'4","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416117+0000","last_change":"2024-05-15T14:27:52.850830+0000","last_active":"2024-05-15T14:46:32.416117+0000","last_peered":"2024-05-15T14:46:32.416117+0000","last_clean":"2024-05-15T14:46:32.416117+0000","last_became_active":"2024-05-15T14:27:52.850532+0000","last_became_peered":"2024-05-15T14:27:52.850532+0000","last_unstale":"2024-05-15T14:46:32.416117+0000","last_undegraded":"2024-05-15T14:46:32.416117+0000","last_fullsized":"2024-05-15T14:46:32.416117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:35.585753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.267909+0000","last_change":"2024-05-15T14:27:50.852471+0000","last_active":"2024-05-15T14:47:54.267909+0000","last_peered":"2024-05-15T14:47:54.267909+0000","last_clean":"2024-05-15T14:47:54.267909+0000","last_became_active":"2024-05-15T14:27:50.852229+0000","last_became_peered":"2024-05-15T14:27:50.852229+0000","last_unstale":"2024-05-15T14:47:54.267909+0000","last_undegraded":"2024-05-15T14:47:54.267909+0000","last_fullsized":"2024-05-15T14:47:54.267909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:31.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"39'34","reported_seq":129,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.865681+0000","last_change":"2024-05-15T14:27:52.858540+0000","last_active":"2024-05-15T14:47:53.865681+0000","last_peered":"2024-05-15T14:47:53.865681+0000","last_clean":"2024-05-15T14:47:53.865681+0000","last_became_active":"2024-05-15T14:27:52.858331+0000","last_became_peered":"2024-05-15T14:27:52.858331+0000","last_unstale":"2024-05-15T14:47:53.865681+0000","last_undegraded":"2024-05-15T14:47:53.865681+0000","last_fullsized":"2024-05-15T14:47:53.865681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":123,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403413+0000","last_change":"2024-05-15T14:27:50.849840+0000","last_active":"2024-05-15T14:44:47.403413+0000","last_peered":"2024-05-15T14:44:47.403413+0000","last_clean":"2024-05-15T14:44:47.403413+0000","last_became_active":"2024-05-15T14:27:50.849526+0000","last_became_peered":"2024-05-15T14:27:50.849526+0000","last_unstale":"2024-05-15T14:44:47.403413+0000","last_undegraded":"2024-05-15T14:44:47.403413+0000","last_fullsized":"2024-05-15T14:44:47.403413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"39'6","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.859181+0000","last_change":"2024-05-15T14:27:52.840106+0000","last_active":"2024-05-15T14:47:53.859181+0000","last_peered":"2024-05-15T14:47:53.859181+0000","last_clean":"2024-05-15T14:47:53.859181+0000","last_became_active":"2024-05-15T14:27:52.838137+0000","last_became_peered":"2024-05-15T14:27:52.838137+0000","last_unstale":"2024-05-15T14:47:53.859181+0000","last_undegraded":"2024-05-15T14:47:53.859181+0000","last_fullsized":"2024-05-15T14:47:53.859181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403404+0000","last_change":"2024-05-15T14:27:50.842514+0000","last_active":"2024-05-15T14:44:47.403404+0000","last_peered":"2024-05-15T14:44:47.403404+0000","last_clean":"2024-05-15T14:44:47.403404+0000","last_became_active":"2024-05-15T14:27:50.842240+0000","last_became_peered":"2024-05-15T14:27:50.842240+0000","last_unstale":"2024-05-15T14:44:47.403404+0000","last_undegraded":"2024-05-15T14:44:47.403404+0000","last_fullsized":"2024-05-15T14:44:47.403404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:45:32.046811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":70,"num_write_kb":11769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"39'44","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.497397+0000","last_change":"2024-05-15T14:27:52.855297+0000","last_active":"2024-05-15T14:44:47.497397+0000","last_peered":"2024-05-15T14:44:47.497397+0000","last_clean":"2024-05-15T14:44:47.497397+0000","last_became_active":"2024-05-15T14:27:52.854742+0000","last_became_peered":"2024-05-15T14:27:52.854742+0000","last_unstale":"2024-05-15T14:44:47.497397+0000","last_undegraded":"2024-05-15T14:44:47.497397+0000","last_fullsized":"2024-05-15T14:44:47.497397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:51:10.843632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":128,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404810+0000","last_change":"2024-05-15T14:27:50.840673+0000","last_active":"2024-05-15T14:44:47.404810+0000","last_peered":"2024-05-15T14:44:47.404810+0000","last_clean":"2024-05-15T14:44:47.404810+0000","last_became_active":"2024-05-15T14:27:50.840405+0000","last_became_peered":"2024-05-15T14:27:50.840405+0000","last_unstale":"2024-05-15T14:44:47.404810+0000","last_undegraded":"2024-05-15T14:44:47.404810+0000","last_fullsized":"2024-05-15T14:44:47.404810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'52","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304178+0000","last_change":"2024-05-15T14:27:52.851060+0000","last_active":"2024-05-15T14:47:54.304178+0000","last_peered":"2024-05-15T14:47:54.304178+0000","last_clean":"2024-05-15T14:47:54.304178+0000","last_became_active":"2024-05-15T14:27:52.850696+0000","last_became_peered":"2024-05-15T14:27:52.850696+0000","last_unstale":"2024-05-15T14:47:54.304178+0000","last_undegraded":"2024-05-15T14:47:54.304178+0000","last_fullsized":"2024-05-15T14:47:54.304178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:06.868623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":72,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.262053+0000","last_change":"2024-05-15T14:27:50.849634+0000","last_active":"2024-05-15T14:47:54.262053+0000","last_peered":"2024-05-15T14:47:54.262053+0000","last_clean":"2024-05-15T14:47:54.262053+0000","last_became_active":"2024-05-15T14:27:50.848542+0000","last_became_peered":"2024-05-15T14:27:50.848542+0000","last_unstale":"2024-05-15T14:47:54.262053+0000","last_undegraded":"2024-05-15T14:47:54.262053+0000","last_fullsized":"2024-05-15T14:47:54.262053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:09.157377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":70,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"39'28","reported_seq":116,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404838+0000","last_change":"2024-05-15T14:27:52.861455+0000","last_active":"2024-05-15T14:44:47.404838+0000","last_peered":"2024-05-15T14:44:47.404838+0000","last_clean":"2024-05-15T14:44:47.404838+0000","last_became_active":"2024-05-15T14:27:52.861166+0000","last_became_peered":"2024-05-15T14:27:52.861166+0000","last_unstale":"2024-05-15T14:44:47.404838+0000","last_undegraded":"2024-05-15T14:44:47.404838+0000","last_fullsized":"2024-05-15T14:44:47.404838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":102,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.406163+0000","last_change":"2024-05-15T14:27:50.837948+0000","last_active":"2024-05-15T14:44:17.406163+0000","last_peered":"2024-05-15T14:44:17.406163+0000","last_clean":"2024-05-15T14:44:17.406163+0000","last_became_active":"2024-05-15T14:27:50.837594+0000","last_became_peered":"2024-05-15T14:27:50.837594+0000","last_unstale":"2024-05-15T14:44:17.406163+0000","last_undegraded":"2024-05-15T14:44:17.406163+0000","last_fullsized":"2024-05-15T14:44:17.406163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.517789+0000","last_change":"2024-05-15T14:31:16.589931+0000","last_active":"2024-05-15T14:45:47.517789+0000","last_peered":"2024-05-15T14:45:47.517789+0000","last_clean":"2024-05-15T14:45:47.517789+0000","last_became_active":"2024-05-15T14:31:16.589649+0000","last_became_peered":"2024-05-15T14:31:16.589649+0000","last_unstale":"2024-05-15T14:45:47.517789+0000","last_undegraded":"2024-05-15T14:45:47.517789+0000","last_fullsized":"2024-05-15T14:45:47.517789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:29:34.232384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"39'24","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.830825+0000","last_change":"2024-05-15T14:28:02.891667+0000","last_active":"2024-05-15T14:47:53.830825+0000","last_peered":"2024-05-15T14:47:53.830825+0000","last_clean":"2024-05-15T14:47:53.830825+0000","last_became_active":"2024-05-15T14:28:02.891340+0000","last_became_peered":"2024-05-15T14:28:02.891340+0000","last_unstale":"2024-05-15T14:47:53.830825+0000","last_undegraded":"2024-05-15T14:47:53.830825+0000","last_fullsized":"2024-05-15T14:47:53.830825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:35.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":38,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"39'78","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328201+0000","last_change":"2024-05-15T14:27:52.863225+0000","last_active":"2024-05-15T14:47:54.328201+0000","last_peered":"2024-05-15T14:47:54.328201+0000","last_clean":"2024-05-15T14:47:54.328201+0000","last_became_active":"2024-05-15T14:27:52.862960+0000","last_became_peered":"2024-05-15T14:27:52.862960+0000","last_unstale":"2024-05-15T14:47:54.328201+0000","last_undegraded":"2024-05-15T14:47:54.328201+0000","last_fullsized":"2024-05-15T14:47:54.328201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":231,"num_write":112,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519858+0000","last_change":"2024-05-15T14:27:50.849295+0000","last_active":"2024-05-15T14:46:32.519858+0000","last_peered":"2024-05-15T14:46:32.519858+0000","last_clean":"2024-05-15T14:46:32.519858+0000","last_became_active":"2024-05-15T14:27:50.849039+0000","last_became_peered":"2024-05-15T14:27:50.849039+0000","last_unstale":"2024-05-15T14:46:32.519858+0000","last_undegraded":"2024-05-15T14:46:32.519858+0000","last_fullsized":"2024-05-15T14:46:32.519858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:14.556752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.403978+0000","last_change":"2024-05-15T14:27:56.876839+0000","last_active":"2024-05-15T14:44:52.403978+0000","last_peered":"2024-05-15T14:44:52.403978+0000","last_clean":"2024-05-15T14:44:52.403978+0000","last_became_active":"2024-05-15T14:27:56.876559+0000","last_became_peered":"2024-05-15T14:27:56.876559+0000","last_unstale":"2024-05-15T14:44:52.403978+0000","last_undegraded":"2024-05-15T14:44:52.403978+0000","last_fullsized":"2024-05-15T14:44:52.403978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"39'264","reported_seq":538,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.030050+0000","last_change":"2024-05-15T14:27:58.884292+0000","last_active":"2024-05-15T14:48:26.030050+0000","last_peered":"2024-05-15T14:48:26.030050+0000","last_clean":"2024-05-15T14:48:26.030050+0000","last_became_active":"2024-05-15T14:27:58.883983+0000","last_became_peered":"2024-05-15T14:27:58.883983+0000","last_unstale":"2024-05-15T14:48:26.030050+0000","last_undegraded":"2024-05-15T14:48:26.030050+0000","last_fullsized":"2024-05-15T14:48:26.030050+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:56.197135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":452,"num_read_kb":554,"num_write":242,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.507472+0000","last_change":"2024-05-15T14:28:00.888232+0000","last_active":"2024-05-15T14:44:57.507472+0000","last_peered":"2024-05-15T14:44:57.507472+0000","last_clean":"2024-05-15T14:44:57.507472+0000","last_became_active":"2024-05-15T14:28:00.887947+0000","last_became_peered":"2024-05-15T14:28:00.887947+0000","last_unstale":"2024-05-15T14:44:57.507472+0000","last_undegraded":"2024-05-15T14:44:57.507472+0000","last_fullsized":"2024-05-15T14:44:57.507472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:52.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.410185+0000","last_change":"2024-05-15T14:31:16.588732+0000","last_active":"2024-05-15T14:45:47.410185+0000","last_peered":"2024-05-15T14:45:47.410185+0000","last_clean":"2024-05-15T14:45:47.410185+0000","last_became_active":"2024-05-15T14:31:16.588437+0000","last_became_peered":"2024-05-15T14:31:16.588437+0000","last_unstale":"2024-05-15T14:45:47.410185+0000","last_undegraded":"2024-05-15T14:45:47.410185+0000","last_fullsized":"2024-05-15T14:45:47.410185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:07:39.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"39'109","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.330362+0000","last_change":"2024-05-15T14:28:02.890784+0000","last_active":"2024-05-15T14:47:54.330362+0000","last_peered":"2024-05-15T14:47:54.330362+0000","last_clean":"2024-05-15T14:47:54.330362+0000","last_became_active":"2024-05-15T14:28:02.890477+0000","last_became_peered":"2024-05-15T14:28:02.890477+0000","last_unstale":"2024-05-15T14:47:54.330362+0000","last_undegraded":"2024-05-15T14:47:54.330362+0000","last_fullsized":"2024-05-15T14:47:54.330362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:18.439604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":241,"num_write":191,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"39'4","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.833264+0000","last_change":"2024-05-15T14:27:52.841464+0000","last_active":"2024-05-15T14:47:53.833264+0000","last_peered":"2024-05-15T14:47:53.833264+0000","last_clean":"2024-05-15T14:47:53.833264+0000","last_became_active":"2024-05-15T14:27:52.840847+0000","last_became_peered":"2024-05-15T14:27:52.840847+0000","last_unstale":"2024-05-15T14:47:53.833264+0000","last_undegraded":"2024-05-15T14:47:53.833264+0000","last_fullsized":"2024-05-15T14:47:53.833264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.024900+0000","last_change":"2024-05-15T14:27:50.846344+0000","last_active":"2024-05-15T14:48:26.024900+0000","last_peered":"2024-05-15T14:48:26.024900+0000","last_clean":"2024-05-15T14:48:26.024900+0000","last_became_active":"2024-05-15T14:27:50.845923+0000","last_became_peered":"2024-05-15T14:27:50.845923+0000","last_unstale":"2024-05-15T14:48:26.024900+0000","last_undegraded":"2024-05-15T14:48:26.024900+0000","last_fullsized":"2024-05-15T14:48:26.024900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:38.935625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32,"num_write":82,"num_write_kb":27622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.505308+0000","last_change":"2024-05-15T14:27:56.876632+0000","last_active":"2024-05-15T14:44:17.505308+0000","last_peered":"2024-05-15T14:44:17.505308+0000","last_clean":"2024-05-15T14:44:17.505308+0000","last_became_active":"2024-05-15T14:27:56.876325+0000","last_became_peered":"2024-05-15T14:27:56.876325+0000","last_unstale":"2024-05-15T14:44:17.505308+0000","last_undegraded":"2024-05-15T14:44:17.505308+0000","last_fullsized":"2024-05-15T14:44:17.505308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"39'141","reported_seq":254,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.677666+0000","last_change":"2024-05-15T14:27:58.884267+0000","last_active":"2024-05-15T14:47:52.677666+0000","last_peered":"2024-05-15T14:47:52.677666+0000","last_clean":"2024-05-15T14:47:52.677666+0000","last_became_active":"2024-05-15T14:27:58.883792+0000","last_became_peered":"2024-05-15T14:27:58.883792+0000","last_unstale":"2024-05-15T14:47:52.677666+0000","last_undegraded":"2024-05-15T14:47:52.677666+0000","last_fullsized":"2024-05-15T14:47:52.677666+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:40.853095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":205,"num_write":143,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.405883+0000","last_change":"2024-05-15T14:28:00.886183+0000","last_active":"2024-05-15T14:44:57.405883+0000","last_peered":"2024-05-15T14:44:57.405883+0000","last_clean":"2024-05-15T14:44:57.405883+0000","last_became_active":"2024-05-15T14:28:00.885933+0000","last_became_peered":"2024-05-15T14:28:00.885933+0000","last_unstale":"2024-05-15T14:44:57.405883+0000","last_undegraded":"2024-05-15T14:44:57.405883+0000","last_fullsized":"2024-05-15T14:44:57.405883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:54:06.577512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.522169+0000","last_change":"2024-05-15T14:31:16.594655+0000","last_active":"2024-05-15T14:46:17.522169+0000","last_peered":"2024-05-15T14:46:17.522169+0000","last_clean":"2024-05-15T14:46:17.522169+0000","last_became_active":"2024-05-15T14:31:16.594357+0000","last_became_peered":"2024-05-15T14:31:16.594357+0000","last_unstale":"2024-05-15T14:46:17.522169+0000","last_undegraded":"2024-05-15T14:46:17.522169+0000","last_fullsized":"2024-05-15T14:46:17.522169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:40.584210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"39'16","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.231721+0000","last_change":"2024-05-15T14:28:02.893788+0000","last_active":"2024-05-15T14:46:21.231721+0000","last_peered":"2024-05-15T14:46:21.231721+0000","last_clean":"2024-05-15T14:46:21.231721+0000","last_became_active":"2024-05-15T14:28:02.892764+0000","last_became_peered":"2024-05-15T14:28:02.892764+0000","last_unstale":"2024-05-15T14:46:21.231721+0000","last_undegraded":"2024-05-15T14:46:21.231721+0000","last_fullsized":"2024-05-15T14:46:21.231721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"39'26","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.831811+0000","last_change":"2024-05-15T14:27:52.853179+0000","last_active":"2024-05-15T14:47:53.831811+0000","last_peered":"2024-05-15T14:47:53.831811+0000","last_clean":"2024-05-15T14:47:53.831811+0000","last_became_active":"2024-05-15T14:27:52.852883+0000","last_became_peered":"2024-05-15T14:27:52.852883+0000","last_unstale":"2024-05-15T14:47:53.831811+0000","last_undegraded":"2024-05-15T14:47:53.831811+0000","last_fullsized":"2024-05-15T14:47:53.831811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519834+0000","last_change":"2024-05-15T14:27:50.848690+0000","last_active":"2024-05-15T14:46:32.519834+0000","last_peered":"2024-05-15T14:46:32.519834+0000","last_clean":"2024-05-15T14:46:32.519834+0000","last_became_active":"2024-05-15T14:27:50.848412+0000","last_became_peered":"2024-05-15T14:27:50.848412+0000","last_unstale":"2024-05-15T14:46:32.519834+0000","last_undegraded":"2024-05-15T14:46:32.519834+0000","last_fullsized":"2024-05-15T14:46:32.519834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"39'14","reported_seq":693,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.906177+0000","last_change":"2024-05-15T14:27:56.877306+0000","last_active":"2024-05-15T14:48:25.906177+0000","last_peered":"2024-05-15T14:48:25.906177+0000","last_clean":"2024-05-15T14:48:25.906177+0000","last_became_active":"2024-05-15T14:27:56.877039+0000","last_became_peered":"2024-05-15T14:27:56.877039+0000","last_unstale":"2024-05-15T14:48:25.906177+0000","last_undegraded":"2024-05-15T14:48:25.906177+0000","last_fullsized":"2024-05-15T14:48:25.906177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":633,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"39'242","reported_seq":403,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.698585+0000","last_change":"2024-05-15T14:27:58.888330+0000","last_active":"2024-05-15T14:47:52.698585+0000","last_peered":"2024-05-15T14:47:52.698585+0000","last_clean":"2024-05-15T14:47:52.698585+0000","last_became_active":"2024-05-15T14:27:58.887969+0000","last_became_peered":"2024-05-15T14:27:58.887969+0000","last_unstale":"2024-05-15T14:47:52.698585+0000","last_undegraded":"2024-05-15T14:47:52.698585+0000","last_fullsized":"2024-05-15T14:47:52.698585+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:58.967265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":351,"num_read_kb":343,"num_write":242,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'924","reported_seq":1430,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.089617+0000","last_change":"2024-05-15T14:28:00.893106+0000","last_active":"2024-05-15T14:48:26.089617+0000","last_peered":"2024-05-15T14:48:26.089617+0000","last_clean":"2024-05-15T14:48:26.089617+0000","last_became_active":"2024-05-15T14:28:00.892864+0000","last_became_peered":"2024-05-15T14:28:00.892864+0000","last_unstale":"2024-05-15T14:48:26.089617+0000","last_undegraded":"2024-05-15T14:48:26.089617+0000","last_fullsized":"2024-05-15T14:48:26.089617+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:44.055462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.522137+0000","last_change":"2024-05-15T14:31:16.584361+0000","last_active":"2024-05-15T14:46:17.522137+0000","last_peered":"2024-05-15T14:46:17.522137+0000","last_clean":"2024-05-15T14:46:17.522137+0000","last_became_active":"2024-05-15T14:31:16.583997+0000","last_became_peered":"2024-05-15T14:31:16.583997+0000","last_unstale":"2024-05-15T14:46:17.522137+0000","last_undegraded":"2024-05-15T14:46:17.522137+0000","last_fullsized":"2024-05-15T14:46:17.522137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:37:56.322484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"39'29","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.868517+0000","last_change":"2024-05-15T14:28:02.887587+0000","last_active":"2024-05-15T14:47:53.868517+0000","last_peered":"2024-05-15T14:47:53.868517+0000","last_clean":"2024-05-15T14:47:53.868517+0000","last_became_active":"2024-05-15T14:28:02.887257+0000","last_became_peered":"2024-05-15T14:28:02.887257+0000","last_unstale":"2024-05-15T14:47:53.868517+0000","last_undegraded":"2024-05-15T14:47:53.868517+0000","last_fullsized":"2024-05-15T14:47:53.868517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":53,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"39'24","reported_seq":108,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.359438+0000","last_change":"2024-05-15T14:27:52.852418+0000","last_active":"2024-05-15T14:46:21.359438+0000","last_peered":"2024-05-15T14:46:21.359438+0000","last_clean":"2024-05-15T14:46:21.359438+0000","last_became_active":"2024-05-15T14:27:52.851979+0000","last_became_peered":"2024-05-15T14:27:52.851979+0000","last_unstale":"2024-05-15T14:46:21.359438+0000","last_undegraded":"2024-05-15T14:46:21.359438+0000","last_fullsized":"2024-05-15T14:46:21.359438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:38.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":90,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"39'6","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.415609+0000","last_change":"2024-05-15T14:27:50.841076+0000","last_active":"2024-05-15T14:46:32.415609+0000","last_peered":"2024-05-15T14:46:32.415609+0000","last_clean":"2024-05-15T14:46:32.415609+0000","last_became_active":"2024-05-15T14:27:50.840772+0000","last_became_peered":"2024-05-15T14:27:50.840772+0000","last_unstale":"2024-05-15T14:46:32.415609+0000","last_undegraded":"2024-05-15T14:46:32.415609+0000","last_fullsized":"2024-05-15T14:46:32.415609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:48:10.102924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":30,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.404007+0000","last_change":"2024-05-15T14:27:56.878098+0000","last_active":"2024-05-15T14:44:52.404007+0000","last_peered":"2024-05-15T14:44:52.404007+0000","last_clean":"2024-05-15T14:44:52.404007+0000","last_became_active":"2024-05-15T14:27:56.877825+0000","last_became_peered":"2024-05-15T14:27:56.877825+0000","last_unstale":"2024-05-15T14:44:52.404007+0000","last_undegraded":"2024-05-15T14:44:52.404007+0000","last_fullsized":"2024-05-15T14:44:52.404007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"39'273","reported_seq":23277,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.006669+0000","last_change":"2024-05-15T14:27:58.887851+0000","last_active":"2024-05-15T14:48:26.006669+0000","last_peered":"2024-05-15T14:48:26.006669+0000","last_clean":"2024-05-15T14:48:26.006669+0000","last_became_active":"2024-05-15T14:27:58.887424+0000","last_became_peered":"2024-05-15T14:27:58.887424+0000","last_unstale":"2024-05-15T14:48:26.006669+0000","last_undegraded":"2024-05-15T14:48:26.006669+0000","last_fullsized":"2024-05-15T14:48:26.006669+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:51.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57540,"num_read_kb":170980,"num_write":272,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'924","reported_seq":2595,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.093366+0000","last_change":"2024-05-15T14:28:00.887805+0000","last_active":"2024-05-15T14:48:26.093366+0000","last_peered":"2024-05-15T14:48:26.093366+0000","last_clean":"2024-05-15T14:48:26.093366+0000","last_became_active":"2024-05-15T14:28:00.887493+0000","last_became_peered":"2024-05-15T14:28:00.887493+0000","last_unstale":"2024-05-15T14:48:26.093366+0000","last_undegraded":"2024-05-15T14:48:26.093366+0000","last_fullsized":"2024-05-15T14:48:26.093366+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:53.511634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.417667+0000","last_change":"2024-05-15T14:31:16.592231+0000","last_active":"2024-05-15T14:45:57.417667+0000","last_peered":"2024-05-15T14:45:57.417667+0000","last_clean":"2024-05-15T14:45:57.417667+0000","last_became_active":"2024-05-15T14:31:16.591945+0000","last_became_peered":"2024-05-15T14:31:16.591945+0000","last_unstale":"2024-05-15T14:45:57.417667+0000","last_undegraded":"2024-05-15T14:45:57.417667+0000","last_fullsized":"2024-05-15T14:45:57.417667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:40:04.556406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"39'16","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304202+0000","last_change":"2024-05-15T14:27:52.842530+0000","last_active":"2024-05-15T14:47:54.304202+0000","last_peered":"2024-05-15T14:47:54.304202+0000","last_clean":"2024-05-15T14:47:54.304202+0000","last_became_active":"2024-05-15T14:27:52.842056+0000","last_became_peered":"2024-05-15T14:27:52.842056+0000","last_unstale":"2024-05-15T14:47:54.304202+0000","last_undegraded":"2024-05-15T14:47:54.304202+0000","last_fullsized":"2024-05-15T14:47:54.304202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.267576+0000","last_change":"2024-05-15T14:27:50.850292+0000","last_active":"2024-05-15T14:47:54.267576+0000","last_peered":"2024-05-15T14:47:54.267576+0000","last_clean":"2024-05-15T14:47:54.267576+0000","last_became_active":"2024-05-15T14:27:50.849981+0000","last_became_peered":"2024-05-15T14:27:50.849981+0000","last_unstale":"2024-05-15T14:47:54.267576+0000","last_undegraded":"2024-05-15T14:47:54.267576+0000","last_fullsized":"2024-05-15T14:47:54.267576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"39'1","reported_seq":128,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.825445+0000","last_change":"2024-05-15T14:27:56.878571+0000","last_active":"2024-05-15T14:46:21.825445+0000","last_peered":"2024-05-15T14:46:21.825445+0000","last_clean":"2024-05-15T14:46:21.825445+0000","last_became_active":"2024-05-15T14:27:56.878269+0000","last_became_peered":"2024-05-15T14:27:56.878269+0000","last_unstale":"2024-05-15T14:46:21.825445+0000","last_undegraded":"2024-05-15T14:46:21.825445+0000","last_fullsized":"2024-05-15T14:46:21.825445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:26.010836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":160,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"39'424","reported_seq":731,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.042504+0000","last_change":"2024-05-15T14:27:58.883936+0000","last_active":"2024-05-15T14:48:26.042504+0000","last_peered":"2024-05-15T14:48:26.042504+0000","last_clean":"2024-05-15T14:48:26.042504+0000","last_became_active":"2024-05-15T14:27:58.883546+0000","last_became_peered":"2024-05-15T14:27:58.883546+0000","last_unstale":"2024-05-15T14:48:26.042504+0000","last_undegraded":"2024-05-15T14:48:26.042504+0000","last_fullsized":"2024-05-15T14:48:26.042504+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.266839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":662,"num_read_kb":650,"num_write":400,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:02.416557+0000","last_change":"2024-05-15T14:28:00.892179+0000","last_active":"2024-05-15T14:46:02.416557+0000","last_peered":"2024-05-15T14:46:02.416557+0000","last_clean":"2024-05-15T14:46:02.416557+0000","last_became_active":"2024-05-15T14:28:00.891863+0000","last_became_peered":"2024-05-15T14:28:00.891863+0000","last_unstale":"2024-05-15T14:46:02.416557+0000","last_undegraded":"2024-05-15T14:46:02.416557+0000","last_fullsized":"2024-05-15T14:46:02.416557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:21:35.957485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"39'26","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.306684+0000","last_change":"2024-05-15T14:28:02.890786+0000","last_active":"2024-05-15T14:47:54.306684+0000","last_peered":"2024-05-15T14:47:54.306684+0000","last_clean":"2024-05-15T14:47:54.306684+0000","last_became_active":"2024-05-15T14:28:02.890450+0000","last_became_peered":"2024-05-15T14:28:02.890450+0000","last_unstale":"2024-05-15T14:47:54.306684+0000","last_undegraded":"2024-05-15T14:47:54.306684+0000","last_fullsized":"2024-05-15T14:47:54.306684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.415229+0000","last_change":"2024-05-15T14:31:16.596637+0000","last_active":"2024-05-15T14:45:52.415229+0000","last_peered":"2024-05-15T14:45:52.415229+0000","last_clean":"2024-05-15T14:45:52.415229+0000","last_became_active":"2024-05-15T14:31:16.596344+0000","last_became_peered":"2024-05-15T14:31:16.596344+0000","last_unstale":"2024-05-15T14:45:52.415229+0000","last_undegraded":"2024-05-15T14:45:52.415229+0000","last_fullsized":"2024-05-15T14:45:52.415229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:45:44.262981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'6","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304209+0000","last_change":"2024-05-15T14:27:52.861403+0000","last_active":"2024-05-15T14:47:54.304209+0000","last_peered":"2024-05-15T14:47:54.304209+0000","last_clean":"2024-05-15T14:47:54.304209+0000","last_became_active":"2024-05-15T14:27:52.861131+0000","last_became_peered":"2024-05-15T14:27:52.861131+0000","last_unstale":"2024-05-15T14:47:54.304209+0000","last_undegraded":"2024-05-15T14:47:54.304209+0000","last_fullsized":"2024-05-15T14:47:54.304209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514795+0000","last_change":"2024-05-15T14:27:50.848143+0000","last_active":"2024-05-15T14:45:52.514795+0000","last_peered":"2024-05-15T14:45:52.514795+0000","last_clean":"2024-05-15T14:45:52.514795+0000","last_became_active":"2024-05-15T14:27:50.847875+0000","last_became_peered":"2024-05-15T14:27:50.847875+0000","last_unstale":"2024-05-15T14:45:52.514795+0000","last_undegraded":"2024-05-15T14:45:52.514795+0000","last_fullsized":"2024-05-15T14:45:52.514795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":11761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"39'1","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:50.280149+0000","last_change":"2024-05-15T14:27:56.881386+0000","last_active":"2024-05-15T14:46:50.280149+0000","last_peered":"2024-05-15T14:46:50.280149+0000","last_clean":"2024-05-15T14:46:50.280149+0000","last_became_active":"2024-05-15T14:27:56.881088+0000","last_became_peered":"2024-05-15T14:27:56.881088+0000","last_unstale":"2024-05-15T14:46:50.280149+0000","last_undegraded":"2024-05-15T14:46:50.280149+0000","last_fullsized":"2024-05-15T14:46:50.280149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:07:36.170847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"39'622","reported_seq":1004,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.083775+0000","last_change":"2024-05-15T14:27:58.883054+0000","last_active":"2024-05-15T14:48:26.083775+0000","last_peered":"2024-05-15T14:48:26.083775+0000","last_clean":"2024-05-15T14:48:26.083775+0000","last_became_active":"2024-05-15T14:27:58.882302+0000","last_became_peered":"2024-05-15T14:27:58.882302+0000","last_unstale":"2024-05-15T14:48:26.083775+0000","last_undegraded":"2024-05-15T14:48:26.083775+0000","last_fullsized":"2024-05-15T14:48:26.083775+0000","mapping_epoch":26,"log_start":"39'598","ondisk_log_start":"39'598","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":598,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:01.547992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1282,"num_read_kb":3196,"num_write":804,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.514379+0000","last_change":"2024-05-15T14:28:00.887671+0000","last_active":"2024-05-15T14:45:22.514379+0000","last_peered":"2024-05-15T14:45:22.514379+0000","last_clean":"2024-05-15T14:45:22.514379+0000","last_became_active":"2024-05-15T14:28:00.887335+0000","last_became_peered":"2024-05-15T14:28:00.887335+0000","last_unstale":"2024-05-15T14:45:22.514379+0000","last_undegraded":"2024-05-15T14:45:22.514379+0000","last_fullsized":"2024-05-15T14:45:22.514379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:16.436035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"39'15","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.314845+0000","last_change":"2024-05-15T14:28:02.889484+0000","last_active":"2024-05-15T14:47:54.314845+0000","last_peered":"2024-05-15T14:47:54.314845+0000","last_clean":"2024-05-15T14:47:54.314845+0000","last_became_active":"2024-05-15T14:28:02.889193+0000","last_became_peered":"2024-05-15T14:28:02.889193+0000","last_unstale":"2024-05-15T14:47:54.314845+0000","last_undegraded":"2024-05-15T14:47:54.314845+0000","last_fullsized":"2024-05-15T14:47:54.314845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:38.654471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.415472+0000","last_change":"2024-05-15T14:31:16.591065+0000","last_active":"2024-05-15T14:46:27.415472+0000","last_peered":"2024-05-15T14:46:27.415472+0000","last_clean":"2024-05-15T14:46:27.415472+0000","last_became_active":"2024-05-15T14:31:16.590510+0000","last_became_peered":"2024-05-15T14:31:16.590510+0000","last_unstale":"2024-05-15T14:46:27.415472+0000","last_undegraded":"2024-05-15T14:46:27.415472+0000","last_fullsized":"2024-05-15T14:46:27.415472+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:15.350673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"39'64","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.296114+0000","last_change":"2024-05-15T14:27:52.861599+0000","last_active":"2024-05-15T14:47:54.296114+0000","last_peered":"2024-05-15T14:47:54.296114+0000","last_clean":"2024-05-15T14:47:54.296114+0000","last_became_active":"2024-05-15T14:27:52.861183+0000","last_became_peered":"2024-05-15T14:27:52.861183+0000","last_unstale":"2024-05-15T14:47:54.296114+0000","last_undegraded":"2024-05-15T14:47:54.296114+0000","last_fullsized":"2024-05-15T14:47:54.296114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:37.266001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":194,"num_write":90,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514768+0000","last_change":"2024-05-15T14:27:50.853049+0000","last_active":"2024-05-15T14:45:52.514768+0000","last_peered":"2024-05-15T14:45:52.514768+0000","last_clean":"2024-05-15T14:45:52.514768+0000","last_became_active":"2024-05-15T14:27:50.852376+0000","last_became_peered":"2024-05-15T14:27:50.852376+0000","last_unstale":"2024-05-15T14:45:52.514768+0000","last_undegraded":"2024-05-15T14:45:52.514768+0000","last_fullsized":"2024-05-15T14:45:52.514768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"25'1","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.359199+0000","last_change":"2024-05-15T14:27:56.881977+0000","last_active":"2024-05-15T14:47:52.359199+0000","last_peered":"2024-05-15T14:47:52.359199+0000","last_clean":"2024-05-15T14:47:52.359199+0000","last_became_active":"2024-05-15T14:27:56.881701+0000","last_became_peered":"2024-05-15T14:27:56.881701+0000","last_unstale":"2024-05-15T14:47:52.359199+0000","last_undegraded":"2024-05-15T14:47:52.359199+0000","last_fullsized":"2024-05-15T14:47:52.359199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:58:05.807690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"39'431","reported_seq":790,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.048598+0000","last_change":"2024-05-15T14:27:58.886060+0000","last_active":"2024-05-15T14:48:26.048598+0000","last_peered":"2024-05-15T14:48:26.048598+0000","last_clean":"2024-05-15T14:48:26.048598+0000","last_became_active":"2024-05-15T14:27:58.885487+0000","last_became_peered":"2024-05-15T14:27:58.885487+0000","last_unstale":"2024-05-15T14:48:26.048598+0000","last_undegraded":"2024-05-15T14:48:26.048598+0000","last_fullsized":"2024-05-15T14:48:26.048598+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:27.428584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":872,"num_read_kb":1334,"num_write":445,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"39'924","reported_seq":1544,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.094334+0000","last_change":"2024-05-15T14:28:00.893226+0000","last_active":"2024-05-15T14:48:26.094334+0000","last_peered":"2024-05-15T14:48:26.094334+0000","last_clean":"2024-05-15T14:48:26.094334+0000","last_became_active":"2024-05-15T14:28:00.892897+0000","last_became_peered":"2024-05-15T14:28:00.892897+0000","last_unstale":"2024-05-15T14:48:26.094334+0000","last_undegraded":"2024-05-15T14:48:26.094334+0000","last_fullsized":"2024-05-15T14:48:26.094334+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:36.428903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"39'14","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.753138+0000","last_change":"2024-05-15T14:28:02.894508+0000","last_active":"2024-05-15T14:47:53.753138+0000","last_peered":"2024-05-15T14:47:53.753138+0000","last_clean":"2024-05-15T14:47:53.753138+0000","last_became_active":"2024-05-15T14:28:02.894071+0000","last_became_peered":"2024-05-15T14:28:02.894071+0000","last_unstale":"2024-05-15T14:47:53.753138+0000","last_undegraded":"2024-05-15T14:47:53.753138+0000","last_fullsized":"2024-05-15T14:47:53.753138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:44.977557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.415437+0000","last_change":"2024-05-15T14:31:16.591474+0000","last_active":"2024-05-15T14:46:27.415437+0000","last_peered":"2024-05-15T14:46:27.415437+0000","last_clean":"2024-05-15T14:46:27.415437+0000","last_became_active":"2024-05-15T14:31:16.591166+0000","last_became_peered":"2024-05-15T14:31:16.591166+0000","last_unstale":"2024-05-15T14:46:27.415437+0000","last_undegraded":"2024-05-15T14:46:27.415437+0000","last_fullsized":"2024-05-15T14:46:27.415437+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:19:18.238793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'114","reported_seq":206,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328155+0000","last_change":"2024-05-15T14:27:52.860101+0000","last_active":"2024-05-15T14:47:54.328155+0000","last_peered":"2024-05-15T14:47:54.328155+0000","last_clean":"2024-05-15T14:47:54.328155+0000","last_became_active":"2024-05-15T14:27:52.859814+0000","last_became_peered":"2024-05-15T14:27:52.859814+0000","last_unstale":"2024-05-15T14:47:54.328155+0000","last_undegraded":"2024-05-15T14:47:54.328155+0000","last_fullsized":"2024-05-15T14:47:54.328155+0000","mapping_epoch":20,"log_start":"39'100","ondisk_log_start":"39'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":332,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411210+0000","last_change":"2024-05-15T14:27:50.849872+0000","last_active":"2024-05-15T14:45:52.411210+0000","last_peered":"2024-05-15T14:45:52.411210+0000","last_clean":"2024-05-15T14:45:52.411210+0000","last_became_active":"2024-05-15T14:27:50.849548+0000","last_became_peered":"2024-05-15T14:27:50.849548+0000","last_unstale":"2024-05-15T14:45:52.411210+0000","last_undegraded":"2024-05-15T14:45:52.411210+0000","last_fullsized":"2024-05-15T14:45:52.411210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"39'5","reported_seq":646,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:45.632505+0000","last_change":"2024-05-15T14:27:56.871956+0000","last_active":"2024-05-15T14:48:45.632505+0000","last_peered":"2024-05-15T14:48:45.632505+0000","last_clean":"2024-05-15T14:48:45.632505+0000","last_became_active":"2024-05-15T14:27:56.871644+0000","last_became_peered":"2024-05-15T14:27:56.871644+0000","last_unstale":"2024-05-15T14:48:45.632505+0000","last_undegraded":"2024-05-15T14:48:45.632505+0000","last_fullsized":"2024-05-15T14:48:45.632505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:48:16.147799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":148,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'275","reported_seq":560,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.054464+0000","last_change":"2024-05-15T14:27:58.881240+0000","last_active":"2024-05-15T14:48:26.054464+0000","last_peered":"2024-05-15T14:48:26.054464+0000","last_clean":"2024-05-15T14:48:26.054464+0000","last_became_active":"2024-05-15T14:27:58.880926+0000","last_became_peered":"2024-05-15T14:27:58.880926+0000","last_unstale":"2024-05-15T14:48:26.054464+0000","last_undegraded":"2024-05-15T14:48:26.054464+0000","last_fullsized":"2024-05-15T14:48:26.054464+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:51.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":466,"num_read_kb":455,"num_write":228,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.501382+0000","last_change":"2024-05-15T14:28:00.886629+0000","last_active":"2024-05-15T14:45:22.501382+0000","last_peered":"2024-05-15T14:45:22.501382+0000","last_clean":"2024-05-15T14:45:22.501382+0000","last_became_active":"2024-05-15T14:28:00.886359+0000","last_became_peered":"2024-05-15T14:28:00.886359+0000","last_unstale":"2024-05-15T14:45:22.501382+0000","last_undegraded":"2024-05-15T14:45:22.501382+0000","last_fullsized":"2024-05-15T14:45:22.501382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:28.468952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"39'29","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.250372+0000","last_change":"2024-05-15T14:28:02.892567+0000","last_active":"2024-05-15T14:47:54.250372+0000","last_peered":"2024-05-15T14:47:54.250372+0000","last_clean":"2024-05-15T14:47:54.250372+0000","last_became_active":"2024-05-15T14:28:02.892287+0000","last_became_peered":"2024-05-15T14:28:02.892287+0000","last_unstale":"2024-05-15T14:47:54.250372+0000","last_undegraded":"2024-05-15T14:47:54.250372+0000","last_fullsized":"2024-05-15T14:47:54.250372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:17:18.538337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518593+0000","last_change":"2024-05-15T14:31:16.590519+0000","last_active":"2024-05-15T14:45:52.518593+0000","last_peered":"2024-05-15T14:45:52.518593+0000","last_clean":"2024-05-15T14:45:52.518593+0000","last_became_active":"2024-05-15T14:31:16.590227+0000","last_became_peered":"2024-05-15T14:31:16.590227+0000","last_unstale":"2024-05-15T14:45:52.518593+0000","last_undegraded":"2024-05-15T14:45:52.518593+0000","last_fullsized":"2024-05-15T14:45:52.518593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:21.771432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411633+0000","last_change":"2024-05-15T14:27:52.851931+0000","last_active":"2024-05-15T14:45:52.411633+0000","last_peered":"2024-05-15T14:45:52.411633+0000","last_clean":"2024-05-15T14:45:52.411633+0000","last_became_active":"2024-05-15T14:27:52.851589+0000","last_became_peered":"2024-05-15T14:27:52.851589+0000","last_unstale":"2024-05-15T14:45:52.411633+0000","last_undegraded":"2024-05-15T14:45:52.411633+0000","last_fullsized":"2024-05-15T14:45:52.411633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:38.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"39'14","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026953+0000","last_change":"2024-05-15T14:27:50.850680+0000","last_active":"2024-05-15T14:48:26.026953+0000","last_peered":"2024-05-15T14:48:26.026953+0000","last_clean":"2024-05-15T14:48:26.026953+0000","last_became_active":"2024-05-15T14:27:50.850389+0000","last_became_peered":"2024-05-15T14:27:50.850389+0000","last_unstale":"2024-05-15T14:48:26.026953+0000","last_undegraded":"2024-05-15T14:48:26.026953+0000","last_fullsized":"2024-05-15T14:48:26.026953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":19,"num_write":54,"num_write_kb":19955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"25'1","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.358730+0000","last_change":"2024-05-15T14:27:56.877565+0000","last_active":"2024-05-15T14:47:52.358730+0000","last_peered":"2024-05-15T14:47:52.358730+0000","last_clean":"2024-05-15T14:47:52.358730+0000","last_became_active":"2024-05-15T14:27:56.876626+0000","last_became_peered":"2024-05-15T14:27:56.876626+0000","last_unstale":"2024-05-15T14:47:52.358730+0000","last_undegraded":"2024-05-15T14:47:52.358730+0000","last_fullsized":"2024-05-15T14:47:52.358730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:59:42.209397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"39'362","reported_seq":584,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.986164+0000","last_change":"2024-05-15T14:27:58.885446+0000","last_active":"2024-05-15T14:48:25.986164+0000","last_peered":"2024-05-15T14:48:25.986164+0000","last_clean":"2024-05-15T14:48:25.986164+0000","last_became_active":"2024-05-15T14:27:58.885156+0000","last_became_peered":"2024-05-15T14:27:58.885156+0000","last_unstale":"2024-05-15T14:48:25.986164+0000","last_undegraded":"2024-05-15T14:48:25.986164+0000","last_fullsized":"2024-05-15T14:48:25.986164+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":660,"num_write":561,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:07.418800+0000","last_change":"2024-05-15T14:28:00.885938+0000","last_active":"2024-05-15T14:46:07.418800+0000","last_peered":"2024-05-15T14:46:07.418800+0000","last_clean":"2024-05-15T14:46:07.418800+0000","last_became_active":"2024-05-15T14:28:00.885582+0000","last_became_peered":"2024-05-15T14:28:00.885582+0000","last_unstale":"2024-05-15T14:46:07.418800+0000","last_undegraded":"2024-05-15T14:46:07.418800+0000","last_fullsized":"2024-05-15T14:46:07.418800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:22:45.934449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"39'24","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.863377+0000","last_change":"2024-05-15T14:28:02.891692+0000","last_active":"2024-05-15T14:47:53.863377+0000","last_peered":"2024-05-15T14:47:53.863377+0000","last_clean":"2024-05-15T14:47:53.863377+0000","last_became_active":"2024-05-15T14:28:02.891419+0000","last_became_peered":"2024-05-15T14:28:02.891419+0000","last_unstale":"2024-05-15T14:47:53.863377+0000","last_undegraded":"2024-05-15T14:47:53.863377+0000","last_fullsized":"2024-05-15T14:47:53.863377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:00.406575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.411559+0000","last_change":"2024-05-15T14:31:16.594272+0000","last_active":"2024-05-15T14:45:22.411559+0000","last_peered":"2024-05-15T14:45:22.411559+0000","last_clean":"2024-05-15T14:45:22.411559+0000","last_became_active":"2024-05-15T14:31:16.593942+0000","last_became_peered":"2024-05-15T14:31:16.593942+0000","last_unstale":"2024-05-15T14:45:22.411559+0000","last_undegraded":"2024-05-15T14:45:22.411559+0000","last_fullsized":"2024-05-15T14:45:22.411559+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:22.878653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'62","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840310+0000","last_change":"2024-05-15T14:27:52.854103+0000","last_active":"2024-05-15T14:47:53.840310+0000","last_peered":"2024-05-15T14:47:53.840310+0000","last_clean":"2024-05-15T14:47:53.840310+0000","last_became_active":"2024-05-15T14:27:52.853828+0000","last_became_peered":"2024-05-15T14:27:52.853828+0000","last_unstale":"2024-05-15T14:47:53.840310+0000","last_undegraded":"2024-05-15T14:47:53.840310+0000","last_fullsized":"2024-05-15T14:47:53.840310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":210,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407053+0000","last_change":"2024-05-15T14:27:50.838852+0000","last_active":"2024-05-15T14:45:17.407053+0000","last_peered":"2024-05-15T14:45:17.407053+0000","last_clean":"2024-05-15T14:45:17.407053+0000","last_became_active":"2024-05-15T14:27:50.838561+0000","last_became_peered":"2024-05-15T14:27:50.838561+0000","last_unstale":"2024-05-15T14:45:17.407053+0000","last_undegraded":"2024-05-15T14:45:17.407053+0000","last_fullsized":"2024-05-15T14:45:17.407053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:04.000024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.415863+0000","last_change":"2024-05-15T14:27:56.885185+0000","last_active":"2024-05-15T14:45:57.415863+0000","last_peered":"2024-05-15T14:45:57.415863+0000","last_clean":"2024-05-15T14:45:57.415863+0000","last_became_active":"2024-05-15T14:27:56.884903+0000","last_became_peered":"2024-05-15T14:27:56.884903+0000","last_unstale":"2024-05-15T14:45:57.415863+0000","last_undegraded":"2024-05-15T14:45:57.415863+0000","last_fullsized":"2024-05-15T14:45:57.415863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:07.170918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"39'341","reported_seq":600,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.072557+0000","last_change":"2024-05-15T14:27:58.876510+0000","last_active":"2024-05-15T14:48:26.072557+0000","last_peered":"2024-05-15T14:48:26.072557+0000","last_clean":"2024-05-15T14:48:26.072557+0000","last_became_active":"2024-05-15T14:27:58.876221+0000","last_became_peered":"2024-05-15T14:27:58.876221+0000","last_unstale":"2024-05-15T14:48:26.072557+0000","last_undegraded":"2024-05-15T14:48:26.072557+0000","last_fullsized":"2024-05-15T14:48:26.072557+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:51.509862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":522,"num_write":318,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'924","reported_seq":1397,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.090607+0000","last_change":"2024-05-15T14:28:00.884330+0000","last_active":"2024-05-15T14:48:26.090607+0000","last_peered":"2024-05-15T14:48:26.090607+0000","last_clean":"2024-05-15T14:48:26.090607+0000","last_became_active":"2024-05-15T14:28:00.884042+0000","last_became_peered":"2024-05-15T14:28:00.884042+0000","last_unstale":"2024-05-15T14:48:26.090607+0000","last_undegraded":"2024-05-15T14:48:26.090607+0000","last_fullsized":"2024-05-15T14:48:26.090607+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:27.911745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"39'23","reported_seq":62,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.291705+0000","last_change":"2024-05-15T14:28:02.888922+0000","last_active":"2024-05-15T14:47:54.291705+0000","last_peered":"2024-05-15T14:47:54.291705+0000","last_clean":"2024-05-15T14:47:54.291705+0000","last_became_active":"2024-05-15T14:28:02.888602+0000","last_became_peered":"2024-05-15T14:28:02.888602+0000","last_unstale":"2024-05-15T14:47:54.291705+0000","last_undegraded":"2024-05-15T14:47:54.291705+0000","last_fullsized":"2024-05-15T14:47:54.291705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:10.939156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514713+0000","last_change":"2024-05-15T14:31:16.591991+0000","last_active":"2024-05-15T14:45:52.514713+0000","last_peered":"2024-05-15T14:45:52.514713+0000","last_clean":"2024-05-15T14:45:52.514713+0000","last_became_active":"2024-05-15T14:31:16.591677+0000","last_became_peered":"2024-05-15T14:31:16.591677+0000","last_unstale":"2024-05-15T14:45:52.514713+0000","last_undegraded":"2024-05-15T14:45:52.514713+0000","last_fullsized":"2024-05-15T14:45:52.514713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:14:24.885155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'72","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327549+0000","last_change":"2024-05-15T14:27:52.844483+0000","last_active":"2024-05-15T14:47:54.327549+0000","last_peered":"2024-05-15T14:47:54.327549+0000","last_clean":"2024-05-15T14:47:54.327549+0000","last_became_active":"2024-05-15T14:27:52.844221+0000","last_became_peered":"2024-05-15T14:27:52.844221+0000","last_unstale":"2024-05-15T14:47:54.327549+0000","last_undegraded":"2024-05-15T14:47:54.327549+0000","last_fullsized":"2024-05-15T14:47:54.327549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":255,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.277035+0000","last_change":"2024-05-15T14:27:50.849342+0000","last_active":"2024-05-15T14:47:54.277035+0000","last_peered":"2024-05-15T14:47:54.277035+0000","last_clean":"2024-05-15T14:47:54.277035+0000","last_became_active":"2024-05-15T14:27:50.846927+0000","last_became_peered":"2024-05-15T14:27:50.846927+0000","last_unstale":"2024-05-15T14:47:54.277035+0000","last_undegraded":"2024-05-15T14:47:54.277035+0000","last_fullsized":"2024-05-15T14:47:54.277035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":82,"num_write_kb":24687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'6","reported_seq":801,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.907076+0000","last_change":"2024-05-15T14:27:56.882327+0000","last_active":"2024-05-15T14:48:25.907076+0000","last_peered":"2024-05-15T14:48:25.907076+0000","last_clean":"2024-05-15T14:48:25.907076+0000","last_became_active":"2024-05-15T14:27:56.882055+0000","last_became_peered":"2024-05-15T14:27:56.882055+0000","last_unstale":"2024-05-15T14:48:25.907076+0000","last_undegraded":"2024-05-15T14:48:25.907076+0000","last_fullsized":"2024-05-15T14:48:25.907076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1072,"num_read_kb":1813,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"39'231","reported_seq":384,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.748891+0000","last_change":"2024-05-15T14:27:58.878945+0000","last_active":"2024-05-15T14:47:53.748891+0000","last_peered":"2024-05-15T14:47:53.748891+0000","last_clean":"2024-05-15T14:47:53.748891+0000","last_became_active":"2024-05-15T14:27:58.878514+0000","last_became_peered":"2024-05-15T14:27:58.878514+0000","last_unstale":"2024-05-15T14:47:53.748891+0000","last_undegraded":"2024-05-15T14:47:53.748891+0000","last_fullsized":"2024-05-15T14:47:53.748891+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:40.853095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":332,"num_write":230,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'924","reported_seq":1429,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.091471+0000","last_change":"2024-05-15T14:28:00.891775+0000","last_active":"2024-05-15T14:48:26.091471+0000","last_peered":"2024-05-15T14:48:26.091471+0000","last_clean":"2024-05-15T14:48:26.091471+0000","last_became_active":"2024-05-15T14:28:00.891535+0000","last_became_peered":"2024-05-15T14:28:00.891535+0000","last_unstale":"2024-05-15T14:48:26.091471+0000","last_undegraded":"2024-05-15T14:48:26.091471+0000","last_fullsized":"2024-05-15T14:48:26.091471+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:03.092896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"39'19","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418124+0000","last_change":"2024-05-15T14:28:02.889970+0000","last_active":"2024-05-15T14:46:47.418124+0000","last_peered":"2024-05-15T14:46:47.418124+0000","last_clean":"2024-05-15T14:46:47.418124+0000","last_became_active":"2024-05-15T14:28:02.889039+0000","last_became_peered":"2024-05-15T14:28:02.889039+0000","last_unstale":"2024-05-15T14:46:47.418124+0000","last_undegraded":"2024-05-15T14:46:47.418124+0000","last_fullsized":"2024-05-15T14:46:47.418124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518620+0000","last_change":"2024-05-15T14:31:16.593519+0000","last_active":"2024-05-15T14:45:52.518620+0000","last_peered":"2024-05-15T14:45:52.518620+0000","last_clean":"2024-05-15T14:45:52.518620+0000","last_became_active":"2024-05-15T14:31:16.593216+0000","last_became_peered":"2024-05-15T14:31:16.593216+0000","last_unstale":"2024-05-15T14:45:52.518620+0000","last_undegraded":"2024-05-15T14:45:52.518620+0000","last_fullsized":"2024-05-15T14:45:52.518620+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:16:24.742213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'24","reported_seq":118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.384978+0000","last_change":"2024-05-15T14:27:52.855239+0000","last_active":"2024-05-15T14:46:21.384978+0000","last_peered":"2024-05-15T14:46:21.384978+0000","last_clean":"2024-05-15T14:46:21.384978+0000","last_became_active":"2024-05-15T14:27:52.854963+0000","last_became_peered":"2024-05-15T14:27:52.854963+0000","last_unstale":"2024-05-15T14:46:21.384978+0000","last_undegraded":"2024-05-15T14:46:21.384978+0000","last_fullsized":"2024-05-15T14:46:21.384978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:02.561338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512454+0000","last_change":"2024-05-15T14:27:50.847492+0000","last_active":"2024-05-15T14:45:12.512454+0000","last_peered":"2024-05-15T14:45:12.512454+0000","last_clean":"2024-05-15T14:45:12.512454+0000","last_became_active":"2024-05-15T14:27:50.847163+0000","last_became_peered":"2024-05-15T14:27:50.847163+0000","last_unstale":"2024-05-15T14:45:12.512454+0000","last_undegraded":"2024-05-15T14:45:12.512454+0000","last_fullsized":"2024-05-15T14:45:12.512454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.412235+0000","last_change":"2024-05-15T14:27:56.880246+0000","last_active":"2024-05-15T14:45:57.412235+0000","last_peered":"2024-05-15T14:45:57.412235+0000","last_clean":"2024-05-15T14:45:57.412235+0000","last_became_active":"2024-05-15T14:27:56.879526+0000","last_became_peered":"2024-05-15T14:27:56.879526+0000","last_unstale":"2024-05-15T14:45:57.412235+0000","last_undegraded":"2024-05-15T14:45:57.412235+0000","last_fullsized":"2024-05-15T14:45:57.412235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"39'405","reported_seq":686,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.033540+0000","last_change":"2024-05-15T14:27:58.883156+0000","last_active":"2024-05-15T14:48:26.033540+0000","last_peered":"2024-05-15T14:48:26.033540+0000","last_clean":"2024-05-15T14:48:26.033540+0000","last_became_active":"2024-05-15T14:27:58.882886+0000","last_became_peered":"2024-05-15T14:27:58.882886+0000","last_unstale":"2024-05-15T14:48:26.033540+0000","last_undegraded":"2024-05-15T14:48:26.033540+0000","last_fullsized":"2024-05-15T14:48:26.033540+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:42.051812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":654,"num_read_kb":644,"num_write":480,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:02.412107+0000","last_change":"2024-05-15T14:28:00.885713+0000","last_active":"2024-05-15T14:46:02.412107+0000","last_peered":"2024-05-15T14:46:02.412107+0000","last_clean":"2024-05-15T14:46:02.412107+0000","last_became_active":"2024-05-15T14:28:00.885434+0000","last_became_peered":"2024-05-15T14:28:00.885434+0000","last_unstale":"2024-05-15T14:46:02.412107+0000","last_undegraded":"2024-05-15T14:46:02.412107+0000","last_fullsized":"2024-05-15T14:46:02.412107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:30.563508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"39'18","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288457+0000","last_change":"2024-05-15T14:28:02.890234+0000","last_active":"2024-05-15T14:47:54.288457+0000","last_peered":"2024-05-15T14:47:54.288457+0000","last_clean":"2024-05-15T14:47:54.288457+0000","last_became_active":"2024-05-15T14:28:02.889918+0000","last_became_peered":"2024-05-15T14:28:02.889918+0000","last_unstale":"2024-05-15T14:47:54.288457+0000","last_undegraded":"2024-05-15T14:47:54.288457+0000","last_fullsized":"2024-05-15T14:47:54.288457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:16:02.299835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.523316+0000","last_change":"2024-05-15T14:31:16.594123+0000","last_active":"2024-05-15T14:46:27.523316+0000","last_peered":"2024-05-15T14:46:27.523316+0000","last_clean":"2024-05-15T14:46:27.523316+0000","last_became_active":"2024-05-15T14:31:16.593813+0000","last_became_peered":"2024-05-15T14:31:16.593813+0000","last_unstale":"2024-05-15T14:46:27.523316+0000","last_undegraded":"2024-05-15T14:46:27.523316+0000","last_fullsized":"2024-05-15T14:46:27.523316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:36.647120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'64","reported_seq":184,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840377+0000","last_change":"2024-05-15T14:27:52.846883+0000","last_active":"2024-05-15T14:47:53.840377+0000","last_peered":"2024-05-15T14:47:53.840377+0000","last_clean":"2024-05-15T14:47:53.840377+0000","last_became_active":"2024-05-15T14:27:52.846508+0000","last_became_peered":"2024-05-15T14:27:52.846508+0000","last_unstale":"2024-05-15T14:47:53.840377+0000","last_undegraded":"2024-05-15T14:47:53.840377+0000","last_fullsized":"2024-05-15T14:47:53.840377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:40.944809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":231,"num_write":88,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514066+0000","last_change":"2024-05-15T14:27:43.806336+0000","last_active":"2024-05-15T14:45:47.514066+0000","last_peered":"2024-05-15T14:45:47.514066+0000","last_clean":"2024-05-15T14:45:47.514066+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:45:47.514066+0000","last_undegraded":"2024-05-15T14:45:47.514066+0000","last_fullsized":"2024-05-15T14:45:47.514066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_clean_scrub_stamp":"2024-05-15T14:27:42.789461+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:25.195322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416082+0000","last_change":"2024-05-15T14:27:44.808919+0000","last_active":"2024-05-15T14:46:32.416082+0000","last_peered":"2024-05-15T14:46:32.416082+0000","last_clean":"2024-05-15T14:46:32.416082+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:46:32.416082+0000","last_undegraded":"2024-05-15T14:46:32.416082+0000","last_fullsized":"2024-05-15T14:46:32.416082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"39'26","reported_seq":112,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.258707+0000","last_change":"2024-05-15T14:27:50.850434+0000","last_active":"2024-05-15T14:47:54.258707+0000","last_peered":"2024-05-15T14:47:54.258707+0000","last_clean":"2024-05-15T14:47:54.258707+0000","last_became_active":"2024-05-15T14:27:50.849731+0000","last_became_peered":"2024-05-15T14:27:50.849731+0000","last_unstale":"2024-05-15T14:47:54.258707+0000","last_undegraded":"2024-05-15T14:47:54.258707+0000","last_fullsized":"2024-05-15T14:47:54.258707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":50,"num_write":130,"num_write_kb":35292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.521236+0000","last_change":"2024-05-15T14:27:56.878884+0000","last_active":"2024-05-15T14:46:42.521236+0000","last_peered":"2024-05-15T14:46:42.521236+0000","last_clean":"2024-05-15T14:46:42.521236+0000","last_became_active":"2024-05-15T14:27:56.878611+0000","last_became_peered":"2024-05-15T14:27:56.878611+0000","last_unstale":"2024-05-15T14:46:42.521236+0000","last_undegraded":"2024-05-15T14:46:42.521236+0000","last_fullsized":"2024-05-15T14:46:42.521236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:39.394172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"39'341","reported_seq":3164,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.066914+0000","last_change":"2024-05-15T14:27:58.884541+0000","last_active":"2024-05-15T14:48:26.066914+0000","last_peered":"2024-05-15T14:48:26.066914+0000","last_clean":"2024-05-15T14:48:26.066914+0000","last_became_active":"2024-05-15T14:27:58.884237+0000","last_became_peered":"2024-05-15T14:27:58.884237+0000","last_unstale":"2024-05-15T14:48:26.066914+0000","last_undegraded":"2024-05-15T14:48:26.066914+0000","last_fullsized":"2024-05-15T14:48:26.066914+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":8031,"num_read_kb":5511,"num_write":255,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.413851+0000","last_change":"2024-05-15T14:28:00.887075+0000","last_active":"2024-05-15T14:45:22.413851+0000","last_peered":"2024-05-15T14:45:22.413851+0000","last_clean":"2024-05-15T14:45:22.413851+0000","last_became_active":"2024-05-15T14:28:00.886539+0000","last_became_peered":"2024-05-15T14:28:00.886539+0000","last_unstale":"2024-05-15T14:45:22.413851+0000","last_undegraded":"2024-05-15T14:45:22.413851+0000","last_fullsized":"2024-05-15T14:45:22.413851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:29.042984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"39'21","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.728874+0000","last_change":"2024-05-15T14:28:02.892380+0000","last_active":"2024-05-15T14:47:53.728874+0000","last_peered":"2024-05-15T14:47:53.728874+0000","last_clean":"2024-05-15T14:47:53.728874+0000","last_became_active":"2024-05-15T14:28:02.892076+0000","last_became_peered":"2024-05-15T14:28:02.892076+0000","last_unstale":"2024-05-15T14:47:53.728874+0000","last_undegraded":"2024-05-15T14:47:53.728874+0000","last_fullsized":"2024-05-15T14:47:53.728874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:04.849548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.b","version":"39'3","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.409808+0000","last_change":"2024-05-15T14:31:16.592642+0000","last_active":"2024-05-15T14:44:47.409808+0000","last_peered":"2024-05-15T14:44:47.409808+0000","last_clean":"2024-05-15T14:44:47.409808+0000","last_became_active":"2024-05-15T14:31:16.592325+0000","last_became_peered":"2024-05-15T14:31:16.592325+0000","last_unstale":"2024-05-15T14:44:47.409808+0000","last_undegraded":"2024-05-15T14:44:47.409808+0000","last_fullsized":"2024-05-15T14:44:47.409808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:15.350673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'26","reported_seq":131,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.335536+0000","last_change":"2024-05-15T14:27:52.859118+0000","last_active":"2024-05-15T14:46:21.335536+0000","last_peered":"2024-05-15T14:46:21.335536+0000","last_clean":"2024-05-15T14:46:21.335536+0000","last_became_active":"2024-05-15T14:27:52.858631+0000","last_became_peered":"2024-05-15T14:27:52.858631+0000","last_unstale":"2024-05-15T14:46:21.335536+0000","last_undegraded":"2024-05-15T14:46:21.335536+0000","last_fullsized":"2024-05-15T14:46:21.335536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514045+0000","last_change":"2024-05-15T14:27:44.810189+0000","last_active":"2024-05-15T14:45:47.514045+0000","last_peered":"2024-05-15T14:45:47.514045+0000","last_clean":"2024-05-15T14:45:47.514045+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:45:47.514045+0000","last_undegraded":"2024-05-15T14:45:47.514045+0000","last_fullsized":"2024-05-15T14:45:47.514045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:29.474022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'9","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.076855+0000","last_change":"2024-05-15T14:27:50.833876+0000","last_active":"2024-05-15T14:48:26.076855+0000","last_peered":"2024-05-15T14:48:26.076855+0000","last_clean":"2024-05-15T14:48:26.076855+0000","last_became_active":"2024-05-15T14:27:50.833509+0000","last_became_peered":"2024-05-15T14:27:50.833509+0000","last_unstale":"2024-05-15T14:48:26.076855+0000","last_undegraded":"2024-05-15T14:48:26.076855+0000","last_fullsized":"2024-05-15T14:48:26.076855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":37,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407312+0000","last_change":"2024-05-15T14:27:56.876813+0000","last_active":"2024-05-15T14:45:17.407312+0000","last_peered":"2024-05-15T14:45:17.407312+0000","last_clean":"2024-05-15T14:45:17.407312+0000","last_became_active":"2024-05-15T14:27:56.876526+0000","last_became_peered":"2024-05-15T14:27:56.876526+0000","last_unstale":"2024-05-15T14:45:17.407312+0000","last_undegraded":"2024-05-15T14:45:17.407312+0000","last_fullsized":"2024-05-15T14:45:17.407312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:54.193440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"39'1087","reported_seq":2199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.228944+0000","last_change":"2024-05-15T14:27:58.887397+0000","last_active":"2024-05-15T14:48:26.228944+0000","last_peered":"2024-05-15T14:48:26.228944+0000","last_clean":"2024-05-15T14:48:26.228944+0000","last_became_active":"2024-05-15T14:27:58.887083+0000","last_became_peered":"2024-05-15T14:27:58.887083+0000","last_unstale":"2024-05-15T14:48:26.228944+0000","last_undegraded":"2024-05-15T14:48:26.228944+0000","last_fullsized":"2024-05-15T14:48:26.228944+0000","mapping_epoch":26,"log_start":"39'1000","ondisk_log_start":"39'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":1000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:41.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1707,"num_read_kb":1691,"num_write":402,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.521852+0000","last_change":"2024-05-15T14:28:00.890674+0000","last_active":"2024-05-15T14:46:47.521852+0000","last_peered":"2024-05-15T14:46:47.521852+0000","last_clean":"2024-05-15T14:46:47.521852+0000","last_became_active":"2024-05-15T14:28:00.890321+0000","last_became_peered":"2024-05-15T14:28:00.890321+0000","last_unstale":"2024-05-15T14:46:47.521852+0000","last_undegraded":"2024-05-15T14:46:47.521852+0000","last_fullsized":"2024-05-15T14:46:47.521852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:17.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"39'19","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.433552+0000","last_change":"2024-05-15T14:28:02.883575+0000","last_active":"2024-05-15T14:47:53.433552+0000","last_peered":"2024-05-15T14:47:53.433552+0000","last_clean":"2024-05-15T14:47:53.433552+0000","last_became_active":"2024-05-15T14:28:02.883249+0000","last_became_peered":"2024-05-15T14:28:02.883249+0000","last_unstale":"2024-05-15T14:47:53.433552+0000","last_undegraded":"2024-05-15T14:47:53.433552+0000","last_fullsized":"2024-05-15T14:47:53.433552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:15.023309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416034+0000","last_change":"2024-05-15T14:31:16.593784+0000","last_active":"2024-05-15T14:46:32.416034+0000","last_peered":"2024-05-15T14:46:32.416034+0000","last_clean":"2024-05-15T14:46:32.416034+0000","last_became_active":"2024-05-15T14:31:16.593500+0000","last_became_peered":"2024-05-15T14:31:16.593500+0000","last_unstale":"2024-05-15T14:46:32.416034+0000","last_undegraded":"2024-05-15T14:46:32.416034+0000","last_fullsized":"2024-05-15T14:46:32.416034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:01.704595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"39'14","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410547+0000","last_change":"2024-05-15T14:27:52.844475+0000","last_active":"2024-05-15T14:45:12.410547+0000","last_peered":"2024-05-15T14:45:12.410547+0000","last_clean":"2024-05-15T14:45:12.410547+0000","last_became_active":"2024-05-15T14:27:52.844149+0000","last_became_peered":"2024-05-15T14:27:52.844149+0000","last_unstale":"2024-05-15T14:45:12.410547+0000","last_undegraded":"2024-05-15T14:45:12.410547+0000","last_fullsized":"2024-05-15T14:45:12.410547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:37.250864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.508491+0000","last_change":"2024-05-15T14:27:45.305663+0000","last_active":"2024-05-15T14:46:27.508491+0000","last_peered":"2024-05-15T14:46:27.508491+0000","last_clean":"2024-05-15T14:46:27.508491+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:46:27.508491+0000","last_undegraded":"2024-05-15T14:46:27.508491+0000","last_fullsized":"2024-05-15T14:46:27.508491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.415809+0000","last_change":"2024-05-15T14:27:50.845090+0000","last_active":"2024-05-15T14:45:57.415809+0000","last_peered":"2024-05-15T14:45:57.415809+0000","last_clean":"2024-05-15T14:45:57.415809+0000","last_became_active":"2024-05-15T14:27:50.844771+0000","last_became_peered":"2024-05-15T14:27:50.844771+0000","last_unstale":"2024-05-15T14:45:57.415809+0000","last_undegraded":"2024-05-15T14:45:57.415809+0000","last_fullsized":"2024-05-15T14:45:57.415809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:04.000024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"39'12","reported_seq":720,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.907972+0000","last_change":"2024-05-15T14:27:56.880418+0000","last_active":"2024-05-15T14:48:25.907972+0000","last_peered":"2024-05-15T14:48:25.907972+0000","last_clean":"2024-05-15T14:48:25.907972+0000","last_became_active":"2024-05-15T14:27:56.880109+0000","last_became_peered":"2024-05-15T14:27:56.880109+0000","last_unstale":"2024-05-15T14:48:25.907972+0000","last_undegraded":"2024-05-15T14:48:25.907972+0000","last_fullsized":"2024-05-15T14:48:25.907972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:59.299924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":688,"num_read_kb":700,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"39'271","reported_seq":763,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.707634+0000","last_change":"2024-05-15T14:27:58.888770+0000","last_active":"2024-05-15T14:47:52.707634+0000","last_peered":"2024-05-15T14:47:52.707634+0000","last_clean":"2024-05-15T14:47:52.707634+0000","last_became_active":"2024-05-15T14:27:58.888477+0000","last_became_peered":"2024-05-15T14:27:58.888477+0000","last_unstale":"2024-05-15T14:47:52.707634+0000","last_undegraded":"2024-05-15T14:47:52.707634+0000","last_fullsized":"2024-05-15T14:47:52.707634+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:12.868288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":392,"num_write":265,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.423189+0000","last_change":"2024-05-15T14:28:00.880873+0000","last_active":"2024-05-15T14:46:47.423189+0000","last_peered":"2024-05-15T14:46:47.423189+0000","last_clean":"2024-05-15T14:46:47.423189+0000","last_became_active":"2024-05-15T14:28:00.880488+0000","last_became_peered":"2024-05-15T14:28:00.880488+0000","last_unstale":"2024-05-15T14:46:47.423189+0000","last_undegraded":"2024-05-15T14:46:47.423189+0000","last_fullsized":"2024-05-15T14:46:47.423189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:05.734987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'21","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.357011+0000","last_change":"2024-05-15T14:28:02.894486+0000","last_active":"2024-05-15T14:46:21.357011+0000","last_peered":"2024-05-15T14:46:21.357011+0000","last_clean":"2024-05-15T14:46:21.357011+0000","last_became_active":"2024-05-15T14:28:02.893812+0000","last_became_peered":"2024-05-15T14:28:02.893812+0000","last_unstale":"2024-05-15T14:46:21.357011+0000","last_undegraded":"2024-05-15T14:46:21.357011+0000","last_fullsized":"2024-05-15T14:46:21.357011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:44.592465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":112,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.420985+0000","last_change":"2024-05-15T14:31:16.589892+0000","last_active":"2024-05-15T14:46:27.420985+0000","last_peered":"2024-05-15T14:46:27.420985+0000","last_clean":"2024-05-15T14:46:27.420985+0000","last_became_active":"2024-05-15T14:31:16.589610+0000","last_became_peered":"2024-05-15T14:31:16.589610+0000","last_unstale":"2024-05-15T14:46:27.420985+0000","last_undegraded":"2024-05-15T14:46:27.420985+0000","last_fullsized":"2024-05-15T14:46:27.420985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:19:18.238793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"39'4","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421245+0000","last_change":"2024-05-15T14:27:52.840002+0000","last_active":"2024-05-15T14:46:37.421245+0000","last_peered":"2024-05-15T14:46:37.421245+0000","last_clean":"2024-05-15T14:46:37.421245+0000","last_became_active":"2024-05-15T14:27:52.839722+0000","last_became_peered":"2024-05-15T14:27:52.839722+0000","last_unstale":"2024-05-15T14:46:37.421245+0000","last_undegraded":"2024-05-15T14:46:37.421245+0000","last_fullsized":"2024-05-15T14:46:37.421245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:19.868710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416067+0000","last_change":"2024-05-15T14:27:44.810023+0000","last_active":"2024-05-15T14:46:32.416067+0000","last_peered":"2024-05-15T14:46:32.416067+0000","last_clean":"2024-05-15T14:46:32.416067+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:46:32.416067+0000","last_undegraded":"2024-05-15T14:46:32.416067+0000","last_fullsized":"2024-05-15T14:46:32.416067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'16","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416855+0000","last_change":"2024-05-15T14:27:50.837385+0000","last_active":"2024-05-15T14:46:37.416855+0000","last_peered":"2024-05-15T14:46:37.416855+0000","last_clean":"2024-05-15T14:46:37.416855+0000","last_became_active":"2024-05-15T14:27:50.836731+0000","last_became_peered":"2024-05-15T14:27:50.836731+0000","last_unstale":"2024-05-15T14:46:37.416855+0000","last_undegraded":"2024-05-15T14:46:37.416855+0000","last_fullsized":"2024-05-15T14:46:37.416855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.423213+0000","last_change":"2024-05-15T14:27:56.880397+0000","last_active":"2024-05-15T14:46:47.423213+0000","last_peered":"2024-05-15T14:46:47.423213+0000","last_clean":"2024-05-15T14:46:47.423213+0000","last_became_active":"2024-05-15T14:27:56.880118+0000","last_became_peered":"2024-05-15T14:27:56.880118+0000","last_unstale":"2024-05-15T14:46:47.423213+0000","last_undegraded":"2024-05-15T14:46:47.423213+0000","last_fullsized":"2024-05-15T14:46:47.423213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:58.838634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"39'330","reported_seq":83275,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.651627+0000","last_change":"2024-05-15T14:27:58.882371+0000","last_active":"2024-05-15T14:47:52.651627+0000","last_peered":"2024-05-15T14:47:52.651627+0000","last_clean":"2024-05-15T14:47:52.651627+0000","last_became_active":"2024-05-15T14:27:58.882039+0000","last_became_peered":"2024-05-15T14:27:58.882039+0000","last_unstale":"2024-05-15T14:47:52.651627+0000","last_undegraded":"2024-05-15T14:47:52.651627+0000","last_fullsized":"2024-05-15T14:47:52.651627+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:34.425254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207654,"num_read_kb":557003,"num_write":353,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.407638+0000","last_change":"2024-05-15T14:28:00.887372+0000","last_active":"2024-05-15T14:45:22.407638+0000","last_peered":"2024-05-15T14:45:22.407638+0000","last_clean":"2024-05-15T14:45:22.407638+0000","last_became_active":"2024-05-15T14:28:00.887095+0000","last_became_peered":"2024-05-15T14:28:00.887095+0000","last_unstale":"2024-05-15T14:45:22.407638+0000","last_undegraded":"2024-05-15T14:45:22.407638+0000","last_fullsized":"2024-05-15T14:45:22.407638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:30.018180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"39'14","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.259616+0000","last_change":"2024-05-15T14:28:02.892539+0000","last_active":"2024-05-15T14:46:21.259616+0000","last_peered":"2024-05-15T14:46:21.259616+0000","last_clean":"2024-05-15T14:46:21.259616+0000","last_became_active":"2024-05-15T14:28:02.892255+0000","last_became_peered":"2024-05-15T14:28:02.892255+0000","last_unstale":"2024-05-15T14:46:21.259616+0000","last_undegraded":"2024-05-15T14:46:21.259616+0000","last_fullsized":"2024-05-15T14:46:21.259616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:27.053905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.404020+0000","last_change":"2024-05-15T14:31:16.593868+0000","last_active":"2024-05-15T14:44:52.404020+0000","last_peered":"2024-05-15T14:44:52.404020+0000","last_clean":"2024-05-15T14:44:52.404020+0000","last_became_active":"2024-05-15T14:31:16.593582+0000","last_became_peered":"2024-05-15T14:31:16.593582+0000","last_unstale":"2024-05-15T14:44:52.404020+0000","last_undegraded":"2024-05-15T14:44:52.404020+0000","last_fullsized":"2024-05-15T14:44:52.404020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:38:46.732341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'44","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327700+0000","last_change":"2024-05-15T14:27:52.851444+0000","last_active":"2024-05-15T14:47:54.327700+0000","last_peered":"2024-05-15T14:47:54.327700+0000","last_clean":"2024-05-15T14:47:54.327700+0000","last_became_active":"2024-05-15T14:27:52.851166+0000","last_became_peered":"2024-05-15T14:27:52.851166+0000","last_unstale":"2024-05-15T14:47:54.327700+0000","last_undegraded":"2024-05-15T14:47:54.327700+0000","last_fullsized":"2024-05-15T14:47:54.327700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:55.341565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":125,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"39'8","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.286095+0000","last_change":"2024-05-15T14:28:37.941507+0000","last_active":"2024-05-15T14:47:54.286095+0000","last_peered":"2024-05-15T14:47:54.286095+0000","last_clean":"2024-05-15T14:47:54.286095+0000","last_became_active":"2024-05-15T14:28:37.941149+0000","last_became_peered":"2024-05-15T14:28:37.941149+0000","last_unstale":"2024-05-15T14:47:54.286095+0000","last_undegraded":"2024-05-15T14:47:54.286095+0000","last_fullsized":"2024-05-15T14:47:54.286095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:15.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11,"num_write":32,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420426+0000","last_change":"2024-05-15T14:27:45.305199+0000","last_active":"2024-05-15T14:46:32.420426+0000","last_peered":"2024-05-15T14:46:32.420426+0000","last_clean":"2024-05-15T14:46:32.420426+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:46:32.420426+0000","last_undegraded":"2024-05-15T14:46:32.420426+0000","last_fullsized":"2024-05-15T14:46:32.420426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.422662+0000","last_change":"2024-05-15T14:27:56.881338+0000","last_active":"2024-05-15T14:46:42.422662+0000","last_peered":"2024-05-15T14:46:42.422662+0000","last_clean":"2024-05-15T14:46:42.422662+0000","last_became_active":"2024-05-15T14:27:56.881083+0000","last_became_peered":"2024-05-15T14:27:56.881083+0000","last_unstale":"2024-05-15T14:46:42.422662+0000","last_undegraded":"2024-05-15T14:46:42.422662+0000","last_fullsized":"2024-05-15T14:46:42.422662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:32.643557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"39'477","reported_seq":926,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.069846+0000","last_change":"2024-05-15T14:27:58.884245+0000","last_active":"2024-05-15T14:48:26.069846+0000","last_peered":"2024-05-15T14:48:26.069846+0000","last_clean":"2024-05-15T14:48:26.069846+0000","last_became_active":"2024-05-15T14:27:58.883886+0000","last_became_peered":"2024-05-15T14:27:58.883886+0000","last_unstale":"2024-05-15T14:48:26.069846+0000","last_undegraded":"2024-05-15T14:48:26.069846+0000","last_fullsized":"2024-05-15T14:48:26.069846+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:12.868288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1019,"num_read_kb":1275,"num_write":493,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418087+0000","last_change":"2024-05-15T14:28:00.884599+0000","last_active":"2024-05-15T14:46:47.418087+0000","last_peered":"2024-05-15T14:46:47.418087+0000","last_clean":"2024-05-15T14:46:47.418087+0000","last_became_active":"2024-05-15T14:28:00.884315+0000","last_became_peered":"2024-05-15T14:28:00.884315+0000","last_unstale":"2024-05-15T14:46:47.418087+0000","last_undegraded":"2024-05-15T14:46:47.418087+0000","last_fullsized":"2024-05-15T14:46:47.418087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:29.042984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"39'35","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.812135+0000","last_change":"2024-05-15T14:28:02.889405+0000","last_active":"2024-05-15T14:47:53.812135+0000","last_peered":"2024-05-15T14:47:53.812135+0000","last_clean":"2024-05-15T14:47:53.812135+0000","last_became_active":"2024-05-15T14:28:02.889093+0000","last_became_peered":"2024-05-15T14:28:02.889093+0000","last_unstale":"2024-05-15T14:47:53.812135+0000","last_undegraded":"2024-05-15T14:47:53.812135+0000","last_fullsized":"2024-05-15T14:47:53.812135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:25.077865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":151,"num_write":63,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.500408+0000","last_change":"2024-05-15T14:31:38.627137+0000","last_active":"2024-05-15T14:45:12.500408+0000","last_peered":"2024-05-15T14:45:12.500408+0000","last_clean":"2024-05-15T14:45:12.500408+0000","last_became_active":"2024-05-15T14:31:38.626777+0000","last_became_peered":"2024-05-15T14:31:38.626777+0000","last_unstale":"2024-05-15T14:45:12.500408+0000","last_undegraded":"2024-05-15T14:45:12.500408+0000","last_fullsized":"2024-05-15T14:45:12.500408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:25.663025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'50","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422119+0000","last_change":"2024-05-15T14:27:52.846446+0000","last_active":"2024-05-15T14:46:37.422119+0000","last_peered":"2024-05-15T14:46:37.422119+0000","last_clean":"2024-05-15T14:46:37.422119+0000","last_became_active":"2024-05-15T14:27:52.846171+0000","last_became_peered":"2024-05-15T14:27:52.846171+0000","last_unstale":"2024-05-15T14:46:37.422119+0000","last_undegraded":"2024-05-15T14:46:37.422119+0000","last_fullsized":"2024-05-15T14:46:37.422119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":163,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421256+0000","last_change":"2024-05-15T14:27:50.845054+0000","last_active":"2024-05-15T14:46:37.421256+0000","last_peered":"2024-05-15T14:46:37.421256+0000","last_clean":"2024-05-15T14:46:37.421256+0000","last_became_active":"2024-05-15T14:27:50.844741+0000","last_became_peered":"2024-05-15T14:27:50.844741+0000","last_unstale":"2024-05-15T14:46:37.421256+0000","last_undegraded":"2024-05-15T14:46:37.421256+0000","last_fullsized":"2024-05-15T14:46:37.421256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:59:36.164522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":80,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519875+0000","last_change":"2024-05-15T14:27:45.305329+0000","last_active":"2024-05-15T14:46:32.519875+0000","last_peered":"2024-05-15T14:46:32.519875+0000","last_clean":"2024-05-15T14:46:32.519875+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:46:32.519875+0000","last_undegraded":"2024-05-15T14:46:32.519875+0000","last_fullsized":"2024-05-15T14:46:32.519875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:38:59.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416750+0000","last_change":"2024-05-15T14:27:56.881115+0000","last_active":"2024-05-15T14:46:42.416750+0000","last_peered":"2024-05-15T14:46:42.416750+0000","last_clean":"2024-05-15T14:46:42.416750+0000","last_became_active":"2024-05-15T14:27:56.880842+0000","last_became_peered":"2024-05-15T14:27:56.880842+0000","last_unstale":"2024-05-15T14:46:42.416750+0000","last_undegraded":"2024-05-15T14:46:42.416750+0000","last_fullsized":"2024-05-15T14:46:42.416750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:23.904400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"39'491","reported_seq":504318,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.715981+0000","last_change":"2024-05-15T14:27:58.882555+0000","last_active":"2024-05-15T14:47:52.715981+0000","last_peered":"2024-05-15T14:47:52.715981+0000","last_clean":"2024-05-15T14:47:52.715981+0000","last_became_active":"2024-05-15T14:27:58.882284+0000","last_became_peered":"2024-05-15T14:27:58.882284+0000","last_unstale":"2024-05-15T14:47:52.715981+0000","last_undegraded":"2024-05-15T14:47:52.715981+0000","last_fullsized":"2024-05-15T14:47:52.715981+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:50.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1259744,"num_read_kb":3777635,"num_write":703,"num_write_kb":2009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"39'924","reported_seq":1369,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.088738+0000","last_change":"2024-05-15T14:28:00.892454+0000","last_active":"2024-05-15T14:48:26.088738+0000","last_peered":"2024-05-15T14:48:26.088738+0000","last_clean":"2024-05-15T14:48:26.088738+0000","last_became_active":"2024-05-15T14:28:00.891484+0000","last_became_peered":"2024-05-15T14:28:00.891484+0000","last_unstale":"2024-05-15T14:48:26.088738+0000","last_undegraded":"2024-05-15T14:48:26.088738+0000","last_fullsized":"2024-05-15T14:48:26.088738+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:42.711145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"39'18","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.426893+0000","last_change":"2024-05-15T14:28:02.891735+0000","last_active":"2024-05-15T14:47:52.426893+0000","last_peered":"2024-05-15T14:47:52.426893+0000","last_clean":"2024-05-15T14:47:52.426893+0000","last_became_active":"2024-05-15T14:28:02.891380+0000","last_became_peered":"2024-05-15T14:28:02.891380+0000","last_unstale":"2024-05-15T14:47:52.426893+0000","last_undegraded":"2024-05-15T14:47:52.426893+0000","last_fullsized":"2024-05-15T14:47:52.426893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:22.867716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":35,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.505963+0000","last_change":"2024-05-15T14:31:16.594082+0000","last_active":"2024-05-15T14:44:47.505963+0000","last_peered":"2024-05-15T14:44:47.505963+0000","last_clean":"2024-05-15T14:44:47.505963+0000","last_became_active":"2024-05-15T14:31:16.593811+0000","last_became_peered":"2024-05-15T14:31:16.593811+0000","last_unstale":"2024-05-15T14:44:47.505963+0000","last_undegraded":"2024-05-15T14:44:47.505963+0000","last_fullsized":"2024-05-15T14:44:47.505963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:50:49.314475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"39'18","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509629+0000","last_change":"2024-05-15T14:28:37.942802+0000","last_active":"2024-05-15T14:46:37.509629+0000","last_peered":"2024-05-15T14:46:37.509629+0000","last_clean":"2024-05-15T14:46:37.509629+0000","last_became_active":"2024-05-15T14:28:37.942459+0000","last_became_peered":"2024-05-15T14:28:37.942459+0000","last_unstale":"2024-05-15T14:46:37.509629+0000","last_undegraded":"2024-05-15T14:46:37.509629+0000","last_fullsized":"2024-05-15T14:46:37.509629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512553+0000","last_change":"2024-05-15T14:27:50.854562+0000","last_active":"2024-05-15T14:45:12.512553+0000","last_peered":"2024-05-15T14:45:12.512553+0000","last_clean":"2024-05-15T14:45:12.512553+0000","last_became_active":"2024-05-15T14:27:50.854248+0000","last_became_peered":"2024-05-15T14:27:50.854248+0000","last_unstale":"2024-05-15T14:45:12.512553+0000","last_undegraded":"2024-05-15T14:45:12.512553+0000","last_fullsized":"2024-05-15T14:45:12.512553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:38.281851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":50,"num_write_kb":8823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:02.409522+0000","last_change":"2024-05-15T14:27:44.808690+0000","last_active":"2024-05-15T14:45:02.409522+0000","last_peered":"2024-05-15T14:45:02.409522+0000","last_clean":"2024-05-15T14:45:02.409522+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:45:02.409522+0000","last_undegraded":"2024-05-15T14:45:02.409522+0000","last_fullsized":"2024-05-15T14:45:02.409522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'1","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.417441+0000","last_change":"2024-05-15T14:27:56.876363+0000","last_active":"2024-05-15T14:46:42.417441+0000","last_peered":"2024-05-15T14:46:42.417441+0000","last_clean":"2024-05-15T14:46:42.417441+0000","last_became_active":"2024-05-15T14:27:56.875993+0000","last_became_peered":"2024-05-15T14:27:56.875993+0000","last_unstale":"2024-05-15T14:46:42.417441+0000","last_undegraded":"2024-05-15T14:46:42.417441+0000","last_fullsized":"2024-05-15T14:46:42.417441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"39'225","reported_seq":383,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.703454+0000","last_change":"2024-05-15T14:27:58.885451+0000","last_active":"2024-05-15T14:47:52.703454+0000","last_peered":"2024-05-15T14:47:52.703454+0000","last_clean":"2024-05-15T14:47:52.703454+0000","last_became_active":"2024-05-15T14:27:58.885090+0000","last_became_peered":"2024-05-15T14:27:58.885090+0000","last_unstale":"2024-05-15T14:47:52.703454+0000","last_undegraded":"2024-05-15T14:47:52.703454+0000","last_fullsized":"2024-05-15T14:47:52.703454+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.266839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"39'924","reported_seq":1442,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.234813+0000","last_change":"2024-05-15T14:28:00.887968+0000","last_active":"2024-05-15T14:48:26.234813+0000","last_peered":"2024-05-15T14:48:26.234813+0000","last_clean":"2024-05-15T14:48:26.234813+0000","last_became_active":"2024-05-15T14:28:00.884286+0000","last_became_peered":"2024-05-15T14:28:00.884286+0000","last_unstale":"2024-05-15T14:48:26.234813+0000","last_undegraded":"2024-05-15T14:48:26.234813+0000","last_fullsized":"2024-05-15T14:48:26.234813+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:52.523948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"39'24","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.774098+0000","last_change":"2024-05-15T14:28:02.892844+0000","last_active":"2024-05-15T14:47:53.774098+0000","last_peered":"2024-05-15T14:47:53.774098+0000","last_clean":"2024-05-15T14:47:53.774098+0000","last_became_active":"2024-05-15T14:28:02.891822+0000","last_became_peered":"2024-05-15T14:28:02.891822+0000","last_unstale":"2024-05-15T14:47:53.774098+0000","last_undegraded":"2024-05-15T14:47:53.774098+0000","last_fullsized":"2024-05-15T14:47:53.774098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.509354+0000","last_change":"2024-05-15T14:31:16.596256+0000","last_active":"2024-05-15T14:44:47.509354+0000","last_peered":"2024-05-15T14:44:47.509354+0000","last_clean":"2024-05-15T14:44:47.509354+0000","last_became_active":"2024-05-15T14:31:16.595913+0000","last_became_peered":"2024-05-15T14:31:16.595913+0000","last_unstale":"2024-05-15T14:44:47.509354+0000","last_undegraded":"2024-05-15T14:44:47.509354+0000","last_fullsized":"2024-05-15T14:44:47.509354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:23:10.278842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"39'16","reported_seq":115,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416789+0000","last_change":"2024-05-15T14:27:52.848596+0000","last_active":"2024-05-15T14:46:37.416789+0000","last_peered":"2024-05-15T14:46:37.416789+0000","last_clean":"2024-05-15T14:46:37.416789+0000","last_became_active":"2024-05-15T14:27:52.848087+0000","last_became_peered":"2024-05-15T14:27:52.848087+0000","last_unstale":"2024-05-15T14:46:37.416789+0000","last_undegraded":"2024-05-15T14:46:37.416789+0000","last_fullsized":"2024-05-15T14:46:37.416789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.412695+0000","last_change":"2024-05-15T14:27:50.840684+0000","last_active":"2024-05-15T14:45:12.412695+0000","last_peered":"2024-05-15T14:45:12.412695+0000","last_clean":"2024-05-15T14:45:12.412695+0000","last_became_active":"2024-05-15T14:27:50.840365+0000","last_became_peered":"2024-05-15T14:27:50.840365+0000","last_unstale":"2024-05-15T14:45:12.412695+0000","last_undegraded":"2024-05-15T14:45:12.412695+0000","last_fullsized":"2024-05-15T14:45:12.412695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:31.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:07.405827+0000","last_change":"2024-05-15T14:27:44.808595+0000","last_active":"2024-05-15T14:45:07.405827+0000","last_peered":"2024-05-15T14:45:07.405827+0000","last_clean":"2024-05-15T14:45:07.405827+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:45:07.405827+0000","last_undegraded":"2024-05-15T14:45:07.405827+0000","last_fullsized":"2024-05-15T14:45:07.405827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"39'12","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.595287+0000","last_change":"2024-05-15T14:27:56.875443+0000","last_active":"2024-05-15T14:47:21.595287+0000","last_peered":"2024-05-15T14:47:21.595287+0000","last_clean":"2024-05-15T14:47:21.595287+0000","last_became_active":"2024-05-15T14:27:56.875166+0000","last_became_peered":"2024-05-15T14:27:56.875166+0000","last_unstale":"2024-05-15T14:47:21.595287+0000","last_undegraded":"2024-05-15T14:47:21.595287+0000","last_fullsized":"2024-05-15T14:47:21.595287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'539","reported_seq":951,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.019444+0000","last_change":"2024-05-15T14:27:58.881816+0000","last_active":"2024-05-15T14:48:26.019444+0000","last_peered":"2024-05-15T14:48:26.019444+0000","last_clean":"2024-05-15T14:48:26.019444+0000","last_became_active":"2024-05-15T14:27:58.881529+0000","last_became_peered":"2024-05-15T14:27:58.881529+0000","last_unstale":"2024-05-15T14:48:26.019444+0000","last_undegraded":"2024-05-15T14:48:26.019444+0000","last_fullsized":"2024-05-15T14:48:26.019444+0000","mapping_epoch":26,"log_start":"39'500","ondisk_log_start":"39'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:44.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":949,"num_read_kb":979,"num_write":696,"num_write_kb":2669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.526053+0000","last_change":"2024-05-15T14:28:00.892129+0000","last_active":"2024-05-15T14:46:47.526053+0000","last_peered":"2024-05-15T14:46:47.526053+0000","last_clean":"2024-05-15T14:46:47.526053+0000","last_became_active":"2024-05-15T14:28:00.890685+0000","last_became_peered":"2024-05-15T14:28:00.890685+0000","last_unstale":"2024-05-15T14:46:47.526053+0000","last_undegraded":"2024-05-15T14:46:47.526053+0000","last_fullsized":"2024-05-15T14:46:47.526053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:33.793001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"39'29","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.787639+0000","last_change":"2024-05-15T14:28:02.893523+0000","last_active":"2024-05-15T14:47:53.787639+0000","last_peered":"2024-05-15T14:47:53.787639+0000","last_clean":"2024-05-15T14:47:53.787639+0000","last_became_active":"2024-05-15T14:28:02.893174+0000","last_became_peered":"2024-05-15T14:28:02.893174+0000","last_unstale":"2024-05-15T14:47:53.787639+0000","last_undegraded":"2024-05-15T14:47:53.787639+0000","last_fullsized":"2024-05-15T14:47:53.787639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.413812+0000","last_change":"2024-05-15T14:31:16.593175+0000","last_active":"2024-05-15T14:45:22.413812+0000","last_peered":"2024-05-15T14:45:22.413812+0000","last_clean":"2024-05-15T14:45:22.413812+0000","last_became_active":"2024-05-15T14:31:16.592898+0000","last_became_peered":"2024-05-15T14:31:16.592898+0000","last_unstale":"2024-05-15T14:45:22.413812+0000","last_undegraded":"2024-05-15T14:45:22.413812+0000","last_fullsized":"2024-05-15T14:45:22.413812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:15.668825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'26","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.789319+0000","last_change":"2024-05-15T14:28:02.893742+0000","last_active":"2024-05-15T14:47:53.789319+0000","last_peered":"2024-05-15T14:47:53.789319+0000","last_clean":"2024-05-15T14:47:53.789319+0000","last_became_active":"2024-05-15T14:28:02.892547+0000","last_became_peered":"2024-05-15T14:28:02.892547+0000","last_unstale":"2024-05-15T14:47:53.789319+0000","last_undegraded":"2024-05-15T14:47:53.789319+0000","last_fullsized":"2024-05-15T14:47:53.789319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:30:24.259350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":37,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"39'44","reported_seq":129,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416184+0000","last_change":"2024-05-15T14:27:52.842978+0000","last_active":"2024-05-15T14:46:32.416184+0000","last_peered":"2024-05-15T14:46:32.416184+0000","last_clean":"2024-05-15T14:46:32.416184+0000","last_became_active":"2024-05-15T14:27:52.842733+0000","last_became_peered":"2024-05-15T14:27:52.842733+0000","last_unstale":"2024-05-15T14:46:32.416184+0000","last_undegraded":"2024-05-15T14:46:32.416184+0000","last_fullsized":"2024-05-15T14:46:32.416184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":143,"num_write":62,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"39'22","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:17.514606+0000","last_change":"2024-05-15T14:28:37.941321+0000","last_active":"2024-05-15T14:47:17.514606+0000","last_peered":"2024-05-15T14:47:17.514606+0000","last_clean":"2024-05-15T14:47:17.514606+0000","last_became_active":"2024-05-15T14:28:37.940961+0000","last_became_peered":"2024-05-15T14:28:37.940961+0000","last_unstale":"2024-05-15T14:47:17.514606+0000","last_undegraded":"2024-05-15T14:47:17.514606+0000","last_fullsized":"2024-05-15T14:47:17.514606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:20.511289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":33493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'2","reported_seq":1004,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.918986+0000","last_change":"2024-05-15T14:27:56.879335+0000","last_active":"2024-05-15T14:48:25.918986+0000","last_peered":"2024-05-15T14:48:25.918986+0000","last_clean":"2024-05-15T14:48:25.918986+0000","last_became_active":"2024-05-15T14:27:56.879047+0000","last_became_peered":"2024-05-15T14:27:56.879047+0000","last_unstale":"2024-05-15T14:48:25.918986+0000","last_undegraded":"2024-05-15T14:48:25.918986+0000","last_fullsized":"2024-05-15T14:48:25.918986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:55.716648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"39'700","reported_seq":1150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.045495+0000","last_change":"2024-05-15T14:27:58.882036+0000","last_active":"2024-05-15T14:48:26.045495+0000","last_peered":"2024-05-15T14:48:26.045495+0000","last_clean":"2024-05-15T14:48:26.045495+0000","last_became_active":"2024-05-15T14:27:58.881703+0000","last_became_peered":"2024-05-15T14:27:58.881703+0000","last_unstale":"2024-05-15T14:48:26.045495+0000","last_undegraded":"2024-05-15T14:48:26.045495+0000","last_fullsized":"2024-05-15T14:48:26.045495+0000","mapping_epoch":26,"log_start":"39'600","ondisk_log_start":"39'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1566,"num_read_kb":3600,"num_write":907,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.505836+0000","last_change":"2024-05-15T14:28:00.884111+0000","last_active":"2024-05-15T14:44:22.505836+0000","last_peered":"2024-05-15T14:44:22.505836+0000","last_clean":"2024-05-15T14:44:22.505836+0000","last_became_active":"2024-05-15T14:28:00.883811+0000","last_became_peered":"2024-05-15T14:28:00.883811+0000","last_unstale":"2024-05-15T14:44:22.505836+0000","last_undegraded":"2024-05-15T14:44:22.505836+0000","last_fullsized":"2024-05-15T14:44:22.505836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:25.050335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.415259+0000","last_change":"2024-05-15T14:31:16.592460+0000","last_active":"2024-05-15T14:45:52.415259+0000","last_peered":"2024-05-15T14:45:52.415259+0000","last_clean":"2024-05-15T14:45:52.415259+0000","last_became_active":"2024-05-15T14:31:16.592053+0000","last_became_peered":"2024-05-15T14:31:16.592053+0000","last_unstale":"2024-05-15T14:45:52.415259+0000","last_undegraded":"2024-05-15T14:45:52.415259+0000","last_fullsized":"2024-05-15T14:45:52.415259+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:36.246607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"39'29","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.772545+0000","last_change":"2024-05-15T14:28:02.894336+0000","last_active":"2024-05-15T14:47:53.772545+0000","last_peered":"2024-05-15T14:47:53.772545+0000","last_clean":"2024-05-15T14:47:53.772545+0000","last_became_active":"2024-05-15T14:28:02.894053+0000","last_became_peered":"2024-05-15T14:28:02.894053+0000","last_unstale":"2024-05-15T14:47:53.772545+0000","last_undegraded":"2024-05-15T14:47:53.772545+0000","last_fullsized":"2024-05-15T14:47:53.772545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:49:32.038155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"39'12","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420386+0000","last_change":"2024-05-15T14:27:52.849694+0000","last_active":"2024-05-15T14:46:32.420386+0000","last_peered":"2024-05-15T14:46:32.420386+0000","last_clean":"2024-05-15T14:46:32.420386+0000","last_became_active":"2024-05-15T14:27:52.849013+0000","last_became_peered":"2024-05-15T14:27:52.849013+0000","last_unstale":"2024-05-15T14:46:32.420386+0000","last_undegraded":"2024-05-15T14:46:32.420386+0000","last_fullsized":"2024-05-15T14:46:32.420386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:16.565935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"39'12","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.505977+0000","last_change":"2024-05-15T14:27:50.853302+0000","last_active":"2024-05-15T14:44:47.505977+0000","last_peered":"2024-05-15T14:44:47.505977+0000","last_clean":"2024-05-15T14:44:47.505977+0000","last_became_active":"2024-05-15T14:27:50.852755+0000","last_became_peered":"2024-05-15T14:27:50.852755+0000","last_unstale":"2024-05-15T14:44:47.505977+0000","last_undegraded":"2024-05-15T14:44:47.505977+0000","last_fullsized":"2024-05-15T14:44:47.505977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.505272+0000","last_change":"2024-05-15T14:27:56.883749+0000","last_active":"2024-05-15T14:44:17.505272+0000","last_peered":"2024-05-15T14:44:17.505272+0000","last_clean":"2024-05-15T14:44:17.505272+0000","last_became_active":"2024-05-15T14:27:56.883312+0000","last_became_peered":"2024-05-15T14:27:56.883312+0000","last_unstale":"2024-05-15T14:44:17.505272+0000","last_undegraded":"2024-05-15T14:44:17.505272+0000","last_fullsized":"2024-05-15T14:44:17.505272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'158","reported_seq":222582,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.527715+0000","last_change":"2024-05-15T14:27:58.884965+0000","last_active":"2024-05-15T14:47:52.527715+0000","last_peered":"2024-05-15T14:47:52.527715+0000","last_clean":"2024-05-15T14:47:52.527715+0000","last_became_active":"2024-05-15T14:27:58.884647+0000","last_became_peered":"2024-05-15T14:27:58.884647+0000","last_unstale":"2024-05-15T14:47:52.527715+0000","last_undegraded":"2024-05-15T14:47:52.527715+0000","last_fullsized":"2024-05-15T14:47:52.527715+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:11.016089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555956,"num_read_kb":2334405,"num_write":176,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.502471+0000","last_change":"2024-05-15T14:28:00.889155+0000","last_active":"2024-05-15T14:44:22.502471+0000","last_peered":"2024-05-15T14:44:22.502471+0000","last_clean":"2024-05-15T14:44:22.502471+0000","last_became_active":"2024-05-15T14:28:00.888834+0000","last_became_peered":"2024-05-15T14:28:00.888834+0000","last_unstale":"2024-05-15T14:44:22.502471+0000","last_undegraded":"2024-05-15T14:44:22.502471+0000","last_fullsized":"2024-05-15T14:44:22.502471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:51.080731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.419945+0000","last_change":"2024-05-15T14:31:16.594403+0000","last_active":"2024-05-15T14:46:17.419945+0000","last_peered":"2024-05-15T14:46:17.419945+0000","last_clean":"2024-05-15T14:46:17.419945+0000","last_became_active":"2024-05-15T14:31:16.594114+0000","last_became_peered":"2024-05-15T14:31:16.594114+0000","last_unstale":"2024-05-15T14:46:17.419945+0000","last_undegraded":"2024-05-15T14:46:17.419945+0000","last_fullsized":"2024-05-15T14:46:17.419945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:24.367502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"39'28","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.331459+0000","last_change":"2024-05-15T14:28:02.890351+0000","last_active":"2024-05-15T14:47:54.331459+0000","last_peered":"2024-05-15T14:47:54.331459+0000","last_clean":"2024-05-15T14:47:54.331459+0000","last_became_active":"2024-05-15T14:28:02.890071+0000","last_became_peered":"2024-05-15T14:28:02.890071+0000","last_unstale":"2024-05-15T14:47:54.331459+0000","last_undegraded":"2024-05-15T14:47:54.331459+0000","last_fullsized":"2024-05-15T14:47:54.331459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":114,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'10","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.523980+0000","last_change":"2024-05-15T14:27:52.852243+0000","last_active":"2024-05-15T14:46:32.523980+0000","last_peered":"2024-05-15T14:46:32.523980+0000","last_clean":"2024-05-15T14:46:32.523980+0000","last_became_active":"2024-05-15T14:27:52.851940+0000","last_became_peered":"2024-05-15T14:27:52.851940+0000","last_unstale":"2024-05-15T14:46:32.523980+0000","last_undegraded":"2024-05-15T14:46:32.523980+0000","last_fullsized":"2024-05-15T14:46:32.523980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403389+0000","last_change":"2024-05-15T14:27:50.846653+0000","last_active":"2024-05-15T14:44:47.403389+0000","last_peered":"2024-05-15T14:44:47.403389+0000","last_clean":"2024-05-15T14:44:47.403389+0000","last_became_active":"2024-05-15T14:27:50.846362+0000","last_became_peered":"2024-05-15T14:27:50.846362+0000","last_unstale":"2024-05-15T14:44:47.403389+0000","last_undegraded":"2024-05-15T14:44:47.403389+0000","last_fullsized":"2024-05-15T14:44:47.403389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"39'11","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.464655+0000","last_change":"2024-05-15T14:27:56.878406+0000","last_active":"2024-05-15T14:47:21.464655+0000","last_peered":"2024-05-15T14:47:21.464655+0000","last_clean":"2024-05-15T14:47:21.464655+0000","last_became_active":"2024-05-15T14:27:56.877413+0000","last_became_peered":"2024-05-15T14:27:56.877413+0000","last_unstale":"2024-05-15T14:47:21.464655+0000","last_undegraded":"2024-05-15T14:47:21.464655+0000","last_fullsized":"2024-05-15T14:47:21.464655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:59.085552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"39'246","reported_seq":460,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.003273+0000","last_change":"2024-05-15T14:27:58.881927+0000","last_active":"2024-05-15T14:48:26.003273+0000","last_peered":"2024-05-15T14:48:26.003273+0000","last_clean":"2024-05-15T14:48:26.003273+0000","last_became_active":"2024-05-15T14:27:58.881581+0000","last_became_peered":"2024-05-15T14:27:58.881581+0000","last_unstale":"2024-05-15T14:48:26.003273+0000","last_undegraded":"2024-05-15T14:48:26.003273+0000","last_fullsized":"2024-05-15T14:48:26.003273+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:40.707496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":385,"num_write":222,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.400519+0000","last_change":"2024-05-15T14:28:00.888057+0000","last_active":"2024-05-15T14:44:22.400519+0000","last_peered":"2024-05-15T14:44:22.400519+0000","last_clean":"2024-05-15T14:44:22.400519+0000","last_became_active":"2024-05-15T14:28:00.887738+0000","last_became_peered":"2024-05-15T14:28:00.887738+0000","last_unstale":"2024-05-15T14:44:22.400519+0000","last_undegraded":"2024-05-15T14:44:22.400519+0000","last_fullsized":"2024-05-15T14:44:22.400519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:59.723993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.419981+0000","last_change":"2024-05-15T14:31:16.591389+0000","last_active":"2024-05-15T14:46:17.419981+0000","last_peered":"2024-05-15T14:46:17.419981+0000","last_clean":"2024-05-15T14:46:17.419981+0000","last_became_active":"2024-05-15T14:31:16.590502+0000","last_became_peered":"2024-05-15T14:31:16.590502+0000","last_unstale":"2024-05-15T14:46:17.419981+0000","last_undegraded":"2024-05-15T14:46:17.419981+0000","last_fullsized":"2024-05-15T14:46:17.419981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:58:48.832872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'26","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.780086+0000","last_change":"2024-05-15T14:28:02.895306+0000","last_active":"2024-05-15T14:47:53.780086+0000","last_peered":"2024-05-15T14:47:53.780086+0000","last_clean":"2024-05-15T14:47:53.780086+0000","last_became_active":"2024-05-15T14:28:02.894280+0000","last_became_peered":"2024-05-15T14:28:02.894280+0000","last_unstale":"2024-05-15T14:47:53.780086+0000","last_undegraded":"2024-05-15T14:47:53.780086+0000","last_fullsized":"2024-05-15T14:47:53.780086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"39'66","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814583+0000","last_change":"2024-05-15T14:27:52.862502+0000","last_active":"2024-05-15T14:47:53.814583+0000","last_peered":"2024-05-15T14:47:53.814583+0000","last_clean":"2024-05-15T14:47:53.814583+0000","last_became_active":"2024-05-15T14:27:52.862259+0000","last_became_peered":"2024-05-15T14:27:52.862259+0000","last_unstale":"2024-05-15T14:47:53.814583+0000","last_undegraded":"2024-05-15T14:47:53.814583+0000","last_fullsized":"2024-05-15T14:47:53.814583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":205,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"39'8","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.409935+0000","last_change":"2024-05-15T14:27:50.844225+0000","last_active":"2024-05-15T14:44:47.409935+0000","last_peered":"2024-05-15T14:44:47.409935+0000","last_clean":"2024-05-15T14:44:47.409935+0000","last_became_active":"2024-05-15T14:27:50.843223+0000","last_became_peered":"2024-05-15T14:27:50.843223+0000","last_unstale":"2024-05-15T14:44:47.409935+0000","last_undegraded":"2024-05-15T14:44:47.409935+0000","last_fullsized":"2024-05-15T14:44:47.409935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"39'9","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.466203+0000","last_change":"2024-05-15T14:27:56.880459+0000","last_active":"2024-05-15T14:47:21.466203+0000","last_peered":"2024-05-15T14:47:21.466203+0000","last_clean":"2024-05-15T14:47:21.466203+0000","last_became_active":"2024-05-15T14:27:56.879589+0000","last_became_peered":"2024-05-15T14:27:56.879589+0000","last_unstale":"2024-05-15T14:47:21.466203+0000","last_undegraded":"2024-05-15T14:47:21.466203+0000","last_fullsized":"2024-05-15T14:47:21.466203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:15.202251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"39'199","reported_seq":391,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.993044+0000","last_change":"2024-05-15T14:27:58.885088+0000","last_active":"2024-05-15T14:48:25.993044+0000","last_peered":"2024-05-15T14:48:25.993044+0000","last_clean":"2024-05-15T14:48:25.993044+0000","last_became_active":"2024-05-15T14:27:58.884831+0000","last_became_peered":"2024-05-15T14:27:58.884831+0000","last_unstale":"2024-05-15T14:48:25.993044+0000","last_undegraded":"2024-05-15T14:48:25.993044+0000","last_fullsized":"2024-05-15T14:48:25.993044+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:27.597755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":320,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.406922+0000","last_change":"2024-05-15T14:28:00.887876+0000","last_active":"2024-05-15T14:44:22.406922+0000","last_peered":"2024-05-15T14:44:22.406922+0000","last_clean":"2024-05-15T14:44:22.406922+0000","last_became_active":"2024-05-15T14:28:00.887513+0000","last_became_peered":"2024-05-15T14:28:00.887513+0000","last_unstale":"2024-05-15T14:44:22.406922+0000","last_undegraded":"2024-05-15T14:44:22.406922+0000","last_fullsized":"2024-05-15T14:44:22.406922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:42.711145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407243+0000","last_change":"2024-05-15T14:31:16.594526+0000","last_active":"2024-05-15T14:45:17.407243+0000","last_peered":"2024-05-15T14:45:17.407243+0000","last_clean":"2024-05-15T14:45:17.407243+0000","last_became_active":"2024-05-15T14:31:16.594193+0000","last_became_peered":"2024-05-15T14:31:16.594193+0000","last_unstale":"2024-05-15T14:45:17.407243+0000","last_undegraded":"2024-05-15T14:45:17.407243+0000","last_fullsized":"2024-05-15T14:45:17.407243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:15:13.565975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"39'20","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814088+0000","last_change":"2024-05-15T14:27:52.847892+0000","last_active":"2024-05-15T14:47:53.814088+0000","last_peered":"2024-05-15T14:47:53.814088+0000","last_clean":"2024-05-15T14:47:53.814088+0000","last_became_active":"2024-05-15T14:27:52.847609+0000","last_became_peered":"2024-05-15T14:27:52.847609+0000","last_unstale":"2024-05-15T14:47:53.814088+0000","last_undegraded":"2024-05-15T14:47:53.814088+0000","last_fullsized":"2024-05-15T14:47:53.814088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:45.470476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":78,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.509233+0000","last_change":"2024-05-15T14:27:50.850851+0000","last_active":"2024-05-15T14:44:47.509233+0000","last_peered":"2024-05-15T14:44:47.509233+0000","last_clean":"2024-05-15T14:44:47.509233+0000","last_became_active":"2024-05-15T14:27:50.850524+0000","last_became_peered":"2024-05-15T14:27:50.850524+0000","last_unstale":"2024-05-15T14:44:47.509233+0000","last_undegraded":"2024-05-15T14:44:47.509233+0000","last_fullsized":"2024-05-15T14:44:47.509233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":18802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"39'11","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.908765+0000","last_change":"2024-05-15T14:27:56.882053+0000","last_active":"2024-05-15T14:48:25.908765+0000","last_peered":"2024-05-15T14:48:25.908765+0000","last_clean":"2024-05-15T14:48:25.908765+0000","last_became_active":"2024-05-15T14:27:56.881789+0000","last_became_peered":"2024-05-15T14:27:56.881789+0000","last_unstale":"2024-05-15T14:48:25.908765+0000","last_undegraded":"2024-05-15T14:48:25.908765+0000","last_fullsized":"2024-05-15T14:48:25.908765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:42.831889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":178,"num_write":22,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"39'270","reported_seq":550,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.063817+0000","last_change":"2024-05-15T14:27:58.887437+0000","last_active":"2024-05-15T14:48:26.063817+0000","last_peered":"2024-05-15T14:48:26.063817+0000","last_clean":"2024-05-15T14:48:26.063817+0000","last_became_active":"2024-05-15T14:27:58.887134+0000","last_became_peered":"2024-05-15T14:27:58.887134+0000","last_unstale":"2024-05-15T14:48:26.063817+0000","last_undegraded":"2024-05-15T14:48:26.063817+0000","last_fullsized":"2024-05-15T14:48:26.063817+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:48.300102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":460,"num_read_kb":450,"num_write":224,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.409142+0000","last_change":"2024-05-15T14:28:00.885482+0000","last_active":"2024-05-15T14:45:32.409142+0000","last_peered":"2024-05-15T14:45:32.409142+0000","last_clean":"2024-05-15T14:45:32.409142+0000","last_became_active":"2024-05-15T14:28:00.885174+0000","last_became_peered":"2024-05-15T14:28:00.885174+0000","last_unstale":"2024-05-15T14:45:32.409142+0000","last_undegraded":"2024-05-15T14:45:32.409142+0000","last_fullsized":"2024-05-15T14:45:32.409142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:03.551642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"39'30","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.322341+0000","last_change":"2024-05-15T14:28:02.894975+0000","last_active":"2024-05-15T14:47:54.322341+0000","last_peered":"2024-05-15T14:47:54.322341+0000","last_clean":"2024-05-15T14:47:54.322341+0000","last_became_active":"2024-05-15T14:28:02.894515+0000","last_became_peered":"2024-05-15T14:28:02.894515+0000","last_unstale":"2024-05-15T14:47:54.322341+0000","last_undegraded":"2024-05-15T14:47:54.322341+0000","last_fullsized":"2024-05-15T14:47:54.322341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:48.703371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.510012+0000","last_change":"2024-05-15T14:31:16.589730+0000","last_active":"2024-05-15T14:45:17.510012+0000","last_peered":"2024-05-15T14:45:17.510012+0000","last_clean":"2024-05-15T14:45:17.510012+0000","last_became_active":"2024-05-15T14:31:16.589442+0000","last_became_peered":"2024-05-15T14:31:16.589442+0000","last_unstale":"2024-05-15T14:45:17.510012+0000","last_undegraded":"2024-05-15T14:45:17.510012+0000","last_fullsized":"2024-05-15T14:45:17.510012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:32:21.556315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"39'56","reported_seq":140,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814321+0000","last_change":"2024-05-15T14:27:52.845888+0000","last_active":"2024-05-15T14:47:53.814321+0000","last_peered":"2024-05-15T14:47:53.814321+0000","last_clean":"2024-05-15T14:47:53.814321+0000","last_became_active":"2024-05-15T14:27:52.845557+0000","last_became_peered":"2024-05-15T14:27:52.845557+0000","last_unstale":"2024-05-15T14:47:53.814321+0000","last_undegraded":"2024-05-15T14:47:53.814321+0000","last_fullsized":"2024-05-15T14:47:53.814321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":171,"num_write":80,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"39'10","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.408489+0000","last_change":"2024-05-15T14:27:50.850506+0000","last_active":"2024-05-15T14:44:52.408489+0000","last_peered":"2024-05-15T14:44:52.408489+0000","last_clean":"2024-05-15T14:44:52.408489+0000","last_became_active":"2024-05-15T14:27:50.850175+0000","last_became_peered":"2024-05-15T14:27:50.850175+0000","last_unstale":"2024-05-15T14:44:52.408489+0000","last_undegraded":"2024-05-15T14:44:52.408489+0000","last_fullsized":"2024-05-15T14:44:52.408489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416792+0000","last_change":"2024-05-15T14:27:56.879893+0000","last_active":"2024-05-15T14:46:42.416792+0000","last_peered":"2024-05-15T14:46:42.416792+0000","last_clean":"2024-05-15T14:46:42.416792+0000","last_became_active":"2024-05-15T14:27:56.879634+0000","last_became_peered":"2024-05-15T14:27:56.879634+0000","last_unstale":"2024-05-15T14:46:42.416792+0000","last_undegraded":"2024-05-15T14:46:42.416792+0000","last_fullsized":"2024-05-15T14:46:42.416792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:06.597029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"39'500","reported_seq":1244,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.997567+0000","last_change":"2024-05-15T14:27:58.887413+0000","last_active":"2024-05-15T14:48:25.997567+0000","last_peered":"2024-05-15T14:48:25.997567+0000","last_clean":"2024-05-15T14:48:25.997567+0000","last_became_active":"2024-05-15T14:27:58.887144+0000","last_became_peered":"2024-05-15T14:27:58.887144+0000","last_unstale":"2024-05-15T14:48:25.997567+0000","last_undegraded":"2024-05-15T14:48:25.997567+0000","last_fullsized":"2024-05-15T14:48:25.997567+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:56.197135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":997,"num_read_kb":904,"num_write":673,"num_write_kb":1754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.412930+0000","last_change":"2024-05-15T14:28:00.891661+0000","last_active":"2024-05-15T14:45:32.412930+0000","last_peered":"2024-05-15T14:45:32.412930+0000","last_clean":"2024-05-15T14:45:32.412930+0000","last_became_active":"2024-05-15T14:28:00.891343+0000","last_became_peered":"2024-05-15T14:28:00.891343+0000","last_unstale":"2024-05-15T14:45:32.412930+0000","last_undegraded":"2024-05-15T14:45:32.412930+0000","last_fullsized":"2024-05-15T14:45:32.412930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:29.432233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"39'31","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.248871+0000","last_change":"2024-05-15T14:28:02.890221+0000","last_active":"2024-05-15T14:46:21.248871+0000","last_peered":"2024-05-15T14:46:21.248871+0000","last_clean":"2024-05-15T14:46:21.248871+0000","last_became_active":"2024-05-15T14:28:02.889940+0000","last_became_peered":"2024-05-15T14:28:02.889940+0000","last_unstale":"2024-05-15T14:46:21.248871+0000","last_undegraded":"2024-05-15T14:46:21.248871+0000","last_fullsized":"2024-05-15T14:46:21.248871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:48.842803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":111,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407852+0000","last_change":"2024-05-15T14:31:16.590555+0000","last_active":"2024-05-15T14:45:17.407852+0000","last_peered":"2024-05-15T14:45:17.407852+0000","last_clean":"2024-05-15T14:45:17.407852+0000","last_became_active":"2024-05-15T14:31:16.590270+0000","last_became_peered":"2024-05-15T14:31:16.590270+0000","last_unstale":"2024-05-15T14:45:17.407852+0000","last_undegraded":"2024-05-15T14:45:17.407852+0000","last_fullsized":"2024-05-15T14:45:17.407852+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:01:05.887839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'14","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.807073+0000","last_change":"2024-05-15T14:27:52.861766+0000","last_active":"2024-05-15T14:47:53.807073+0000","last_peered":"2024-05-15T14:47:53.807073+0000","last_clean":"2024-05-15T14:47:53.807073+0000","last_became_active":"2024-05-15T14:27:52.861459+0000","last_became_peered":"2024-05-15T14:27:52.861459+0000","last_unstale":"2024-05-15T14:47:53.807073+0000","last_undegraded":"2024-05-15T14:47:53.807073+0000","last_fullsized":"2024-05-15T14:47:53.807073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408411+0000","last_change":"2024-05-15T14:27:50.836665+0000","last_active":"2024-05-15T14:45:22.408411+0000","last_peered":"2024-05-15T14:45:22.408411+0000","last_clean":"2024-05-15T14:45:22.408411+0000","last_became_active":"2024-05-15T14:27:50.836343+0000","last_became_peered":"2024-05-15T14:27:50.836343+0000","last_unstale":"2024-05-15T14:45:22.408411+0000","last_undegraded":"2024-05-15T14:45:22.408411+0000","last_fullsized":"2024-05-15T14:45:22.408411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:38.935625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:27.408960+0000","last_change":"2024-05-15T14:27:56.877775+0000","last_active":"2024-05-15T14:45:27.408960+0000","last_peered":"2024-05-15T14:45:27.408960+0000","last_clean":"2024-05-15T14:45:27.408960+0000","last_became_active":"2024-05-15T14:27:56.876994+0000","last_became_peered":"2024-05-15T14:27:56.876994+0000","last_unstale":"2024-05-15T14:45:27.408960+0000","last_undegraded":"2024-05-15T14:45:27.408960+0000","last_fullsized":"2024-05-15T14:45:27.408960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"39'247","reported_seq":467,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.058303+0000","last_change":"2024-05-15T14:27:58.877101+0000","last_active":"2024-05-15T14:48:26.058303+0000","last_peered":"2024-05-15T14:48:26.058303+0000","last_clean":"2024-05-15T14:48:26.058303+0000","last_became_active":"2024-05-15T14:27:58.876807+0000","last_became_peered":"2024-05-15T14:27:58.876807+0000","last_unstale":"2024-05-15T14:48:26.058303+0000","last_undegraded":"2024-05-15T14:48:26.058303+0000","last_fullsized":"2024-05-15T14:48:26.058303+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:27.039335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":390,"num_write":224,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:07.417129+0000","last_change":"2024-05-15T14:28:00.891499+0000","last_active":"2024-05-15T14:46:07.417129+0000","last_peered":"2024-05-15T14:46:07.417129+0000","last_clean":"2024-05-15T14:46:07.417129+0000","last_became_active":"2024-05-15T14:28:00.891181+0000","last_became_peered":"2024-05-15T14:28:00.891181+0000","last_unstale":"2024-05-15T14:46:07.417129+0000","last_undegraded":"2024-05-15T14:46:07.417129+0000","last_fullsized":"2024-05-15T14:46:07.417129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:38:22.090345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"39'31","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.725546+0000","last_change":"2024-05-15T14:28:02.890319+0000","last_active":"2024-05-15T14:47:53.725546+0000","last_peered":"2024-05-15T14:47:53.725546+0000","last_clean":"2024-05-15T14:47:53.725546+0000","last_became_active":"2024-05-15T14:28:02.889976+0000","last_became_peered":"2024-05-15T14:28:02.889976+0000","last_unstale":"2024-05-15T14:47:53.725546+0000","last_undegraded":"2024-05-15T14:47:53.725546+0000","last_fullsized":"2024-05-15T14:47:53.725546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:35.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.509569+0000","last_change":"2024-05-15T14:31:16.592036+0000","last_active":"2024-05-15T14:45:17.509569+0000","last_peered":"2024-05-15T14:45:17.509569+0000","last_clean":"2024-05-15T14:45:17.509569+0000","last_became_active":"2024-05-15T14:31:16.591739+0000","last_became_peered":"2024-05-15T14:31:16.591739+0000","last_unstale":"2024-05-15T14:45:17.509569+0000","last_undegraded":"2024-05-15T14:45:17.509569+0000","last_fullsized":"2024-05-15T14:45:17.509569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:29:51.681101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1c","version":"39'60","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.859800+0000","last_change":"2024-05-15T14:27:52.838848+0000","last_active":"2024-05-15T14:47:53.859800+0000","last_peered":"2024-05-15T14:47:53.859800+0000","last_clean":"2024-05-15T14:47:53.859800+0000","last_became_active":"2024-05-15T14:27:52.838558+0000","last_became_peered":"2024-05-15T14:27:52.838558+0000","last_unstale":"2024-05-15T14:47:53.859800+0000","last_undegraded":"2024-05-15T14:47:53.859800+0000","last_fullsized":"2024-05-15T14:47:53.859800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:39.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":198,"num_write":84,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"39'14","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.431530+0000","last_change":"2024-05-15T14:27:50.834122+0000","last_active":"2024-05-15T14:47:52.431530+0000","last_peered":"2024-05-15T14:47:52.431530+0000","last_clean":"2024-05-15T14:47:52.431530+0000","last_became_active":"2024-05-15T14:27:50.833741+0000","last_became_peered":"2024-05-15T14:27:50.833741+0000","last_unstale":"2024-05-15T14:47:52.431530+0000","last_undegraded":"2024-05-15T14:47:52.431530+0000","last_fullsized":"2024-05-15T14:47:52.431530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20,"num_write":62,"num_write_kb":15860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":276,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:49.987139+0000","last_change":"2024-05-15T14:27:56.884180+0000","last_active":"2024-05-15T14:45:49.987139+0000","last_peered":"2024-05-15T14:45:49.987139+0000","last_clean":"2024-05-15T14:45:49.987139+0000","last_became_active":"2024-05-15T14:27:56.883663+0000","last_became_peered":"2024-05-15T14:27:56.883663+0000","last_unstale":"2024-05-15T14:45:49.987139+0000","last_undegraded":"2024-05-15T14:45:49.987139+0000","last_fullsized":"2024-05-15T14:45:49.987139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:26.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2211,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":456,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"39'289","reported_seq":645,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:55.118121+0000","last_change":"2024-05-15T14:27:58.880803+0000","last_active":"2024-05-15T14:47:55.118121+0000","last_peered":"2024-05-15T14:47:55.118121+0000","last_clean":"2024-05-15T14:47:55.118121+0000","last_became_active":"2024-05-15T14:27:58.880510+0000","last_became_peered":"2024-05-15T14:27:58.880510+0000","last_unstale":"2024-05-15T14:47:55.118121+0000","last_undegraded":"2024-05-15T14:47:55.118121+0000","last_fullsized":"2024-05-15T14:47:55.118121+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:03.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":979,"num_read_kb":1295,"num_write":324,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'924","reported_seq":2554,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.229886+0000","last_change":"2024-05-15T14:28:00.885605+0000","last_active":"2024-05-15T14:48:26.229886+0000","last_peered":"2024-05-15T14:48:26.229886+0000","last_clean":"2024-05-15T14:48:26.229886+0000","last_became_active":"2024-05-15T14:28:00.885293+0000","last_became_peered":"2024-05-15T14:28:00.885293+0000","last_unstale":"2024-05-15T14:48:26.229886+0000","last_undegraded":"2024-05-15T14:48:26.229886+0000","last_fullsized":"2024-05-15T14:48:26.229886+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:25.360934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"39'25","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.696985+0000","last_change":"2024-05-15T14:28:02.893269+0000","last_active":"2024-05-15T14:47:53.696985+0000","last_peered":"2024-05-15T14:47:53.696985+0000","last_clean":"2024-05-15T14:47:53.696985+0000","last_became_active":"2024-05-15T14:28:02.892984+0000","last_became_peered":"2024-05-15T14:28:02.892984+0000","last_unstale":"2024-05-15T14:47:53.696985+0000","last_undegraded":"2024-05-15T14:47:53.696985+0000","last_fullsized":"2024-05-15T14:47:53.696985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:44.714715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":37,"num_write":54,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.411080+0000","last_change":"2024-05-15T14:31:16.594309+0000","last_active":"2024-05-15T14:45:47.411080+0000","last_peered":"2024-05-15T14:45:47.411080+0000","last_clean":"2024-05-15T14:45:47.411080+0000","last_became_active":"2024-05-15T14:31:16.594019+0000","last_became_peered":"2024-05-15T14:31:16.594019+0000","last_unstale":"2024-05-15T14:45:47.411080+0000","last_undegraded":"2024-05-15T14:45:47.411080+0000","last_fullsized":"2024-05-15T14:45:47.411080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:25:09.888037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"39'52","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.320806+0000","last_change":"2024-05-15T14:27:52.854866+0000","last_active":"2024-05-15T14:47:54.320806+0000","last_peered":"2024-05-15T14:47:54.320806+0000","last_clean":"2024-05-15T14:47:54.320806+0000","last_became_active":"2024-05-15T14:27:52.854479+0000","last_became_peered":"2024-05-15T14:27:52.854479+0000","last_unstale":"2024-05-15T14:47:54.320806+0000","last_undegraded":"2024-05-15T14:47:54.320806+0000","last_fullsized":"2024-05-15T14:47:54.320806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":157,"num_write":72,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408007+0000","last_change":"2024-05-15T14:27:50.841154+0000","last_active":"2024-05-15T14:45:22.408007+0000","last_peered":"2024-05-15T14:45:22.408007+0000","last_clean":"2024-05-15T14:45:22.408007+0000","last_became_active":"2024-05-15T14:27:50.840771+0000","last_became_peered":"2024-05-15T14:27:50.840771+0000","last_unstale":"2024-05-15T14:45:22.408007+0000","last_undegraded":"2024-05-15T14:45:22.408007+0000","last_fullsized":"2024-05-15T14:45:22.408007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:18.416733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'25","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.593035+0000","last_change":"2024-05-15T14:27:56.878204+0000","last_active":"2024-05-15T14:47:21.593035+0000","last_peered":"2024-05-15T14:47:21.593035+0000","last_clean":"2024-05-15T14:47:21.593035+0000","last_became_active":"2024-05-15T14:27:56.877367+0000","last_became_peered":"2024-05-15T14:27:56.877367+0000","last_unstale":"2024-05-15T14:47:21.593035+0000","last_undegraded":"2024-05-15T14:47:21.593035+0000","last_fullsized":"2024-05-15T14:47:21.593035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:48.893192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":101,"num_read_kb":87,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"39'408","reported_seq":22976,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.077957+0000","last_change":"2024-05-15T14:27:58.882407+0000","last_active":"2024-05-15T14:48:26.077957+0000","last_peered":"2024-05-15T14:48:26.077957+0000","last_clean":"2024-05-15T14:48:26.077957+0000","last_became_active":"2024-05-15T14:27:58.882139+0000","last_became_peered":"2024-05-15T14:27:58.882139+0000","last_unstale":"2024-05-15T14:48:26.077957+0000","last_undegraded":"2024-05-15T14:48:26.077957+0000","last_fullsized":"2024-05-15T14:48:26.077957+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:49.077081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56365,"num_read_kb":194190,"num_write":402,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.410843+0000","last_change":"2024-05-15T14:28:00.886162+0000","last_active":"2024-05-15T14:44:57.410843+0000","last_peered":"2024-05-15T14:44:57.410843+0000","last_clean":"2024-05-15T14:44:57.410843+0000","last_became_active":"2024-05-15T14:28:00.885872+0000","last_became_peered":"2024-05-15T14:28:00.885872+0000","last_unstale":"2024-05-15T14:44:57.410843+0000","last_undegraded":"2024-05-15T14:44:57.410843+0000","last_fullsized":"2024-05-15T14:44:57.410843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:42.856744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"39'21","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.251279+0000","last_change":"2024-05-15T14:28:02.896566+0000","last_active":"2024-05-15T14:47:54.251279+0000","last_peered":"2024-05-15T14:47:54.251279+0000","last_clean":"2024-05-15T14:47:54.251279+0000","last_became_active":"2024-05-15T14:28:02.896293+0000","last_became_peered":"2024-05-15T14:28:02.896293+0000","last_unstale":"2024-05-15T14:47:54.251279+0000","last_undegraded":"2024-05-15T14:47:54.251279+0000","last_fullsized":"2024-05-15T14:47:54.251279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:31.046554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514146+0000","last_change":"2024-05-15T14:31:16.594407+0000","last_active":"2024-05-15T14:45:47.514146+0000","last_peered":"2024-05-15T14:45:47.514146+0000","last_clean":"2024-05-15T14:45:47.514146+0000","last_became_active":"2024-05-15T14:31:16.594144+0000","last_became_peered":"2024-05-15T14:31:16.594144+0000","last_unstale":"2024-05-15T14:45:47.514146+0000","last_undegraded":"2024-05-15T14:45:47.514146+0000","last_fullsized":"2024-05-15T14:45:47.514146+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:01:05.887839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"39'56","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288903+0000","last_change":"2024-05-15T14:27:52.854982+0000","last_active":"2024-05-15T14:47:54.288903+0000","last_peered":"2024-05-15T14:47:54.288903+0000","last_clean":"2024-05-15T14:47:54.288903+0000","last_became_active":"2024-05-15T14:27:52.854517+0000","last_became_peered":"2024-05-15T14:27:52.854517+0000","last_unstale":"2024-05-15T14:47:54.288903+0000","last_undegraded":"2024-05-15T14:47:54.288903+0000","last_fullsized":"2024-05-15T14:47:54.288903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:03.135228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":183,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408040+0000","last_change":"2024-05-15T14:27:50.840481+0000","last_active":"2024-05-15T14:45:22.408040+0000","last_peered":"2024-05-15T14:45:22.408040+0000","last_clean":"2024-05-15T14:45:22.408040+0000","last_became_active":"2024-05-15T14:27:50.839960+0000","last_became_peered":"2024-05-15T14:27:50.839960+0000","last_unstale":"2024-05-15T14:45:22.408040+0000","last_undegraded":"2024-05-15T14:45:22.408040+0000","last_fullsized":"2024-05-15T14:45:22.408040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:50.553074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.588072+0000","last_change":"2024-05-15T14:27:56.883585+0000","last_active":"2024-05-15T14:47:21.588072+0000","last_peered":"2024-05-15T14:47:21.588072+0000","last_clean":"2024-05-15T14:47:21.588072+0000","last_became_active":"2024-05-15T14:27:56.883267+0000","last_became_peered":"2024-05-15T14:27:56.883267+0000","last_unstale":"2024-05-15T14:47:21.588072+0000","last_undegraded":"2024-05-15T14:47:21.588072+0000","last_fullsized":"2024-05-15T14:47:21.588072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"39'216","reported_seq":413,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.080784+0000","last_change":"2024-05-15T14:27:58.882536+0000","last_active":"2024-05-15T14:48:26.080784+0000","last_peered":"2024-05-15T14:48:26.080784+0000","last_clean":"2024-05-15T14:48:26.080784+0000","last_became_active":"2024-05-15T14:27:58.882239+0000","last_became_peered":"2024-05-15T14:27:58.882239+0000","last_unstale":"2024-05-15T14:48:26.080784+0000","last_undegraded":"2024-05-15T14:48:26.080784+0000","last_fullsized":"2024-05-15T14:48:26.080784+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:44.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":340,"num_read_kb":332,"num_write":192,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:02.405124+0000","last_change":"2024-05-15T14:28:00.887245+0000","last_active":"2024-05-15T14:45:02.405124+0000","last_peered":"2024-05-15T14:45:02.405124+0000","last_clean":"2024-05-15T14:45:02.405124+0000","last_became_active":"2024-05-15T14:28:00.886898+0000","last_became_peered":"2024-05-15T14:28:00.886898+0000","last_unstale":"2024-05-15T14:45:02.405124+0000","last_undegraded":"2024-05-15T14:45:02.405124+0000","last_fullsized":"2024-05-15T14:45:02.405124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:11.178263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"39'12","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.428797+0000","last_change":"2024-05-15T14:28:02.890898+0000","last_active":"2024-05-15T14:47:52.428797+0000","last_peered":"2024-05-15T14:47:52.428797+0000","last_clean":"2024-05-15T14:47:52.428797+0000","last_became_active":"2024-05-15T14:28:02.890595+0000","last_became_peered":"2024-05-15T14:28:02.890595+0000","last_unstale":"2024-05-15T14:47:52.428797+0000","last_undegraded":"2024-05-15T14:47:52.428797+0000","last_fullsized":"2024-05-15T14:47:52.428797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:15:31.656577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.411631+0000","last_change":"2024-05-15T14:31:16.597622+0000","last_active":"2024-05-15T14:45:22.411631+0000","last_peered":"2024-05-15T14:45:22.411631+0000","last_clean":"2024-05-15T14:45:22.411631+0000","last_became_active":"2024-05-15T14:31:16.597207+0000","last_became_peered":"2024-05-15T14:31:16.597207+0000","last_unstale":"2024-05-15T14:45:22.411631+0000","last_undegraded":"2024-05-15T14:45:22.411631+0000","last_fullsized":"2024-05-15T14:45:22.411631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:03:58.603941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"39'94","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288855+0000","last_change":"2024-05-15T14:27:52.852789+0000","last_active":"2024-05-15T14:47:54.288855+0000","last_peered":"2024-05-15T14:47:54.288855+0000","last_clean":"2024-05-15T14:47:54.288855+0000","last_became_active":"2024-05-15T14:27:52.852536+0000","last_became_peered":"2024-05-15T14:27:52.852536+0000","last_unstale":"2024-05-15T14:47:54.288855+0000","last_undegraded":"2024-05-15T14:47:54.288855+0000","last_fullsized":"2024-05-15T14:47:54.288855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":296,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"39'22","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518672+0000","last_change":"2024-05-15T14:27:50.848136+0000","last_active":"2024-05-15T14:45:52.518672+0000","last_peered":"2024-05-15T14:45:52.518672+0000","last_clean":"2024-05-15T14:45:52.518672+0000","last_became_active":"2024-05-15T14:27:50.847850+0000","last_became_peered":"2024-05-15T14:27:50.847850+0000","last_unstale":"2024-05-15T14:45:52.518672+0000","last_undegraded":"2024-05-15T14:45:52.518672+0000","last_fullsized":"2024-05-15T14:45:52.518672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":44,"num_write":110,"num_write_kb":26471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"32'3","reported_seq":1305,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.920310+0000","last_change":"2024-05-15T14:27:56.879855+0000","last_active":"2024-05-15T14:48:25.920310+0000","last_peered":"2024-05-15T14:48:25.920310+0000","last_clean":"2024-05-15T14:48:25.920310+0000","last_became_active":"2024-05-15T14:27:56.879092+0000","last_became_peered":"2024-05-15T14:27:56.879092+0000","last_unstale":"2024-05-15T14:48:25.920310+0000","last_undegraded":"2024-05-15T14:48:25.920310+0000","last_fullsized":"2024-05-15T14:48:25.920310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1591,"num_read_kb":1589,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'230","reported_seq":386,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.051621+0000","last_change":"2024-05-15T14:27:58.883107+0000","last_active":"2024-05-15T14:48:26.051621+0000","last_peered":"2024-05-15T14:48:26.051621+0000","last_clean":"2024-05-15T14:48:26.051621+0000","last_became_active":"2024-05-15T14:27:58.882703+0000","last_became_peered":"2024-05-15T14:27:58.882703+0000","last_unstale":"2024-05-15T14:48:26.051621+0000","last_undegraded":"2024-05-15T14:48:26.051621+0000","last_fullsized":"2024-05-15T14:48:26.051621+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:03.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":436,"num_read_kb":463,"num_write":435,"num_write_kb":1979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.409428+0000","last_change":"2024-05-15T14:28:00.884804+0000","last_active":"2024-05-15T14:45:32.409428+0000","last_peered":"2024-05-15T14:45:32.409428+0000","last_clean":"2024-05-15T14:45:32.409428+0000","last_became_active":"2024-05-15T14:28:00.884499+0000","last_became_peered":"2024-05-15T14:28:00.884499+0000","last_unstale":"2024-05-15T14:45:32.409428+0000","last_undegraded":"2024-05-15T14:45:32.409428+0000","last_fullsized":"2024-05-15T14:45:32.409428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:22:45.934449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"39'18","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.258684+0000","last_change":"2024-05-15T14:28:02.896315+0000","last_active":"2024-05-15T14:46:21.258684+0000","last_peered":"2024-05-15T14:46:21.258684+0000","last_clean":"2024-05-15T14:46:21.258684+0000","last_became_active":"2024-05-15T14:28:02.895999+0000","last_became_peered":"2024-05-15T14:28:02.895999+0000","last_unstale":"2024-05-15T14:46:21.258684+0000","last_undegraded":"2024-05-15T14:46:21.258684+0000","last_fullsized":"2024-05-15T14:46:21.258684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:38.432473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514109+0000","last_change":"2024-05-15T14:31:16.593403+0000","last_active":"2024-05-15T14:45:47.514109+0000","last_peered":"2024-05-15T14:45:47.514109+0000","last_clean":"2024-05-15T14:45:47.514109+0000","last_became_active":"2024-05-15T14:31:16.593126+0000","last_became_peered":"2024-05-15T14:31:16.593126+0000","last_unstale":"2024-05-15T14:45:47.514109+0000","last_undegraded":"2024-05-15T14:45:47.514109+0000","last_fullsized":"2024-05-15T14:45:47.514109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:32.457272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404758+0000","last_change":"2024-05-15T14:27:52.844385+0000","last_active":"2024-05-15T14:44:47.404758+0000","last_peered":"2024-05-15T14:44:47.404758+0000","last_clean":"2024-05-15T14:44:47.404758+0000","last_became_active":"2024-05-15T14:27:52.844112+0000","last_became_peered":"2024-05-15T14:27:52.844112+0000","last_unstale":"2024-05-15T14:44:47.404758+0000","last_undegraded":"2024-05-15T14:44:47.404758+0000","last_fullsized":"2024-05-15T14:44:47.404758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"39'20","reported_seq":98,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422176+0000","last_change":"2024-05-15T14:27:50.844543+0000","last_active":"2024-05-15T14:46:37.422176+0000","last_peered":"2024-05-15T14:46:37.422176+0000","last_clean":"2024-05-15T14:46:37.422176+0000","last_became_active":"2024-05-15T14:27:50.843701+0000","last_became_peered":"2024-05-15T14:27:50.843701+0000","last_unstale":"2024-05-15T14:46:37.422176+0000","last_undegraded":"2024-05-15T14:46:37.422176+0000","last_fullsized":"2024-05-15T14:46:37.422176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":100,"num_write_kb":23517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.408964+0000","last_change":"2024-05-15T14:27:56.883840+0000","last_active":"2024-05-15T14:44:57.408964+0000","last_peered":"2024-05-15T14:44:57.408964+0000","last_clean":"2024-05-15T14:44:57.408964+0000","last_became_active":"2024-05-15T14:27:56.883534+0000","last_became_peered":"2024-05-15T14:27:56.883534+0000","last_unstale":"2024-05-15T14:44:57.408964+0000","last_undegraded":"2024-05-15T14:44:57.408964+0000","last_fullsized":"2024-05-15T14:44:57.408964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:44.326726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"39'319","reported_seq":521,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.060192+0000","last_change":"2024-05-15T14:27:58.886044+0000","last_active":"2024-05-15T14:48:26.060192+0000","last_peered":"2024-05-15T14:48:26.060192+0000","last_clean":"2024-05-15T14:48:26.060192+0000","last_became_active":"2024-05-15T14:27:58.885479+0000","last_became_peered":"2024-05-15T14:27:58.885479+0000","last_unstale":"2024-05-15T14:48:26.060192+0000","last_undegraded":"2024-05-15T14:48:26.060192+0000","last_fullsized":"2024-05-15T14:48:26.060192+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:42.051812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":600,"num_write":516,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.414924+0000","last_change":"2024-05-15T14:28:00.885531+0000","last_active":"2024-05-15T14:45:32.414924+0000","last_peered":"2024-05-15T14:45:32.414924+0000","last_clean":"2024-05-15T14:45:32.414924+0000","last_became_active":"2024-05-15T14:28:00.885171+0000","last_became_peered":"2024-05-15T14:28:00.885171+0000","last_unstale":"2024-05-15T14:45:32.414924+0000","last_undegraded":"2024-05-15T14:45:32.414924+0000","last_fullsized":"2024-05-15T14:45:32.414924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:03.551642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'26","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418188+0000","last_change":"2024-05-15T14:28:02.888549+0000","last_active":"2024-05-15T14:46:47.418188+0000","last_peered":"2024-05-15T14:46:47.418188+0000","last_clean":"2024-05-15T14:46:47.418188+0000","last_became_active":"2024-05-15T14:28:02.888247+0000","last_became_peered":"2024-05-15T14:28:02.888247+0000","last_unstale":"2024-05-15T14:46:47.418188+0000","last_undegraded":"2024-05-15T14:46:47.418188+0000","last_fullsized":"2024-05-15T14:46:47.418188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":30,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"39'16","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410536+0000","last_change":"2024-05-15T14:27:52.844877+0000","last_active":"2024-05-15T14:45:12.410536+0000","last_peered":"2024-05-15T14:45:12.410536+0000","last_clean":"2024-05-15T14:45:12.410536+0000","last_became_active":"2024-05-15T14:27:52.844292+0000","last_became_peered":"2024-05-15T14:27:52.844292+0000","last_unstale":"2024-05-15T14:45:12.410536+0000","last_undegraded":"2024-05-15T14:45:12.410536+0000","last_fullsized":"2024-05-15T14:45:12.410536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:16.074039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"39'20","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.028581+0000","last_change":"2024-05-15T14:27:50.853660+0000","last_active":"2024-05-15T14:48:26.028581+0000","last_peered":"2024-05-15T14:48:26.028581+0000","last_clean":"2024-05-15T14:48:26.028581+0000","last_became_active":"2024-05-15T14:27:50.853042+0000","last_became_peered":"2024-05-15T14:27:50.853042+0000","last_unstale":"2024-05-15T14:48:26.028581+0000","last_undegraded":"2024-05-15T14:48:26.028581+0000","last_fullsized":"2024-05-15T14:48:26.028581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:39:59.963824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":35,"num_write":92,"num_write_kb":30554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"39'20","reported_seq":112,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304259+0000","last_change":"2024-05-15T14:27:52.842491+0000","last_active":"2024-05-15T14:47:54.304259+0000","last_peered":"2024-05-15T14:47:54.304259+0000","last_clean":"2024-05-15T14:47:54.304259+0000","last_became_active":"2024-05-15T14:27:52.840716+0000","last_became_peered":"2024-05-15T14:27:52.840716+0000","last_unstale":"2024-05-15T14:47:54.304259+0000","last_undegraded":"2024-05-15T14:47:54.304259+0000","last_fullsized":"2024-05-15T14:47:54.304259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:20.425917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"39'16","reported_seq":98,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509652+0000","last_change":"2024-05-15T14:28:38.451032+0000","last_active":"2024-05-15T14:46:37.509652+0000","last_peered":"2024-05-15T14:46:37.509652+0000","last_clean":"2024-05-15T14:46:37.509652+0000","last_became_active":"2024-05-15T14:28:38.450578+0000","last_became_peered":"2024-05-15T14:28:38.450578+0000","last_unstale":"2024-05-15T14:46:37.509652+0000","last_undegraded":"2024-05-15T14:46:37.509652+0000","last_fullsized":"2024-05-15T14:46:37.509652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:19.965962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"39'26","reported_seq":110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.385094+0000","last_change":"2024-05-15T14:27:52.841680+0000","last_active":"2024-05-15T14:46:21.385094+0000","last_peered":"2024-05-15T14:46:21.385094+0000","last_clean":"2024-05-15T14:46:21.385094+0000","last_became_active":"2024-05-15T14:27:52.841192+0000","last_became_peered":"2024-05-15T14:27:52.841192+0000","last_unstale":"2024-05-15T14:46:21.385094+0000","last_undegraded":"2024-05-15T14:46:21.385094+0000","last_fullsized":"2024-05-15T14:46:21.385094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":93,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"39'18","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416631+0000","last_change":"2024-05-15T14:28:38.450889+0000","last_active":"2024-05-15T14:46:37.416631+0000","last_peered":"2024-05-15T14:46:37.416631+0000","last_clean":"2024-05-15T14:46:37.416631+0000","last_became_active":"2024-05-15T14:28:38.450592+0000","last_became_peered":"2024-05-15T14:28:38.450592+0000","last_unstale":"2024-05-15T14:46:37.416631+0000","last_undegraded":"2024-05-15T14:46:37.416631+0000","last_fullsized":"2024-05-15T14:46:37.416631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:32.536677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"39'72","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.411796+0000","last_change":"2024-05-15T14:28:37.941694+0000","last_active":"2024-05-15T14:45:57.411796+0000","last_peered":"2024-05-15T14:45:57.411796+0000","last_clean":"2024-05-15T14:45:57.411796+0000","last_became_active":"2024-05-15T14:28:37.941389+0000","last_became_peered":"2024-05-15T14:28:37.941389+0000","last_unstale":"2024-05-15T14:45:57.411796+0000","last_undegraded":"2024-05-15T14:45:57.411796+0000","last_fullsized":"2024-05-15T14:45:57.411796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:12.821111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":236,"num_write":102,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.028033+0000","last_change":"2024-05-15T14:27:50.849038+0000","last_active":"2024-05-15T14:48:26.028033+0000","last_peered":"2024-05-15T14:48:26.028033+0000","last_clean":"2024-05-15T14:48:26.028033+0000","last_became_active":"2024-05-15T14:27:50.848763+0000","last_became_peered":"2024-05-15T14:27:50.848763+0000","last_unstale":"2024-05-15T14:48:26.028033+0000","last_undegraded":"2024-05-15T14:48:26.028033+0000","last_fullsized":"2024-05-15T14:48:26.028033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:50.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":82,"num_write_kb":24675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"39'82","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327631+0000","last_change":"2024-05-15T14:27:52.853939+0000","last_active":"2024-05-15T14:47:54.327631+0000","last_peered":"2024-05-15T14:47:54.327631+0000","last_clean":"2024-05-15T14:47:54.327631+0000","last_became_active":"2024-05-15T14:27:52.851068+0000","last_became_peered":"2024-05-15T14:27:52.851068+0000","last_unstale":"2024-05-15T14:47:54.327631+0000","last_undegraded":"2024-05-15T14:47:54.327631+0000","last_fullsized":"2024-05-15T14:47:54.327631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":322,"num_read_kb":258,"num_write":116,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512532+0000","last_change":"2024-05-15T14:27:50.847365+0000","last_active":"2024-05-15T14:45:12.512532+0000","last_peered":"2024-05-15T14:45:12.512532+0000","last_clean":"2024-05-15T14:45:12.512532+0000","last_became_active":"2024-05-15T14:27:50.847042+0000","last_became_peered":"2024-05-15T14:27:50.847042+0000","last_unstale":"2024-05-15T14:45:12.512532+0000","last_undegraded":"2024-05-15T14:45:12.512532+0000","last_fullsized":"2024-05-15T14:45:12.512532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'66","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327563+0000","last_change":"2024-05-15T14:27:52.847215+0000","last_active":"2024-05-15T14:47:54.327563+0000","last_peered":"2024-05-15T14:47:54.327563+0000","last_clean":"2024-05-15T14:47:54.327563+0000","last_became_active":"2024-05-15T14:27:52.846918+0000","last_became_peered":"2024-05-15T14:27:52.846918+0000","last_unstale":"2024-05-15T14:47:54.327563+0000","last_undegraded":"2024-05-15T14:47:54.327563+0000","last_fullsized":"2024-05-15T14:47:54.327563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":226,"num_write":90,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410488+0000","last_change":"2024-05-15T14:27:50.850495+0000","last_active":"2024-05-15T14:45:12.410488+0000","last_peered":"2024-05-15T14:45:12.410488+0000","last_clean":"2024-05-15T14:45:12.410488+0000","last_became_active":"2024-05-15T14:27:50.849910+0000","last_became_peered":"2024-05-15T14:27:50.849910+0000","last_unstale":"2024-05-15T14:45:12.410488+0000","last_undegraded":"2024-05-15T14:45:12.410488+0000","last_fullsized":"2024-05-15T14:45:12.410488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.524589+0000","last_change":"2024-05-15T14:27:52.862477+0000","last_active":"2024-05-15T14:46:37.524589+0000","last_peered":"2024-05-15T14:46:37.524589+0000","last_clean":"2024-05-15T14:46:37.524589+0000","last_became_active":"2024-05-15T14:27:52.862227+0000","last_became_peered":"2024-05-15T14:27:52.862227+0000","last_unstale":"2024-05-15T14:46:37.524589+0000","last_undegraded":"2024-05-15T14:46:37.524589+0000","last_fullsized":"2024-05-15T14:46:37.524589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"39'14","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.406550+0000","last_change":"2024-05-15T14:28:37.942575+0000","last_active":"2024-05-15T14:45:12.406550+0000","last_peered":"2024-05-15T14:45:12.406550+0000","last_clean":"2024-05-15T14:45:12.406550+0000","last_became_active":"2024-05-15T14:28:37.942198+0000","last_became_peered":"2024-05-15T14:28:37.942198+0000","last_unstale":"2024-05-15T14:45:12.406550+0000","last_undegraded":"2024-05-15T14:45:12.406550+0000","last_fullsized":"2024-05-15T14:45:12.406550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:26:58.883367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416154+0000","last_change":"2024-05-15T14:27:52.841198+0000","last_active":"2024-05-15T14:46:37.416154+0000","last_peered":"2024-05-15T14:46:37.416154+0000","last_clean":"2024-05-15T14:46:37.416154+0000","last_became_active":"2024-05-15T14:27:52.840941+0000","last_became_peered":"2024-05-15T14:27:52.840941+0000","last_unstale":"2024-05-15T14:46:37.416154+0000","last_undegraded":"2024-05-15T14:46:37.416154+0000","last_fullsized":"2024-05-15T14:46:37.416154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:17.311449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512566+0000","last_change":"2024-05-15T14:27:50.849503+0000","last_active":"2024-05-15T14:45:12.512566+0000","last_peered":"2024-05-15T14:45:12.512566+0000","last_clean":"2024-05-15T14:45:12.512566+0000","last_became_active":"2024-05-15T14:27:50.847998+0000","last_became_peered":"2024-05-15T14:27:50.847998+0000","last_unstale":"2024-05-15T14:45:12.512566+0000","last_undegraded":"2024-05-15T14:45:12.512566+0000","last_fullsized":"2024-05-15T14:45:12.512566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:50.553074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"39'8","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.421601+0000","last_change":"2024-05-15T14:27:52.853614+0000","last_active":"2024-05-15T14:46:32.421601+0000","last_peered":"2024-05-15T14:46:32.421601+0000","last_clean":"2024-05-15T14:46:32.421601+0000","last_became_active":"2024-05-15T14:27:52.852947+0000","last_became_peered":"2024-05-15T14:27:52.852947+0000","last_unstale":"2024-05-15T14:46:32.421601+0000","last_undegraded":"2024-05-15T14:46:32.421601+0000","last_fullsized":"2024-05-15T14:46:32.421601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:27.422621+0000","last_change":"2024-05-15T14:27:50.856154+0000","last_active":"2024-05-15T14:47:27.422621+0000","last_peered":"2024-05-15T14:47:27.422621+0000","last_clean":"2024-05-15T14:47:27.422621+0000","last_became_active":"2024-05-15T14:27:50.855927+0000","last_became_peered":"2024-05-15T14:27:50.855927+0000","last_unstale":"2024-05-15T14:47:27.422621+0000","last_undegraded":"2024-05-15T14:47:27.422621+0000","last_fullsized":"2024-05-15T14:47:27.422621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:14.556752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24,"num_write":62,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"39'24","reported_seq":110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416239+0000","last_change":"2024-05-15T14:27:52.854135+0000","last_active":"2024-05-15T14:46:32.416239+0000","last_peered":"2024-05-15T14:46:32.416239+0000","last_clean":"2024-05-15T14:46:32.416239+0000","last_became_active":"2024-05-15T14:27:52.853857+0000","last_became_peered":"2024-05-15T14:27:52.853857+0000","last_unstale":"2024-05-15T14:46:32.416239+0000","last_undegraded":"2024-05-15T14:46:32.416239+0000","last_fullsized":"2024-05-15T14:46:32.416239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":91,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"39'18","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518609+0000","last_change":"2024-05-15T14:27:50.844170+0000","last_active":"2024-05-15T14:45:52.518609+0000","last_peered":"2024-05-15T14:45:52.518609+0000","last_clean":"2024-05-15T14:45:52.518609+0000","last_became_active":"2024-05-15T14:27:50.843874+0000","last_became_peered":"2024-05-15T14:27:50.843874+0000","last_unstale":"2024-05-15T14:45:52.518609+0000","last_undegraded":"2024-05-15T14:45:52.518609+0000","last_fullsized":"2024-05-15T14:45:52.518609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:48.618636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"39'58","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.504998+0000","last_change":"2024-05-15T14:27:52.847675+0000","last_active":"2024-05-15T14:45:52.504998+0000","last_peered":"2024-05-15T14:45:52.504998+0000","last_clean":"2024-05-15T14:45:52.504998+0000","last_became_active":"2024-05-15T14:27:52.847362+0000","last_became_peered":"2024-05-15T14:27:52.847362+0000","last_unstale":"2024-05-15T14:45:52.504998+0000","last_undegraded":"2024-05-15T14:45:52.504998+0000","last_fullsized":"2024-05-15T14:45:52.504998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:06:52.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":172,"num_write":84,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411173+0000","last_change":"2024-05-15T14:27:50.846611+0000","last_active":"2024-05-15T14:45:52.411173+0000","last_peered":"2024-05-15T14:45:52.411173+0000","last_clean":"2024-05-15T14:45:52.411173+0000","last_became_active":"2024-05-15T14:27:50.846291+0000","last_became_peered":"2024-05-15T14:27:50.846291+0000","last_unstale":"2024-05-15T14:45:52.411173+0000","last_undegraded":"2024-05-15T14:45:52.411173+0000","last_fullsized":"2024-05-15T14:45:52.411173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:01.126044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":14702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"39'74","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327403+0000","last_change":"2024-05-15T14:27:52.848460+0000","last_active":"2024-05-15T14:47:54.327403+0000","last_peered":"2024-05-15T14:47:54.327403+0000","last_clean":"2024-05-15T14:47:54.327403+0000","last_became_active":"2024-05-15T14:27:52.848173+0000","last_became_peered":"2024-05-15T14:27:52.848173+0000","last_unstale":"2024-05-15T14:47:54.327403+0000","last_undegraded":"2024-05-15T14:47:54.327403+0000","last_fullsized":"2024-05-15T14:47:54.327403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":248,"num_write":102,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.417142+0000","last_change":"2024-05-15T14:27:50.847115+0000","last_active":"2024-05-15T14:45:52.417142+0000","last_peered":"2024-05-15T14:45:52.417142+0000","last_clean":"2024-05-15T14:45:52.417142+0000","last_became_active":"2024-05-15T14:27:50.846782+0000","last_became_peered":"2024-05-15T14:27:50.846782+0000","last_unstale":"2024-05-15T14:45:52.417142+0000","last_undegraded":"2024-05-15T14:45:52.417142+0000","last_fullsized":"2024-05-15T14:45:52.417142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"39'30","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840678+0000","last_change":"2024-05-15T14:27:52.851930+0000","last_active":"2024-05-15T14:47:53.840678+0000","last_peered":"2024-05-15T14:47:53.840678+0000","last_clean":"2024-05-15T14:47:53.840678+0000","last_became_active":"2024-05-15T14:27:52.851642+0000","last_became_peered":"2024-05-15T14:27:52.851642+0000","last_unstale":"2024-05-15T14:47:53.840678+0000","last_undegraded":"2024-05-15T14:47:53.840678+0000","last_fullsized":"2024-05-15T14:47:53.840678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":127,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.410649+0000","last_change":"2024-05-15T14:27:50.840821+0000","last_active":"2024-05-15T14:45:52.410649+0000","last_peered":"2024-05-15T14:45:52.410649+0000","last_clean":"2024-05-15T14:45:52.410649+0000","last_became_active":"2024-05-15T14:27:50.840467+0000","last_became_peered":"2024-05-15T14:27:50.840467+0000","last_unstale":"2024-05-15T14:45:52.410649+0000","last_undegraded":"2024-05-15T14:45:52.410649+0000","last_fullsized":"2024-05-15T14:45:52.410649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:07:30.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"39'92","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328290+0000","last_change":"2024-05-15T14:27:52.860211+0000","last_active":"2024-05-15T14:47:54.328290+0000","last_peered":"2024-05-15T14:47:54.328290+0000","last_clean":"2024-05-15T14:47:54.328290+0000","last_became_active":"2024-05-15T14:27:52.859926+0000","last_became_peered":"2024-05-15T14:27:52.859926+0000","last_unstale":"2024-05-15T14:47:54.328290+0000","last_undegraded":"2024-05-15T14:47:54.328290+0000","last_fullsized":"2024-05-15T14:47:54.328290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":270,"num_write":132,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"39'24","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.532445+0000","last_change":"2024-05-15T14:27:50.850215+0000","last_active":"2024-05-15T14:48:07.532445+0000","last_peered":"2024-05-15T14:48:07.532445+0000","last_clean":"2024-05-15T14:48:07.532445+0000","last_became_active":"2024-05-15T14:27:50.849936+0000","last_became_peered":"2024-05-15T14:27:50.849936+0000","last_unstale":"2024-05-15T14:48:07.532445+0000","last_undegraded":"2024-05-15T14:48:07.532445+0000","last_fullsized":"2024-05-15T14:48:07.532445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:18.416733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":112,"num_write_kb":36442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"39'62","reported_seq":162,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518575+0000","last_change":"2024-05-15T14:27:52.857096+0000","last_active":"2024-05-15T14:45:52.518575+0000","last_peered":"2024-05-15T14:45:52.518575+0000","last_clean":"2024-05-15T14:45:52.518575+0000","last_became_active":"2024-05-15T14:27:52.856767+0000","last_became_peered":"2024-05-15T14:27:52.856767+0000","last_unstale":"2024-05-15T14:45:52.518575+0000","last_undegraded":"2024-05-15T14:45:52.518575+0000","last_fullsized":"2024-05-15T14:45:52.518575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":205,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"39'18","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.509004+0000","last_change":"2024-05-15T14:27:50.842853+0000","last_active":"2024-05-15T14:46:32.509004+0000","last_peered":"2024-05-15T14:46:32.509004+0000","last_clean":"2024-05-15T14:46:32.509004+0000","last_became_active":"2024-05-15T14:27:50.842512+0000","last_became_peered":"2024-05-15T14:27:50.842512+0000","last_unstale":"2024-05-15T14:46:32.509004+0000","last_undegraded":"2024-05-15T14:46:32.509004+0000","last_fullsized":"2024-05-15T14:46:32.509004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:21.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"39'56","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304223+0000","last_change":"2024-05-15T14:27:52.855227+0000","last_active":"2024-05-15T14:47:54.304223+0000","last_peered":"2024-05-15T14:47:54.304223+0000","last_clean":"2024-05-15T14:47:54.304223+0000","last_became_active":"2024-05-15T14:27:52.854841+0000","last_became_peered":"2024-05-15T14:27:52.854841+0000","last_unstale":"2024-05-15T14:47:54.304223+0000","last_undegraded":"2024-05-15T14:47:54.304223+0000","last_fullsized":"2024-05-15T14:47:54.304223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":78,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"39'20","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416132+0000","last_change":"2024-05-15T14:27:50.848570+0000","last_active":"2024-05-15T14:46:32.416132+0000","last_peered":"2024-05-15T14:46:32.416132+0000","last_clean":"2024-05-15T14:46:32.416132+0000","last_became_active":"2024-05-15T14:27:50.848291+0000","last_became_peered":"2024-05-15T14:27:50.848291+0000","last_unstale":"2024-05-15T14:46:32.416132+0000","last_undegraded":"2024-05-15T14:46:32.416132+0000","last_fullsized":"2024-05-15T14:46:32.416132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":40,"num_write":100,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416004+0000","last_change":"2024-05-15T14:27:50.842699+0000","last_active":"2024-05-15T14:46:32.416004+0000","last_peered":"2024-05-15T14:46:32.416004+0000","last_clean":"2024-05-15T14:46:32.416004+0000","last_became_active":"2024-05-15T14:27:50.842420+0000","last_became_peered":"2024-05-15T14:27:50.842420+0000","last_unstale":"2024-05-15T14:46:32.416004+0000","last_undegraded":"2024-05-15T14:46:32.416004+0000","last_fullsized":"2024-05-15T14:46:32.416004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":90,"num_write_kb":20587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304330+0000","last_change":"2024-05-15T14:27:52.853871+0000","last_active":"2024-05-15T14:47:54.304330+0000","last_peered":"2024-05-15T14:47:54.304330+0000","last_clean":"2024-05-15T14:47:54.304330+0000","last_became_active":"2024-05-15T14:27:52.853329+0000","last_became_peered":"2024-05-15T14:27:52.853329+0000","last_unstale":"2024-05-15T14:47:54.304330+0000","last_undegraded":"2024-05-15T14:47:54.304330+0000","last_fullsized":"2024-05-15T14:47:54.304330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:03.135228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420349+0000","last_change":"2024-05-15T14:27:50.839786+0000","last_active":"2024-05-15T14:46:32.420349+0000","last_peered":"2024-05-15T14:46:32.420349+0000","last_clean":"2024-05-15T14:46:32.420349+0000","last_became_active":"2024-05-15T14:27:50.839496+0000","last_became_peered":"2024-05-15T14:27:50.839496+0000","last_unstale":"2024-05-15T14:46:32.420349+0000","last_undegraded":"2024-05-15T14:46:32.420349+0000","last_fullsized":"2024-05-15T14:46:32.420349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:53.186276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":17647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"39'70","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304247+0000","last_change":"2024-05-15T14:27:52.852295+0000","last_active":"2024-05-15T14:47:54.304247+0000","last_peered":"2024-05-15T14:47:54.304247+0000","last_clean":"2024-05-15T14:47:54.304247+0000","last_became_active":"2024-05-15T14:27:52.851973+0000","last_became_peered":"2024-05-15T14:27:52.851973+0000","last_unstale":"2024-05-15T14:47:54.304247+0000","last_undegraded":"2024-05-15T14:47:54.304247+0000","last_fullsized":"2024-05-15T14:47:54.304247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":234,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3423,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1381,"num_read_kb":1449,"num_write":1045,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":6846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":830,"ondisk_log_size":830,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11724,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":2162624,"num_read_kb":7062025,"num_write":12227,"num_write_kb":15784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1856,"ondisk_log_size":1856,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":14929,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5654,"num_read_kb":6894,"num_write":192,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":29858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9598,"num_read_kb":7988,"num_write":3212,"num_write_kb":1308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2246,"ondisk_log_size":2246,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2611,"num_read_kb":1724,"num_write":4445,"num_write_kb":1235021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575104,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335408,"statfs":{"total":96636764160,"available":96599457792,"internally_reserved":0,"allocated":1118208,"data_stored":815108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575105,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":487424,"data_stored":221551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575104,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44184,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327656,"statfs":{"total":96636764160,"available":96591519744,"internally_reserved":0,"allocated":536576,"data_stored":225223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575105,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":227462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575105,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":532480,"data_stored":222205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575105,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":491520,"data_stored":224011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575105,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":222247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575106,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1118208,"data_stored":816897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":68,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:48:57.849 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T14:48:57.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:48:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:48:58.209 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:48:58.211 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":669,"stamp":"2024-05-15T14:48:56.769703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620444,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":2181945,"num_read_kb":7080143,"num_write":21230,"num_write_kb":1254163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6230,"ondisk_log_size":6230,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275416,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699304,"statfs":{"total":773094113280,"available":772812087296,"internally_reserved":0,"allocated":5316608,"data_stored":2974704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003758"},"pg_stats":[{"pgid":"3.3f","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.520606+0000","last_change":"2024-05-15T14:27:50.850244+0000","last_active":"2024-05-15T14:46:37.520606+0000","last_peered":"2024-05-15T14:46:37.520606+0000","last_clean":"2024-05-15T14:46:37.520606+0000","last_became_active":"2024-05-15T14:27:50.849951+0000","last_became_peered":"2024-05-15T14:27:50.849951+0000","last_unstale":"2024-05-15T14:46:37.520606+0000","last_undegraded":"2024-05-15T14:46:37.520606+0000","last_fullsized":"2024-05-15T14:46:37.520606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'2","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.860511+0000","last_change":"2024-05-15T14:27:52.844115+0000","last_active":"2024-05-15T14:47:53.860511+0000","last_peered":"2024-05-15T14:47:53.860511+0000","last_clean":"2024-05-15T14:47:53.860511+0000","last_became_active":"2024-05-15T14:27:52.843836+0000","last_became_peered":"2024-05-15T14:27:52.843836+0000","last_unstale":"2024-05-15T14:47:53.860511+0000","last_undegraded":"2024-05-15T14:47:53.860511+0000","last_fullsized":"2024-05-15T14:47:53.860511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421276+0000","last_change":"2024-05-15T14:27:50.837638+0000","last_active":"2024-05-15T14:46:37.421276+0000","last_peered":"2024-05-15T14:46:37.421276+0000","last_clean":"2024-05-15T14:46:37.421276+0000","last_became_active":"2024-05-15T14:27:50.837321+0000","last_became_peered":"2024-05-15T14:27:50.837321+0000","last_unstale":"2024-05-15T14:46:37.421276+0000","last_undegraded":"2024-05-15T14:46:37.421276+0000","last_fullsized":"2024-05-15T14:46:37.421276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":50,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"39'10","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304257+0000","last_change":"2024-05-15T14:27:52.841298+0000","last_active":"2024-05-15T14:47:54.304257+0000","last_peered":"2024-05-15T14:47:54.304257+0000","last_clean":"2024-05-15T14:47:54.304257+0000","last_became_active":"2024-05-15T14:27:52.840977+0000","last_became_peered":"2024-05-15T14:27:52.840977+0000","last_unstale":"2024-05-15T14:47:54.304257+0000","last_undegraded":"2024-05-15T14:47:54.304257+0000","last_fullsized":"2024-05-15T14:47:54.304257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"39'8","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422141+0000","last_change":"2024-05-15T14:27:50.846251+0000","last_active":"2024-05-15T14:46:37.422141+0000","last_peered":"2024-05-15T14:46:37.422141+0000","last_clean":"2024-05-15T14:46:37.422141+0000","last_became_active":"2024-05-15T14:27:50.844989+0000","last_became_peered":"2024-05-15T14:27:50.844989+0000","last_unstale":"2024-05-15T14:46:37.422141+0000","last_undegraded":"2024-05-15T14:46:37.422141+0000","last_fullsized":"2024-05-15T14:46:37.422141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'24","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.833658+0000","last_change":"2024-05-15T14:27:52.850744+0000","last_active":"2024-05-15T14:47:53.833658+0000","last_peered":"2024-05-15T14:47:53.833658+0000","last_clean":"2024-05-15T14:47:53.833658+0000","last_became_active":"2024-05-15T14:27:52.850449+0000","last_became_peered":"2024-05-15T14:27:52.850449+0000","last_unstale":"2024-05-15T14:47:53.833658+0000","last_undegraded":"2024-05-15T14:47:53.833658+0000","last_fullsized":"2024-05-15T14:47:53.833658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":101,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"39'22","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.426566+0000","last_change":"2024-05-15T14:27:50.852104+0000","last_active":"2024-05-15T14:47:57.426566+0000","last_peered":"2024-05-15T14:47:57.426566+0000","last_clean":"2024-05-15T14:47:57.426566+0000","last_became_active":"2024-05-15T14:27:50.851846+0000","last_became_peered":"2024-05-15T14:27:50.851846+0000","last_unstale":"2024-05-15T14:47:57.426566+0000","last_undegraded":"2024-05-15T14:47:57.426566+0000","last_fullsized":"2024-05-15T14:47:57.426566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":27630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"39'4","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.806419+0000","last_change":"2024-05-15T14:27:52.854744+0000","last_active":"2024-05-15T14:47:53.806419+0000","last_peered":"2024-05-15T14:47:53.806419+0000","last_clean":"2024-05-15T14:47:53.806419+0000","last_became_active":"2024-05-15T14:27:52.854481+0000","last_became_peered":"2024-05-15T14:27:52.854481+0000","last_unstale":"2024-05-15T14:47:53.806419+0000","last_undegraded":"2024-05-15T14:47:53.806419+0000","last_fullsized":"2024-05-15T14:47:53.806419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"39'8","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.510681+0000","last_change":"2024-05-15T14:27:50.853255+0000","last_active":"2024-05-15T14:45:22.510681+0000","last_peered":"2024-05-15T14:45:22.510681+0000","last_clean":"2024-05-15T14:45:22.510681+0000","last_became_active":"2024-05-15T14:27:50.851756+0000","last_became_peered":"2024-05-15T14:27:50.851756+0000","last_unstale":"2024-05-15T14:45:22.510681+0000","last_undegraded":"2024-05-15T14:45:22.510681+0000","last_fullsized":"2024-05-15T14:45:22.510681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:50.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14,"num_write":40,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"39'8","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.411312+0000","last_change":"2024-05-15T14:27:52.845713+0000","last_active":"2024-05-15T14:45:57.411312+0000","last_peered":"2024-05-15T14:45:57.411312+0000","last_clean":"2024-05-15T14:45:57.411312+0000","last_became_active":"2024-05-15T14:27:52.844904+0000","last_became_peered":"2024-05-15T14:27:52.844904+0000","last_unstale":"2024-05-15T14:45:57.411312+0000","last_undegraded":"2024-05-15T14:45:57.411312+0000","last_fullsized":"2024-05-15T14:45:57.411312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:52.927880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"39'8","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026317+0000","last_change":"2024-05-15T14:27:50.847389+0000","last_active":"2024-05-15T14:48:26.026317+0000","last_peered":"2024-05-15T14:48:26.026317+0000","last_clean":"2024-05-15T14:48:26.026317+0000","last_became_active":"2024-05-15T14:27:50.847121+0000","last_became_peered":"2024-05-15T14:27:50.847121+0000","last_unstale":"2024-05-15T14:48:26.026317+0000","last_undegraded":"2024-05-15T14:48:26.026317+0000","last_fullsized":"2024-05-15T14:48:26.026317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:48.618636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":24,"num_write_kb":14074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'100","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327789+0000","last_change":"2024-05-15T14:27:52.848754+0000","last_active":"2024-05-15T14:47:54.327789+0000","last_peered":"2024-05-15T14:47:54.327789+0000","last_clean":"2024-05-15T14:47:54.327789+0000","last_became_active":"2024-05-15T14:27:52.848482+0000","last_became_peered":"2024-05-15T14:27:52.848482+0000","last_unstale":"2024-05-15T14:47:54.327789+0000","last_undegraded":"2024-05-15T14:47:54.327789+0000","last_fullsized":"2024-05-15T14:47:54.327789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":302,"num_write":142,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"39'10","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.510650+0000","last_change":"2024-05-15T14:27:50.852930+0000","last_active":"2024-05-15T14:45:22.510650+0000","last_peered":"2024-05-15T14:45:22.510650+0000","last_clean":"2024-05-15T14:45:22.510650+0000","last_became_active":"2024-05-15T14:27:50.852659+0000","last_became_peered":"2024-05-15T14:27:50.852659+0000","last_unstale":"2024-05-15T14:45:22.510650+0000","last_undegraded":"2024-05-15T14:45:22.510650+0000","last_fullsized":"2024-05-15T14:45:22.510650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840691+0000","last_change":"2024-05-15T14:27:52.839571+0000","last_active":"2024-05-15T14:47:53.840691+0000","last_peered":"2024-05-15T14:47:53.840691+0000","last_clean":"2024-05-15T14:47:53.840691+0000","last_became_active":"2024-05-15T14:27:52.839017+0000","last_became_peered":"2024-05-15T14:27:52.839017+0000","last_unstale":"2024-05-15T14:47:53.840691+0000","last_undegraded":"2024-05-15T14:47:53.840691+0000","last_fullsized":"2024-05-15T14:47:53.840691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.277374+0000","last_change":"2024-05-15T14:27:50.854894+0000","last_active":"2024-05-15T14:47:54.277374+0000","last_peered":"2024-05-15T14:47:54.277374+0000","last_clean":"2024-05-15T14:47:54.277374+0000","last_became_active":"2024-05-15T14:27:50.854408+0000","last_became_peered":"2024-05-15T14:27:50.854408+0000","last_unstale":"2024-05-15T14:47:54.277374+0000","last_undegraded":"2024-05-15T14:47:54.277374+0000","last_fullsized":"2024-05-15T14:47:54.277374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25,"num_write":70,"num_write_kb":17643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509693+0000","last_change":"2024-05-15T14:27:52.853989+0000","last_active":"2024-05-15T14:46:37.509693+0000","last_peered":"2024-05-15T14:46:37.509693+0000","last_clean":"2024-05-15T14:46:37.509693+0000","last_became_active":"2024-05-15T14:27:52.853688+0000","last_became_peered":"2024-05-15T14:27:52.853688+0000","last_unstale":"2024-05-15T14:46:37.509693+0000","last_undegraded":"2024-05-15T14:46:37.509693+0000","last_fullsized":"2024-05-15T14:46:37.509693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:01.973008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"39'4","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416117+0000","last_change":"2024-05-15T14:27:52.850830+0000","last_active":"2024-05-15T14:46:32.416117+0000","last_peered":"2024-05-15T14:46:32.416117+0000","last_clean":"2024-05-15T14:46:32.416117+0000","last_became_active":"2024-05-15T14:27:52.850532+0000","last_became_peered":"2024-05-15T14:27:52.850532+0000","last_unstale":"2024-05-15T14:46:32.416117+0000","last_undegraded":"2024-05-15T14:46:32.416117+0000","last_fullsized":"2024-05-15T14:46:32.416117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:35.585753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.267909+0000","last_change":"2024-05-15T14:27:50.852471+0000","last_active":"2024-05-15T14:47:54.267909+0000","last_peered":"2024-05-15T14:47:54.267909+0000","last_clean":"2024-05-15T14:47:54.267909+0000","last_became_active":"2024-05-15T14:27:50.852229+0000","last_became_peered":"2024-05-15T14:27:50.852229+0000","last_unstale":"2024-05-15T14:47:54.267909+0000","last_undegraded":"2024-05-15T14:47:54.267909+0000","last_fullsized":"2024-05-15T14:47:54.267909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:31.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"39'34","reported_seq":129,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.865681+0000","last_change":"2024-05-15T14:27:52.858540+0000","last_active":"2024-05-15T14:47:53.865681+0000","last_peered":"2024-05-15T14:47:53.865681+0000","last_clean":"2024-05-15T14:47:53.865681+0000","last_became_active":"2024-05-15T14:27:52.858331+0000","last_became_peered":"2024-05-15T14:27:52.858331+0000","last_unstale":"2024-05-15T14:47:53.865681+0000","last_undegraded":"2024-05-15T14:47:53.865681+0000","last_fullsized":"2024-05-15T14:47:53.865681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":123,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403413+0000","last_change":"2024-05-15T14:27:50.849840+0000","last_active":"2024-05-15T14:44:47.403413+0000","last_peered":"2024-05-15T14:44:47.403413+0000","last_clean":"2024-05-15T14:44:47.403413+0000","last_became_active":"2024-05-15T14:27:50.849526+0000","last_became_peered":"2024-05-15T14:27:50.849526+0000","last_unstale":"2024-05-15T14:44:47.403413+0000","last_undegraded":"2024-05-15T14:44:47.403413+0000","last_fullsized":"2024-05-15T14:44:47.403413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"39'6","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.859181+0000","last_change":"2024-05-15T14:27:52.840106+0000","last_active":"2024-05-15T14:47:53.859181+0000","last_peered":"2024-05-15T14:47:53.859181+0000","last_clean":"2024-05-15T14:47:53.859181+0000","last_became_active":"2024-05-15T14:27:52.838137+0000","last_became_peered":"2024-05-15T14:27:52.838137+0000","last_unstale":"2024-05-15T14:47:53.859181+0000","last_undegraded":"2024-05-15T14:47:53.859181+0000","last_fullsized":"2024-05-15T14:47:53.859181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403404+0000","last_change":"2024-05-15T14:27:50.842514+0000","last_active":"2024-05-15T14:44:47.403404+0000","last_peered":"2024-05-15T14:44:47.403404+0000","last_clean":"2024-05-15T14:44:47.403404+0000","last_became_active":"2024-05-15T14:27:50.842240+0000","last_became_peered":"2024-05-15T14:27:50.842240+0000","last_unstale":"2024-05-15T14:44:47.403404+0000","last_undegraded":"2024-05-15T14:44:47.403404+0000","last_fullsized":"2024-05-15T14:44:47.403404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:45:32.046811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":70,"num_write_kb":11769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"39'44","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.497397+0000","last_change":"2024-05-15T14:27:52.855297+0000","last_active":"2024-05-15T14:44:47.497397+0000","last_peered":"2024-05-15T14:44:47.497397+0000","last_clean":"2024-05-15T14:44:47.497397+0000","last_became_active":"2024-05-15T14:27:52.854742+0000","last_became_peered":"2024-05-15T14:27:52.854742+0000","last_unstale":"2024-05-15T14:44:47.497397+0000","last_undegraded":"2024-05-15T14:44:47.497397+0000","last_fullsized":"2024-05-15T14:44:47.497397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:51:10.843632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":128,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404810+0000","last_change":"2024-05-15T14:27:50.840673+0000","last_active":"2024-05-15T14:44:47.404810+0000","last_peered":"2024-05-15T14:44:47.404810+0000","last_clean":"2024-05-15T14:44:47.404810+0000","last_became_active":"2024-05-15T14:27:50.840405+0000","last_became_peered":"2024-05-15T14:27:50.840405+0000","last_unstale":"2024-05-15T14:44:47.404810+0000","last_undegraded":"2024-05-15T14:44:47.404810+0000","last_fullsized":"2024-05-15T14:44:47.404810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'52","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304178+0000","last_change":"2024-05-15T14:27:52.851060+0000","last_active":"2024-05-15T14:47:54.304178+0000","last_peered":"2024-05-15T14:47:54.304178+0000","last_clean":"2024-05-15T14:47:54.304178+0000","last_became_active":"2024-05-15T14:27:52.850696+0000","last_became_peered":"2024-05-15T14:27:52.850696+0000","last_unstale":"2024-05-15T14:47:54.304178+0000","last_undegraded":"2024-05-15T14:47:54.304178+0000","last_fullsized":"2024-05-15T14:47:54.304178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:06.868623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":72,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.262053+0000","last_change":"2024-05-15T14:27:50.849634+0000","last_active":"2024-05-15T14:47:54.262053+0000","last_peered":"2024-05-15T14:47:54.262053+0000","last_clean":"2024-05-15T14:47:54.262053+0000","last_became_active":"2024-05-15T14:27:50.848542+0000","last_became_peered":"2024-05-15T14:27:50.848542+0000","last_unstale":"2024-05-15T14:47:54.262053+0000","last_undegraded":"2024-05-15T14:47:54.262053+0000","last_fullsized":"2024-05-15T14:47:54.262053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:09.157377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":70,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"39'28","reported_seq":116,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404838+0000","last_change":"2024-05-15T14:27:52.861455+0000","last_active":"2024-05-15T14:44:47.404838+0000","last_peered":"2024-05-15T14:44:47.404838+0000","last_clean":"2024-05-15T14:44:47.404838+0000","last_became_active":"2024-05-15T14:27:52.861166+0000","last_became_peered":"2024-05-15T14:27:52.861166+0000","last_unstale":"2024-05-15T14:44:47.404838+0000","last_undegraded":"2024-05-15T14:44:47.404838+0000","last_fullsized":"2024-05-15T14:44:47.404838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":102,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.406163+0000","last_change":"2024-05-15T14:27:50.837948+0000","last_active":"2024-05-15T14:44:17.406163+0000","last_peered":"2024-05-15T14:44:17.406163+0000","last_clean":"2024-05-15T14:44:17.406163+0000","last_became_active":"2024-05-15T14:27:50.837594+0000","last_became_peered":"2024-05-15T14:27:50.837594+0000","last_unstale":"2024-05-15T14:44:17.406163+0000","last_undegraded":"2024-05-15T14:44:17.406163+0000","last_fullsized":"2024-05-15T14:44:17.406163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.517789+0000","last_change":"2024-05-15T14:31:16.589931+0000","last_active":"2024-05-15T14:45:47.517789+0000","last_peered":"2024-05-15T14:45:47.517789+0000","last_clean":"2024-05-15T14:45:47.517789+0000","last_became_active":"2024-05-15T14:31:16.589649+0000","last_became_peered":"2024-05-15T14:31:16.589649+0000","last_unstale":"2024-05-15T14:45:47.517789+0000","last_undegraded":"2024-05-15T14:45:47.517789+0000","last_fullsized":"2024-05-15T14:45:47.517789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:29:34.232384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"39'24","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.830825+0000","last_change":"2024-05-15T14:28:02.891667+0000","last_active":"2024-05-15T14:47:53.830825+0000","last_peered":"2024-05-15T14:47:53.830825+0000","last_clean":"2024-05-15T14:47:53.830825+0000","last_became_active":"2024-05-15T14:28:02.891340+0000","last_became_peered":"2024-05-15T14:28:02.891340+0000","last_unstale":"2024-05-15T14:47:53.830825+0000","last_undegraded":"2024-05-15T14:47:53.830825+0000","last_fullsized":"2024-05-15T14:47:53.830825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:35.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":38,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"39'78","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328201+0000","last_change":"2024-05-15T14:27:52.863225+0000","last_active":"2024-05-15T14:47:54.328201+0000","last_peered":"2024-05-15T14:47:54.328201+0000","last_clean":"2024-05-15T14:47:54.328201+0000","last_became_active":"2024-05-15T14:27:52.862960+0000","last_became_peered":"2024-05-15T14:27:52.862960+0000","last_unstale":"2024-05-15T14:47:54.328201+0000","last_undegraded":"2024-05-15T14:47:54.328201+0000","last_fullsized":"2024-05-15T14:47:54.328201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":231,"num_write":112,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519858+0000","last_change":"2024-05-15T14:27:50.849295+0000","last_active":"2024-05-15T14:46:32.519858+0000","last_peered":"2024-05-15T14:46:32.519858+0000","last_clean":"2024-05-15T14:46:32.519858+0000","last_became_active":"2024-05-15T14:27:50.849039+0000","last_became_peered":"2024-05-15T14:27:50.849039+0000","last_unstale":"2024-05-15T14:46:32.519858+0000","last_undegraded":"2024-05-15T14:46:32.519858+0000","last_fullsized":"2024-05-15T14:46:32.519858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:14.556752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.403978+0000","last_change":"2024-05-15T14:27:56.876839+0000","last_active":"2024-05-15T14:44:52.403978+0000","last_peered":"2024-05-15T14:44:52.403978+0000","last_clean":"2024-05-15T14:44:52.403978+0000","last_became_active":"2024-05-15T14:27:56.876559+0000","last_became_peered":"2024-05-15T14:27:56.876559+0000","last_unstale":"2024-05-15T14:44:52.403978+0000","last_undegraded":"2024-05-15T14:44:52.403978+0000","last_fullsized":"2024-05-15T14:44:52.403978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"39'264","reported_seq":538,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.030050+0000","last_change":"2024-05-15T14:27:58.884292+0000","last_active":"2024-05-15T14:48:26.030050+0000","last_peered":"2024-05-15T14:48:26.030050+0000","last_clean":"2024-05-15T14:48:26.030050+0000","last_became_active":"2024-05-15T14:27:58.883983+0000","last_became_peered":"2024-05-15T14:27:58.883983+0000","last_unstale":"2024-05-15T14:48:26.030050+0000","last_undegraded":"2024-05-15T14:48:26.030050+0000","last_fullsized":"2024-05-15T14:48:26.030050+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:56.197135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":452,"num_read_kb":554,"num_write":242,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.507472+0000","last_change":"2024-05-15T14:28:00.888232+0000","last_active":"2024-05-15T14:44:57.507472+0000","last_peered":"2024-05-15T14:44:57.507472+0000","last_clean":"2024-05-15T14:44:57.507472+0000","last_became_active":"2024-05-15T14:28:00.887947+0000","last_became_peered":"2024-05-15T14:28:00.887947+0000","last_unstale":"2024-05-15T14:44:57.507472+0000","last_undegraded":"2024-05-15T14:44:57.507472+0000","last_fullsized":"2024-05-15T14:44:57.507472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:52.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.410185+0000","last_change":"2024-05-15T14:31:16.588732+0000","last_active":"2024-05-15T14:45:47.410185+0000","last_peered":"2024-05-15T14:45:47.410185+0000","last_clean":"2024-05-15T14:45:47.410185+0000","last_became_active":"2024-05-15T14:31:16.588437+0000","last_became_peered":"2024-05-15T14:31:16.588437+0000","last_unstale":"2024-05-15T14:45:47.410185+0000","last_undegraded":"2024-05-15T14:45:47.410185+0000","last_fullsized":"2024-05-15T14:45:47.410185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:07:39.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"39'109","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.330362+0000","last_change":"2024-05-15T14:28:02.890784+0000","last_active":"2024-05-15T14:47:54.330362+0000","last_peered":"2024-05-15T14:47:54.330362+0000","last_clean":"2024-05-15T14:47:54.330362+0000","last_became_active":"2024-05-15T14:28:02.890477+0000","last_became_peered":"2024-05-15T14:28:02.890477+0000","last_unstale":"2024-05-15T14:47:54.330362+0000","last_undegraded":"2024-05-15T14:47:54.330362+0000","last_fullsized":"2024-05-15T14:47:54.330362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:18.439604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":241,"num_write":191,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"39'4","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.833264+0000","last_change":"2024-05-15T14:27:52.841464+0000","last_active":"2024-05-15T14:47:53.833264+0000","last_peered":"2024-05-15T14:47:53.833264+0000","last_clean":"2024-05-15T14:47:53.833264+0000","last_became_active":"2024-05-15T14:27:52.840847+0000","last_became_peered":"2024-05-15T14:27:52.840847+0000","last_unstale":"2024-05-15T14:47:53.833264+0000","last_undegraded":"2024-05-15T14:47:53.833264+0000","last_fullsized":"2024-05-15T14:47:53.833264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.024900+0000","last_change":"2024-05-15T14:27:50.846344+0000","last_active":"2024-05-15T14:48:26.024900+0000","last_peered":"2024-05-15T14:48:26.024900+0000","last_clean":"2024-05-15T14:48:26.024900+0000","last_became_active":"2024-05-15T14:27:50.845923+0000","last_became_peered":"2024-05-15T14:27:50.845923+0000","last_unstale":"2024-05-15T14:48:26.024900+0000","last_undegraded":"2024-05-15T14:48:26.024900+0000","last_fullsized":"2024-05-15T14:48:26.024900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:38.935625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32,"num_write":82,"num_write_kb":27622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.505308+0000","last_change":"2024-05-15T14:27:56.876632+0000","last_active":"2024-05-15T14:44:17.505308+0000","last_peered":"2024-05-15T14:44:17.505308+0000","last_clean":"2024-05-15T14:44:17.505308+0000","last_became_active":"2024-05-15T14:27:56.876325+0000","last_became_peered":"2024-05-15T14:27:56.876325+0000","last_unstale":"2024-05-15T14:44:17.505308+0000","last_undegraded":"2024-05-15T14:44:17.505308+0000","last_fullsized":"2024-05-15T14:44:17.505308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"39'141","reported_seq":254,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.677666+0000","last_change":"2024-05-15T14:27:58.884267+0000","last_active":"2024-05-15T14:47:52.677666+0000","last_peered":"2024-05-15T14:47:52.677666+0000","last_clean":"2024-05-15T14:47:52.677666+0000","last_became_active":"2024-05-15T14:27:58.883792+0000","last_became_peered":"2024-05-15T14:27:58.883792+0000","last_unstale":"2024-05-15T14:47:52.677666+0000","last_undegraded":"2024-05-15T14:47:52.677666+0000","last_fullsized":"2024-05-15T14:47:52.677666+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:40.853095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":205,"num_write":143,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.405883+0000","last_change":"2024-05-15T14:28:00.886183+0000","last_active":"2024-05-15T14:44:57.405883+0000","last_peered":"2024-05-15T14:44:57.405883+0000","last_clean":"2024-05-15T14:44:57.405883+0000","last_became_active":"2024-05-15T14:28:00.885933+0000","last_became_peered":"2024-05-15T14:28:00.885933+0000","last_unstale":"2024-05-15T14:44:57.405883+0000","last_undegraded":"2024-05-15T14:44:57.405883+0000","last_fullsized":"2024-05-15T14:44:57.405883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:54:06.577512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.522169+0000","last_change":"2024-05-15T14:31:16.594655+0000","last_active":"2024-05-15T14:46:17.522169+0000","last_peered":"2024-05-15T14:46:17.522169+0000","last_clean":"2024-05-15T14:46:17.522169+0000","last_became_active":"2024-05-15T14:31:16.594357+0000","last_became_peered":"2024-05-15T14:31:16.594357+0000","last_unstale":"2024-05-15T14:46:17.522169+0000","last_undegraded":"2024-05-15T14:46:17.522169+0000","last_fullsized":"2024-05-15T14:46:17.522169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:40.584210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"39'16","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.231721+0000","last_change":"2024-05-15T14:28:02.893788+0000","last_active":"2024-05-15T14:46:21.231721+0000","last_peered":"2024-05-15T14:46:21.231721+0000","last_clean":"2024-05-15T14:46:21.231721+0000","last_became_active":"2024-05-15T14:28:02.892764+0000","last_became_peered":"2024-05-15T14:28:02.892764+0000","last_unstale":"2024-05-15T14:46:21.231721+0000","last_undegraded":"2024-05-15T14:46:21.231721+0000","last_fullsized":"2024-05-15T14:46:21.231721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"39'26","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.831811+0000","last_change":"2024-05-15T14:27:52.853179+0000","last_active":"2024-05-15T14:47:53.831811+0000","last_peered":"2024-05-15T14:47:53.831811+0000","last_clean":"2024-05-15T14:47:53.831811+0000","last_became_active":"2024-05-15T14:27:52.852883+0000","last_became_peered":"2024-05-15T14:27:52.852883+0000","last_unstale":"2024-05-15T14:47:53.831811+0000","last_undegraded":"2024-05-15T14:47:53.831811+0000","last_fullsized":"2024-05-15T14:47:53.831811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519834+0000","last_change":"2024-05-15T14:27:50.848690+0000","last_active":"2024-05-15T14:46:32.519834+0000","last_peered":"2024-05-15T14:46:32.519834+0000","last_clean":"2024-05-15T14:46:32.519834+0000","last_became_active":"2024-05-15T14:27:50.848412+0000","last_became_peered":"2024-05-15T14:27:50.848412+0000","last_unstale":"2024-05-15T14:46:32.519834+0000","last_undegraded":"2024-05-15T14:46:32.519834+0000","last_fullsized":"2024-05-15T14:46:32.519834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"39'14","reported_seq":693,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.906177+0000","last_change":"2024-05-15T14:27:56.877306+0000","last_active":"2024-05-15T14:48:25.906177+0000","last_peered":"2024-05-15T14:48:25.906177+0000","last_clean":"2024-05-15T14:48:25.906177+0000","last_became_active":"2024-05-15T14:27:56.877039+0000","last_became_peered":"2024-05-15T14:27:56.877039+0000","last_unstale":"2024-05-15T14:48:25.906177+0000","last_undegraded":"2024-05-15T14:48:25.906177+0000","last_fullsized":"2024-05-15T14:48:25.906177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":633,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"39'242","reported_seq":403,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.698585+0000","last_change":"2024-05-15T14:27:58.888330+0000","last_active":"2024-05-15T14:47:52.698585+0000","last_peered":"2024-05-15T14:47:52.698585+0000","last_clean":"2024-05-15T14:47:52.698585+0000","last_became_active":"2024-05-15T14:27:58.887969+0000","last_became_peered":"2024-05-15T14:27:58.887969+0000","last_unstale":"2024-05-15T14:47:52.698585+0000","last_undegraded":"2024-05-15T14:47:52.698585+0000","last_fullsized":"2024-05-15T14:47:52.698585+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:58.967265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":351,"num_read_kb":343,"num_write":242,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'924","reported_seq":1430,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.089617+0000","last_change":"2024-05-15T14:28:00.893106+0000","last_active":"2024-05-15T14:48:26.089617+0000","last_peered":"2024-05-15T14:48:26.089617+0000","last_clean":"2024-05-15T14:48:26.089617+0000","last_became_active":"2024-05-15T14:28:00.892864+0000","last_became_peered":"2024-05-15T14:28:00.892864+0000","last_unstale":"2024-05-15T14:48:26.089617+0000","last_undegraded":"2024-05-15T14:48:26.089617+0000","last_fullsized":"2024-05-15T14:48:26.089617+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:44.055462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.522137+0000","last_change":"2024-05-15T14:31:16.584361+0000","last_active":"2024-05-15T14:46:17.522137+0000","last_peered":"2024-05-15T14:46:17.522137+0000","last_clean":"2024-05-15T14:46:17.522137+0000","last_became_active":"2024-05-15T14:31:16.583997+0000","last_became_peered":"2024-05-15T14:31:16.583997+0000","last_unstale":"2024-05-15T14:46:17.522137+0000","last_undegraded":"2024-05-15T14:46:17.522137+0000","last_fullsized":"2024-05-15T14:46:17.522137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:37:56.322484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"39'29","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.868517+0000","last_change":"2024-05-15T14:28:02.887587+0000","last_active":"2024-05-15T14:47:53.868517+0000","last_peered":"2024-05-15T14:47:53.868517+0000","last_clean":"2024-05-15T14:47:53.868517+0000","last_became_active":"2024-05-15T14:28:02.887257+0000","last_became_peered":"2024-05-15T14:28:02.887257+0000","last_unstale":"2024-05-15T14:47:53.868517+0000","last_undegraded":"2024-05-15T14:47:53.868517+0000","last_fullsized":"2024-05-15T14:47:53.868517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":53,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"39'24","reported_seq":108,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.359438+0000","last_change":"2024-05-15T14:27:52.852418+0000","last_active":"2024-05-15T14:46:21.359438+0000","last_peered":"2024-05-15T14:46:21.359438+0000","last_clean":"2024-05-15T14:46:21.359438+0000","last_became_active":"2024-05-15T14:27:52.851979+0000","last_became_peered":"2024-05-15T14:27:52.851979+0000","last_unstale":"2024-05-15T14:46:21.359438+0000","last_undegraded":"2024-05-15T14:46:21.359438+0000","last_fullsized":"2024-05-15T14:46:21.359438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:38.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":90,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"39'6","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.415609+0000","last_change":"2024-05-15T14:27:50.841076+0000","last_active":"2024-05-15T14:46:32.415609+0000","last_peered":"2024-05-15T14:46:32.415609+0000","last_clean":"2024-05-15T14:46:32.415609+0000","last_became_active":"2024-05-15T14:27:50.840772+0000","last_became_peered":"2024-05-15T14:27:50.840772+0000","last_unstale":"2024-05-15T14:46:32.415609+0000","last_undegraded":"2024-05-15T14:46:32.415609+0000","last_fullsized":"2024-05-15T14:46:32.415609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:48:10.102924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":30,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.404007+0000","last_change":"2024-05-15T14:27:56.878098+0000","last_active":"2024-05-15T14:44:52.404007+0000","last_peered":"2024-05-15T14:44:52.404007+0000","last_clean":"2024-05-15T14:44:52.404007+0000","last_became_active":"2024-05-15T14:27:56.877825+0000","last_became_peered":"2024-05-15T14:27:56.877825+0000","last_unstale":"2024-05-15T14:44:52.404007+0000","last_undegraded":"2024-05-15T14:44:52.404007+0000","last_fullsized":"2024-05-15T14:44:52.404007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"39'273","reported_seq":23277,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.006669+0000","last_change":"2024-05-15T14:27:58.887851+0000","last_active":"2024-05-15T14:48:26.006669+0000","last_peered":"2024-05-15T14:48:26.006669+0000","last_clean":"2024-05-15T14:48:26.006669+0000","last_became_active":"2024-05-15T14:27:58.887424+0000","last_became_peered":"2024-05-15T14:27:58.887424+0000","last_unstale":"2024-05-15T14:48:26.006669+0000","last_undegraded":"2024-05-15T14:48:26.006669+0000","last_fullsized":"2024-05-15T14:48:26.006669+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:51.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57540,"num_read_kb":170980,"num_write":272,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'924","reported_seq":2595,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.093366+0000","last_change":"2024-05-15T14:28:00.887805+0000","last_active":"2024-05-15T14:48:26.093366+0000","last_peered":"2024-05-15T14:48:26.093366+0000","last_clean":"2024-05-15T14:48:26.093366+0000","last_became_active":"2024-05-15T14:28:00.887493+0000","last_became_peered":"2024-05-15T14:28:00.887493+0000","last_unstale":"2024-05-15T14:48:26.093366+0000","last_undegraded":"2024-05-15T14:48:26.093366+0000","last_fullsized":"2024-05-15T14:48:26.093366+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:53.511634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.417667+0000","last_change":"2024-05-15T14:31:16.592231+0000","last_active":"2024-05-15T14:45:57.417667+0000","last_peered":"2024-05-15T14:45:57.417667+0000","last_clean":"2024-05-15T14:45:57.417667+0000","last_became_active":"2024-05-15T14:31:16.591945+0000","last_became_peered":"2024-05-15T14:31:16.591945+0000","last_unstale":"2024-05-15T14:45:57.417667+0000","last_undegraded":"2024-05-15T14:45:57.417667+0000","last_fullsized":"2024-05-15T14:45:57.417667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:40:04.556406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"39'16","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304202+0000","last_change":"2024-05-15T14:27:52.842530+0000","last_active":"2024-05-15T14:47:54.304202+0000","last_peered":"2024-05-15T14:47:54.304202+0000","last_clean":"2024-05-15T14:47:54.304202+0000","last_became_active":"2024-05-15T14:27:52.842056+0000","last_became_peered":"2024-05-15T14:27:52.842056+0000","last_unstale":"2024-05-15T14:47:54.304202+0000","last_undegraded":"2024-05-15T14:47:54.304202+0000","last_fullsized":"2024-05-15T14:47:54.304202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.267576+0000","last_change":"2024-05-15T14:27:50.850292+0000","last_active":"2024-05-15T14:47:54.267576+0000","last_peered":"2024-05-15T14:47:54.267576+0000","last_clean":"2024-05-15T14:47:54.267576+0000","last_became_active":"2024-05-15T14:27:50.849981+0000","last_became_peered":"2024-05-15T14:27:50.849981+0000","last_unstale":"2024-05-15T14:47:54.267576+0000","last_undegraded":"2024-05-15T14:47:54.267576+0000","last_fullsized":"2024-05-15T14:47:54.267576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"39'1","reported_seq":128,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.825445+0000","last_change":"2024-05-15T14:27:56.878571+0000","last_active":"2024-05-15T14:46:21.825445+0000","last_peered":"2024-05-15T14:46:21.825445+0000","last_clean":"2024-05-15T14:46:21.825445+0000","last_became_active":"2024-05-15T14:27:56.878269+0000","last_became_peered":"2024-05-15T14:27:56.878269+0000","last_unstale":"2024-05-15T14:46:21.825445+0000","last_undegraded":"2024-05-15T14:46:21.825445+0000","last_fullsized":"2024-05-15T14:46:21.825445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:26.010836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":160,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"39'424","reported_seq":731,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.042504+0000","last_change":"2024-05-15T14:27:58.883936+0000","last_active":"2024-05-15T14:48:26.042504+0000","last_peered":"2024-05-15T14:48:26.042504+0000","last_clean":"2024-05-15T14:48:26.042504+0000","last_became_active":"2024-05-15T14:27:58.883546+0000","last_became_peered":"2024-05-15T14:27:58.883546+0000","last_unstale":"2024-05-15T14:48:26.042504+0000","last_undegraded":"2024-05-15T14:48:26.042504+0000","last_fullsized":"2024-05-15T14:48:26.042504+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.266839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":662,"num_read_kb":650,"num_write":400,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:02.416557+0000","last_change":"2024-05-15T14:28:00.892179+0000","last_active":"2024-05-15T14:46:02.416557+0000","last_peered":"2024-05-15T14:46:02.416557+0000","last_clean":"2024-05-15T14:46:02.416557+0000","last_became_active":"2024-05-15T14:28:00.891863+0000","last_became_peered":"2024-05-15T14:28:00.891863+0000","last_unstale":"2024-05-15T14:46:02.416557+0000","last_undegraded":"2024-05-15T14:46:02.416557+0000","last_fullsized":"2024-05-15T14:46:02.416557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:21:35.957485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"39'26","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.306684+0000","last_change":"2024-05-15T14:28:02.890786+0000","last_active":"2024-05-15T14:47:54.306684+0000","last_peered":"2024-05-15T14:47:54.306684+0000","last_clean":"2024-05-15T14:47:54.306684+0000","last_became_active":"2024-05-15T14:28:02.890450+0000","last_became_peered":"2024-05-15T14:28:02.890450+0000","last_unstale":"2024-05-15T14:47:54.306684+0000","last_undegraded":"2024-05-15T14:47:54.306684+0000","last_fullsized":"2024-05-15T14:47:54.306684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.415229+0000","last_change":"2024-05-15T14:31:16.596637+0000","last_active":"2024-05-15T14:45:52.415229+0000","last_peered":"2024-05-15T14:45:52.415229+0000","last_clean":"2024-05-15T14:45:52.415229+0000","last_became_active":"2024-05-15T14:31:16.596344+0000","last_became_peered":"2024-05-15T14:31:16.596344+0000","last_unstale":"2024-05-15T14:45:52.415229+0000","last_undegraded":"2024-05-15T14:45:52.415229+0000","last_fullsized":"2024-05-15T14:45:52.415229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:45:44.262981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'6","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304209+0000","last_change":"2024-05-15T14:27:52.861403+0000","last_active":"2024-05-15T14:47:54.304209+0000","last_peered":"2024-05-15T14:47:54.304209+0000","last_clean":"2024-05-15T14:47:54.304209+0000","last_became_active":"2024-05-15T14:27:52.861131+0000","last_became_peered":"2024-05-15T14:27:52.861131+0000","last_unstale":"2024-05-15T14:47:54.304209+0000","last_undegraded":"2024-05-15T14:47:54.304209+0000","last_fullsized":"2024-05-15T14:47:54.304209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514795+0000","last_change":"2024-05-15T14:27:50.848143+0000","last_active":"2024-05-15T14:45:52.514795+0000","last_peered":"2024-05-15T14:45:52.514795+0000","last_clean":"2024-05-15T14:45:52.514795+0000","last_became_active":"2024-05-15T14:27:50.847875+0000","last_became_peered":"2024-05-15T14:27:50.847875+0000","last_unstale":"2024-05-15T14:45:52.514795+0000","last_undegraded":"2024-05-15T14:45:52.514795+0000","last_fullsized":"2024-05-15T14:45:52.514795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":11761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"39'1","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:50.280149+0000","last_change":"2024-05-15T14:27:56.881386+0000","last_active":"2024-05-15T14:46:50.280149+0000","last_peered":"2024-05-15T14:46:50.280149+0000","last_clean":"2024-05-15T14:46:50.280149+0000","last_became_active":"2024-05-15T14:27:56.881088+0000","last_became_peered":"2024-05-15T14:27:56.881088+0000","last_unstale":"2024-05-15T14:46:50.280149+0000","last_undegraded":"2024-05-15T14:46:50.280149+0000","last_fullsized":"2024-05-15T14:46:50.280149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:07:36.170847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"39'622","reported_seq":1004,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.083775+0000","last_change":"2024-05-15T14:27:58.883054+0000","last_active":"2024-05-15T14:48:26.083775+0000","last_peered":"2024-05-15T14:48:26.083775+0000","last_clean":"2024-05-15T14:48:26.083775+0000","last_became_active":"2024-05-15T14:27:58.882302+0000","last_became_peered":"2024-05-15T14:27:58.882302+0000","last_unstale":"2024-05-15T14:48:26.083775+0000","last_undegraded":"2024-05-15T14:48:26.083775+0000","last_fullsized":"2024-05-15T14:48:26.083775+0000","mapping_epoch":26,"log_start":"39'598","ondisk_log_start":"39'598","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":598,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:01.547992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1282,"num_read_kb":3196,"num_write":804,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.514379+0000","last_change":"2024-05-15T14:28:00.887671+0000","last_active":"2024-05-15T14:45:22.514379+0000","last_peered":"2024-05-15T14:45:22.514379+0000","last_clean":"2024-05-15T14:45:22.514379+0000","last_became_active":"2024-05-15T14:28:00.887335+0000","last_became_peered":"2024-05-15T14:28:00.887335+0000","last_unstale":"2024-05-15T14:45:22.514379+0000","last_undegraded":"2024-05-15T14:45:22.514379+0000","last_fullsized":"2024-05-15T14:45:22.514379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:16.436035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"39'15","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.314845+0000","last_change":"2024-05-15T14:28:02.889484+0000","last_active":"2024-05-15T14:47:54.314845+0000","last_peered":"2024-05-15T14:47:54.314845+0000","last_clean":"2024-05-15T14:47:54.314845+0000","last_became_active":"2024-05-15T14:28:02.889193+0000","last_became_peered":"2024-05-15T14:28:02.889193+0000","last_unstale":"2024-05-15T14:47:54.314845+0000","last_undegraded":"2024-05-15T14:47:54.314845+0000","last_fullsized":"2024-05-15T14:47:54.314845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:38.654471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.415472+0000","last_change":"2024-05-15T14:31:16.591065+0000","last_active":"2024-05-15T14:46:27.415472+0000","last_peered":"2024-05-15T14:46:27.415472+0000","last_clean":"2024-05-15T14:46:27.415472+0000","last_became_active":"2024-05-15T14:31:16.590510+0000","last_became_peered":"2024-05-15T14:31:16.590510+0000","last_unstale":"2024-05-15T14:46:27.415472+0000","last_undegraded":"2024-05-15T14:46:27.415472+0000","last_fullsized":"2024-05-15T14:46:27.415472+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:15.350673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"39'64","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.296114+0000","last_change":"2024-05-15T14:27:52.861599+0000","last_active":"2024-05-15T14:47:54.296114+0000","last_peered":"2024-05-15T14:47:54.296114+0000","last_clean":"2024-05-15T14:47:54.296114+0000","last_became_active":"2024-05-15T14:27:52.861183+0000","last_became_peered":"2024-05-15T14:27:52.861183+0000","last_unstale":"2024-05-15T14:47:54.296114+0000","last_undegraded":"2024-05-15T14:47:54.296114+0000","last_fullsized":"2024-05-15T14:47:54.296114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:37.266001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":194,"num_write":90,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514768+0000","last_change":"2024-05-15T14:27:50.853049+0000","last_active":"2024-05-15T14:45:52.514768+0000","last_peered":"2024-05-15T14:45:52.514768+0000","last_clean":"2024-05-15T14:45:52.514768+0000","last_became_active":"2024-05-15T14:27:50.852376+0000","last_became_peered":"2024-05-15T14:27:50.852376+0000","last_unstale":"2024-05-15T14:45:52.514768+0000","last_undegraded":"2024-05-15T14:45:52.514768+0000","last_fullsized":"2024-05-15T14:45:52.514768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"25'1","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.359199+0000","last_change":"2024-05-15T14:27:56.881977+0000","last_active":"2024-05-15T14:47:52.359199+0000","last_peered":"2024-05-15T14:47:52.359199+0000","last_clean":"2024-05-15T14:47:52.359199+0000","last_became_active":"2024-05-15T14:27:56.881701+0000","last_became_peered":"2024-05-15T14:27:56.881701+0000","last_unstale":"2024-05-15T14:47:52.359199+0000","last_undegraded":"2024-05-15T14:47:52.359199+0000","last_fullsized":"2024-05-15T14:47:52.359199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:58:05.807690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"39'431","reported_seq":790,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.048598+0000","last_change":"2024-05-15T14:27:58.886060+0000","last_active":"2024-05-15T14:48:26.048598+0000","last_peered":"2024-05-15T14:48:26.048598+0000","last_clean":"2024-05-15T14:48:26.048598+0000","last_became_active":"2024-05-15T14:27:58.885487+0000","last_became_peered":"2024-05-15T14:27:58.885487+0000","last_unstale":"2024-05-15T14:48:26.048598+0000","last_undegraded":"2024-05-15T14:48:26.048598+0000","last_fullsized":"2024-05-15T14:48:26.048598+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:27.428584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":872,"num_read_kb":1334,"num_write":445,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"39'924","reported_seq":1544,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.094334+0000","last_change":"2024-05-15T14:28:00.893226+0000","last_active":"2024-05-15T14:48:26.094334+0000","last_peered":"2024-05-15T14:48:26.094334+0000","last_clean":"2024-05-15T14:48:26.094334+0000","last_became_active":"2024-05-15T14:28:00.892897+0000","last_became_peered":"2024-05-15T14:28:00.892897+0000","last_unstale":"2024-05-15T14:48:26.094334+0000","last_undegraded":"2024-05-15T14:48:26.094334+0000","last_fullsized":"2024-05-15T14:48:26.094334+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:36.428903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"39'14","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.753138+0000","last_change":"2024-05-15T14:28:02.894508+0000","last_active":"2024-05-15T14:47:53.753138+0000","last_peered":"2024-05-15T14:47:53.753138+0000","last_clean":"2024-05-15T14:47:53.753138+0000","last_became_active":"2024-05-15T14:28:02.894071+0000","last_became_peered":"2024-05-15T14:28:02.894071+0000","last_unstale":"2024-05-15T14:47:53.753138+0000","last_undegraded":"2024-05-15T14:47:53.753138+0000","last_fullsized":"2024-05-15T14:47:53.753138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:44.977557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.415437+0000","last_change":"2024-05-15T14:31:16.591474+0000","last_active":"2024-05-15T14:46:27.415437+0000","last_peered":"2024-05-15T14:46:27.415437+0000","last_clean":"2024-05-15T14:46:27.415437+0000","last_became_active":"2024-05-15T14:31:16.591166+0000","last_became_peered":"2024-05-15T14:31:16.591166+0000","last_unstale":"2024-05-15T14:46:27.415437+0000","last_undegraded":"2024-05-15T14:46:27.415437+0000","last_fullsized":"2024-05-15T14:46:27.415437+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:19:18.238793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'114","reported_seq":206,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328155+0000","last_change":"2024-05-15T14:27:52.860101+0000","last_active":"2024-05-15T14:47:54.328155+0000","last_peered":"2024-05-15T14:47:54.328155+0000","last_clean":"2024-05-15T14:47:54.328155+0000","last_became_active":"2024-05-15T14:27:52.859814+0000","last_became_peered":"2024-05-15T14:27:52.859814+0000","last_unstale":"2024-05-15T14:47:54.328155+0000","last_undegraded":"2024-05-15T14:47:54.328155+0000","last_fullsized":"2024-05-15T14:47:54.328155+0000","mapping_epoch":20,"log_start":"39'100","ondisk_log_start":"39'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":332,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411210+0000","last_change":"2024-05-15T14:27:50.849872+0000","last_active":"2024-05-15T14:45:52.411210+0000","last_peered":"2024-05-15T14:45:52.411210+0000","last_clean":"2024-05-15T14:45:52.411210+0000","last_became_active":"2024-05-15T14:27:50.849548+0000","last_became_peered":"2024-05-15T14:27:50.849548+0000","last_unstale":"2024-05-15T14:45:52.411210+0000","last_undegraded":"2024-05-15T14:45:52.411210+0000","last_fullsized":"2024-05-15T14:45:52.411210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"39'5","reported_seq":646,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:45.632505+0000","last_change":"2024-05-15T14:27:56.871956+0000","last_active":"2024-05-15T14:48:45.632505+0000","last_peered":"2024-05-15T14:48:45.632505+0000","last_clean":"2024-05-15T14:48:45.632505+0000","last_became_active":"2024-05-15T14:27:56.871644+0000","last_became_peered":"2024-05-15T14:27:56.871644+0000","last_unstale":"2024-05-15T14:48:45.632505+0000","last_undegraded":"2024-05-15T14:48:45.632505+0000","last_fullsized":"2024-05-15T14:48:45.632505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:48:16.147799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":148,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'275","reported_seq":560,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.054464+0000","last_change":"2024-05-15T14:27:58.881240+0000","last_active":"2024-05-15T14:48:26.054464+0000","last_peered":"2024-05-15T14:48:26.054464+0000","last_clean":"2024-05-15T14:48:26.054464+0000","last_became_active":"2024-05-15T14:27:58.880926+0000","last_became_peered":"2024-05-15T14:27:58.880926+0000","last_unstale":"2024-05-15T14:48:26.054464+0000","last_undegraded":"2024-05-15T14:48:26.054464+0000","last_fullsized":"2024-05-15T14:48:26.054464+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:51.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":466,"num_read_kb":455,"num_write":228,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.501382+0000","last_change":"2024-05-15T14:28:00.886629+0000","last_active":"2024-05-15T14:45:22.501382+0000","last_peered":"2024-05-15T14:45:22.501382+0000","last_clean":"2024-05-15T14:45:22.501382+0000","last_became_active":"2024-05-15T14:28:00.886359+0000","last_became_peered":"2024-05-15T14:28:00.886359+0000","last_unstale":"2024-05-15T14:45:22.501382+0000","last_undegraded":"2024-05-15T14:45:22.501382+0000","last_fullsized":"2024-05-15T14:45:22.501382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:28.468952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"39'29","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.250372+0000","last_change":"2024-05-15T14:28:02.892567+0000","last_active":"2024-05-15T14:47:54.250372+0000","last_peered":"2024-05-15T14:47:54.250372+0000","last_clean":"2024-05-15T14:47:54.250372+0000","last_became_active":"2024-05-15T14:28:02.892287+0000","last_became_peered":"2024-05-15T14:28:02.892287+0000","last_unstale":"2024-05-15T14:47:54.250372+0000","last_undegraded":"2024-05-15T14:47:54.250372+0000","last_fullsized":"2024-05-15T14:47:54.250372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:17:18.538337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518593+0000","last_change":"2024-05-15T14:31:16.590519+0000","last_active":"2024-05-15T14:45:52.518593+0000","last_peered":"2024-05-15T14:45:52.518593+0000","last_clean":"2024-05-15T14:45:52.518593+0000","last_became_active":"2024-05-15T14:31:16.590227+0000","last_became_peered":"2024-05-15T14:31:16.590227+0000","last_unstale":"2024-05-15T14:45:52.518593+0000","last_undegraded":"2024-05-15T14:45:52.518593+0000","last_fullsized":"2024-05-15T14:45:52.518593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:21.771432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411633+0000","last_change":"2024-05-15T14:27:52.851931+0000","last_active":"2024-05-15T14:45:52.411633+0000","last_peered":"2024-05-15T14:45:52.411633+0000","last_clean":"2024-05-15T14:45:52.411633+0000","last_became_active":"2024-05-15T14:27:52.851589+0000","last_became_peered":"2024-05-15T14:27:52.851589+0000","last_unstale":"2024-05-15T14:45:52.411633+0000","last_undegraded":"2024-05-15T14:45:52.411633+0000","last_fullsized":"2024-05-15T14:45:52.411633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:38.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"39'14","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026953+0000","last_change":"2024-05-15T14:27:50.850680+0000","last_active":"2024-05-15T14:48:26.026953+0000","last_peered":"2024-05-15T14:48:26.026953+0000","last_clean":"2024-05-15T14:48:26.026953+0000","last_became_active":"2024-05-15T14:27:50.850389+0000","last_became_peered":"2024-05-15T14:27:50.850389+0000","last_unstale":"2024-05-15T14:48:26.026953+0000","last_undegraded":"2024-05-15T14:48:26.026953+0000","last_fullsized":"2024-05-15T14:48:26.026953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":19,"num_write":54,"num_write_kb":19955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"25'1","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.358730+0000","last_change":"2024-05-15T14:27:56.877565+0000","last_active":"2024-05-15T14:47:52.358730+0000","last_peered":"2024-05-15T14:47:52.358730+0000","last_clean":"2024-05-15T14:47:52.358730+0000","last_became_active":"2024-05-15T14:27:56.876626+0000","last_became_peered":"2024-05-15T14:27:56.876626+0000","last_unstale":"2024-05-15T14:47:52.358730+0000","last_undegraded":"2024-05-15T14:47:52.358730+0000","last_fullsized":"2024-05-15T14:47:52.358730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:59:42.209397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"39'362","reported_seq":584,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.986164+0000","last_change":"2024-05-15T14:27:58.885446+0000","last_active":"2024-05-15T14:48:25.986164+0000","last_peered":"2024-05-15T14:48:25.986164+0000","last_clean":"2024-05-15T14:48:25.986164+0000","last_became_active":"2024-05-15T14:27:58.885156+0000","last_became_peered":"2024-05-15T14:27:58.885156+0000","last_unstale":"2024-05-15T14:48:25.986164+0000","last_undegraded":"2024-05-15T14:48:25.986164+0000","last_fullsized":"2024-05-15T14:48:25.986164+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":660,"num_write":561,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:07.418800+0000","last_change":"2024-05-15T14:28:00.885938+0000","last_active":"2024-05-15T14:46:07.418800+0000","last_peered":"2024-05-15T14:46:07.418800+0000","last_clean":"2024-05-15T14:46:07.418800+0000","last_became_active":"2024-05-15T14:28:00.885582+0000","last_became_peered":"2024-05-15T14:28:00.885582+0000","last_unstale":"2024-05-15T14:46:07.418800+0000","last_undegraded":"2024-05-15T14:46:07.418800+0000","last_fullsized":"2024-05-15T14:46:07.418800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:22:45.934449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"39'24","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.863377+0000","last_change":"2024-05-15T14:28:02.891692+0000","last_active":"2024-05-15T14:47:53.863377+0000","last_peered":"2024-05-15T14:47:53.863377+0000","last_clean":"2024-05-15T14:47:53.863377+0000","last_became_active":"2024-05-15T14:28:02.891419+0000","last_became_peered":"2024-05-15T14:28:02.891419+0000","last_unstale":"2024-05-15T14:47:53.863377+0000","last_undegraded":"2024-05-15T14:47:53.863377+0000","last_fullsized":"2024-05-15T14:47:53.863377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:00.406575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.411559+0000","last_change":"2024-05-15T14:31:16.594272+0000","last_active":"2024-05-15T14:45:22.411559+0000","last_peered":"2024-05-15T14:45:22.411559+0000","last_clean":"2024-05-15T14:45:22.411559+0000","last_became_active":"2024-05-15T14:31:16.593942+0000","last_became_peered":"2024-05-15T14:31:16.593942+0000","last_unstale":"2024-05-15T14:45:22.411559+0000","last_undegraded":"2024-05-15T14:45:22.411559+0000","last_fullsized":"2024-05-15T14:45:22.411559+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:22.878653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'62","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840310+0000","last_change":"2024-05-15T14:27:52.854103+0000","last_active":"2024-05-15T14:47:53.840310+0000","last_peered":"2024-05-15T14:47:53.840310+0000","last_clean":"2024-05-15T14:47:53.840310+0000","last_became_active":"2024-05-15T14:27:52.853828+0000","last_became_peered":"2024-05-15T14:27:52.853828+0000","last_unstale":"2024-05-15T14:47:53.840310+0000","last_undegraded":"2024-05-15T14:47:53.840310+0000","last_fullsized":"2024-05-15T14:47:53.840310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":210,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407053+0000","last_change":"2024-05-15T14:27:50.838852+0000","last_active":"2024-05-15T14:45:17.407053+0000","last_peered":"2024-05-15T14:45:17.407053+0000","last_clean":"2024-05-15T14:45:17.407053+0000","last_became_active":"2024-05-15T14:27:50.838561+0000","last_became_peered":"2024-05-15T14:27:50.838561+0000","last_unstale":"2024-05-15T14:45:17.407053+0000","last_undegraded":"2024-05-15T14:45:17.407053+0000","last_fullsized":"2024-05-15T14:45:17.407053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:04.000024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.415863+0000","last_change":"2024-05-15T14:27:56.885185+0000","last_active":"2024-05-15T14:45:57.415863+0000","last_peered":"2024-05-15T14:45:57.415863+0000","last_clean":"2024-05-15T14:45:57.415863+0000","last_became_active":"2024-05-15T14:27:56.884903+0000","last_became_peered":"2024-05-15T14:27:56.884903+0000","last_unstale":"2024-05-15T14:45:57.415863+0000","last_undegraded":"2024-05-15T14:45:57.415863+0000","last_fullsized":"2024-05-15T14:45:57.415863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:07.170918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"39'341","reported_seq":600,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.072557+0000","last_change":"2024-05-15T14:27:58.876510+0000","last_active":"2024-05-15T14:48:26.072557+0000","last_peered":"2024-05-15T14:48:26.072557+0000","last_clean":"2024-05-15T14:48:26.072557+0000","last_became_active":"2024-05-15T14:27:58.876221+0000","last_became_peered":"2024-05-15T14:27:58.876221+0000","last_unstale":"2024-05-15T14:48:26.072557+0000","last_undegraded":"2024-05-15T14:48:26.072557+0000","last_fullsized":"2024-05-15T14:48:26.072557+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:51.509862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":522,"num_write":318,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'924","reported_seq":1397,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.090607+0000","last_change":"2024-05-15T14:28:00.884330+0000","last_active":"2024-05-15T14:48:26.090607+0000","last_peered":"2024-05-15T14:48:26.090607+0000","last_clean":"2024-05-15T14:48:26.090607+0000","last_became_active":"2024-05-15T14:28:00.884042+0000","last_became_peered":"2024-05-15T14:28:00.884042+0000","last_unstale":"2024-05-15T14:48:26.090607+0000","last_undegraded":"2024-05-15T14:48:26.090607+0000","last_fullsized":"2024-05-15T14:48:26.090607+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:27.911745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"39'23","reported_seq":62,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.291705+0000","last_change":"2024-05-15T14:28:02.888922+0000","last_active":"2024-05-15T14:47:54.291705+0000","last_peered":"2024-05-15T14:47:54.291705+0000","last_clean":"2024-05-15T14:47:54.291705+0000","last_became_active":"2024-05-15T14:28:02.888602+0000","last_became_peered":"2024-05-15T14:28:02.888602+0000","last_unstale":"2024-05-15T14:47:54.291705+0000","last_undegraded":"2024-05-15T14:47:54.291705+0000","last_fullsized":"2024-05-15T14:47:54.291705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:10.939156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514713+0000","last_change":"2024-05-15T14:31:16.591991+0000","last_active":"2024-05-15T14:45:52.514713+0000","last_peered":"2024-05-15T14:45:52.514713+0000","last_clean":"2024-05-15T14:45:52.514713+0000","last_became_active":"2024-05-15T14:31:16.591677+0000","last_became_peered":"2024-05-15T14:31:16.591677+0000","last_unstale":"2024-05-15T14:45:52.514713+0000","last_undegraded":"2024-05-15T14:45:52.514713+0000","last_fullsized":"2024-05-15T14:45:52.514713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:14:24.885155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'72","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327549+0000","last_change":"2024-05-15T14:27:52.844483+0000","last_active":"2024-05-15T14:47:54.327549+0000","last_peered":"2024-05-15T14:47:54.327549+0000","last_clean":"2024-05-15T14:47:54.327549+0000","last_became_active":"2024-05-15T14:27:52.844221+0000","last_became_peered":"2024-05-15T14:27:52.844221+0000","last_unstale":"2024-05-15T14:47:54.327549+0000","last_undegraded":"2024-05-15T14:47:54.327549+0000","last_fullsized":"2024-05-15T14:47:54.327549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":255,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.277035+0000","last_change":"2024-05-15T14:27:50.849342+0000","last_active":"2024-05-15T14:47:54.277035+0000","last_peered":"2024-05-15T14:47:54.277035+0000","last_clean":"2024-05-15T14:47:54.277035+0000","last_became_active":"2024-05-15T14:27:50.846927+0000","last_became_peered":"2024-05-15T14:27:50.846927+0000","last_unstale":"2024-05-15T14:47:54.277035+0000","last_undegraded":"2024-05-15T14:47:54.277035+0000","last_fullsized":"2024-05-15T14:47:54.277035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":82,"num_write_kb":24687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'6","reported_seq":801,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.907076+0000","last_change":"2024-05-15T14:27:56.882327+0000","last_active":"2024-05-15T14:48:25.907076+0000","last_peered":"2024-05-15T14:48:25.907076+0000","last_clean":"2024-05-15T14:48:25.907076+0000","last_became_active":"2024-05-15T14:27:56.882055+0000","last_became_peered":"2024-05-15T14:27:56.882055+0000","last_unstale":"2024-05-15T14:48:25.907076+0000","last_undegraded":"2024-05-15T14:48:25.907076+0000","last_fullsized":"2024-05-15T14:48:25.907076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1072,"num_read_kb":1813,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"39'231","reported_seq":384,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.748891+0000","last_change":"2024-05-15T14:27:58.878945+0000","last_active":"2024-05-15T14:47:53.748891+0000","last_peered":"2024-05-15T14:47:53.748891+0000","last_clean":"2024-05-15T14:47:53.748891+0000","last_became_active":"2024-05-15T14:27:58.878514+0000","last_became_peered":"2024-05-15T14:27:58.878514+0000","last_unstale":"2024-05-15T14:47:53.748891+0000","last_undegraded":"2024-05-15T14:47:53.748891+0000","last_fullsized":"2024-05-15T14:47:53.748891+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:40.853095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":332,"num_write":230,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'924","reported_seq":1429,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.091471+0000","last_change":"2024-05-15T14:28:00.891775+0000","last_active":"2024-05-15T14:48:26.091471+0000","last_peered":"2024-05-15T14:48:26.091471+0000","last_clean":"2024-05-15T14:48:26.091471+0000","last_became_active":"2024-05-15T14:28:00.891535+0000","last_became_peered":"2024-05-15T14:28:00.891535+0000","last_unstale":"2024-05-15T14:48:26.091471+0000","last_undegraded":"2024-05-15T14:48:26.091471+0000","last_fullsized":"2024-05-15T14:48:26.091471+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:03.092896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"39'19","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418124+0000","last_change":"2024-05-15T14:28:02.889970+0000","last_active":"2024-05-15T14:46:47.418124+0000","last_peered":"2024-05-15T14:46:47.418124+0000","last_clean":"2024-05-15T14:46:47.418124+0000","last_became_active":"2024-05-15T14:28:02.889039+0000","last_became_peered":"2024-05-15T14:28:02.889039+0000","last_unstale":"2024-05-15T14:46:47.418124+0000","last_undegraded":"2024-05-15T14:46:47.418124+0000","last_fullsized":"2024-05-15T14:46:47.418124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518620+0000","last_change":"2024-05-15T14:31:16.593519+0000","last_active":"2024-05-15T14:45:52.518620+0000","last_peered":"2024-05-15T14:45:52.518620+0000","last_clean":"2024-05-15T14:45:52.518620+0000","last_became_active":"2024-05-15T14:31:16.593216+0000","last_became_peered":"2024-05-15T14:31:16.593216+0000","last_unstale":"2024-05-15T14:45:52.518620+0000","last_undegraded":"2024-05-15T14:45:52.518620+0000","last_fullsized":"2024-05-15T14:45:52.518620+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:16:24.742213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'24","reported_seq":118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.384978+0000","last_change":"2024-05-15T14:27:52.855239+0000","last_active":"2024-05-15T14:46:21.384978+0000","last_peered":"2024-05-15T14:46:21.384978+0000","last_clean":"2024-05-15T14:46:21.384978+0000","last_became_active":"2024-05-15T14:27:52.854963+0000","last_became_peered":"2024-05-15T14:27:52.854963+0000","last_unstale":"2024-05-15T14:46:21.384978+0000","last_undegraded":"2024-05-15T14:46:21.384978+0000","last_fullsized":"2024-05-15T14:46:21.384978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:02.561338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512454+0000","last_change":"2024-05-15T14:27:50.847492+0000","last_active":"2024-05-15T14:45:12.512454+0000","last_peered":"2024-05-15T14:45:12.512454+0000","last_clean":"2024-05-15T14:45:12.512454+0000","last_became_active":"2024-05-15T14:27:50.847163+0000","last_became_peered":"2024-05-15T14:27:50.847163+0000","last_unstale":"2024-05-15T14:45:12.512454+0000","last_undegraded":"2024-05-15T14:45:12.512454+0000","last_fullsized":"2024-05-15T14:45:12.512454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.412235+0000","last_change":"2024-05-15T14:27:56.880246+0000","last_active":"2024-05-15T14:45:57.412235+0000","last_peered":"2024-05-15T14:45:57.412235+0000","last_clean":"2024-05-15T14:45:57.412235+0000","last_became_active":"2024-05-15T14:27:56.879526+0000","last_became_peered":"2024-05-15T14:27:56.879526+0000","last_unstale":"2024-05-15T14:45:57.412235+0000","last_undegraded":"2024-05-15T14:45:57.412235+0000","last_fullsized":"2024-05-15T14:45:57.412235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"39'405","reported_seq":686,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.033540+0000","last_change":"2024-05-15T14:27:58.883156+0000","last_active":"2024-05-15T14:48:26.033540+0000","last_peered":"2024-05-15T14:48:26.033540+0000","last_clean":"2024-05-15T14:48:26.033540+0000","last_became_active":"2024-05-15T14:27:58.882886+0000","last_became_peered":"2024-05-15T14:27:58.882886+0000","last_unstale":"2024-05-15T14:48:26.033540+0000","last_undegraded":"2024-05-15T14:48:26.033540+0000","last_fullsized":"2024-05-15T14:48:26.033540+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:42.051812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":654,"num_read_kb":644,"num_write":480,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:02.412107+0000","last_change":"2024-05-15T14:28:00.885713+0000","last_active":"2024-05-15T14:46:02.412107+0000","last_peered":"2024-05-15T14:46:02.412107+0000","last_clean":"2024-05-15T14:46:02.412107+0000","last_became_active":"2024-05-15T14:28:00.885434+0000","last_became_peered":"2024-05-15T14:28:00.885434+0000","last_unstale":"2024-05-15T14:46:02.412107+0000","last_undegraded":"2024-05-15T14:46:02.412107+0000","last_fullsized":"2024-05-15T14:46:02.412107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:30.563508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"39'18","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288457+0000","last_change":"2024-05-15T14:28:02.890234+0000","last_active":"2024-05-15T14:47:54.288457+0000","last_peered":"2024-05-15T14:47:54.288457+0000","last_clean":"2024-05-15T14:47:54.288457+0000","last_became_active":"2024-05-15T14:28:02.889918+0000","last_became_peered":"2024-05-15T14:28:02.889918+0000","last_unstale":"2024-05-15T14:47:54.288457+0000","last_undegraded":"2024-05-15T14:47:54.288457+0000","last_fullsized":"2024-05-15T14:47:54.288457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:16:02.299835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.523316+0000","last_change":"2024-05-15T14:31:16.594123+0000","last_active":"2024-05-15T14:46:27.523316+0000","last_peered":"2024-05-15T14:46:27.523316+0000","last_clean":"2024-05-15T14:46:27.523316+0000","last_became_active":"2024-05-15T14:31:16.593813+0000","last_became_peered":"2024-05-15T14:31:16.593813+0000","last_unstale":"2024-05-15T14:46:27.523316+0000","last_undegraded":"2024-05-15T14:46:27.523316+0000","last_fullsized":"2024-05-15T14:46:27.523316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:36.647120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'64","reported_seq":184,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840377+0000","last_change":"2024-05-15T14:27:52.846883+0000","last_active":"2024-05-15T14:47:53.840377+0000","last_peered":"2024-05-15T14:47:53.840377+0000","last_clean":"2024-05-15T14:47:53.840377+0000","last_became_active":"2024-05-15T14:27:52.846508+0000","last_became_peered":"2024-05-15T14:27:52.846508+0000","last_unstale":"2024-05-15T14:47:53.840377+0000","last_undegraded":"2024-05-15T14:47:53.840377+0000","last_fullsized":"2024-05-15T14:47:53.840377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:40.944809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":231,"num_write":88,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514066+0000","last_change":"2024-05-15T14:27:43.806336+0000","last_active":"2024-05-15T14:45:47.514066+0000","last_peered":"2024-05-15T14:45:47.514066+0000","last_clean":"2024-05-15T14:45:47.514066+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:45:47.514066+0000","last_undegraded":"2024-05-15T14:45:47.514066+0000","last_fullsized":"2024-05-15T14:45:47.514066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_clean_scrub_stamp":"2024-05-15T14:27:42.789461+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:25.195322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416082+0000","last_change":"2024-05-15T14:27:44.808919+0000","last_active":"2024-05-15T14:46:32.416082+0000","last_peered":"2024-05-15T14:46:32.416082+0000","last_clean":"2024-05-15T14:46:32.416082+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:46:32.416082+0000","last_undegraded":"2024-05-15T14:46:32.416082+0000","last_fullsized":"2024-05-15T14:46:32.416082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"39'26","reported_seq":112,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.258707+0000","last_change":"2024-05-15T14:27:50.850434+0000","last_active":"2024-05-15T14:47:54.258707+0000","last_peered":"2024-05-15T14:47:54.258707+0000","last_clean":"2024-05-15T14:47:54.258707+0000","last_became_active":"2024-05-15T14:27:50.849731+0000","last_became_peered":"2024-05-15T14:27:50.849731+0000","last_unstale":"2024-05-15T14:47:54.258707+0000","last_undegraded":"2024-05-15T14:47:54.258707+0000","last_fullsized":"2024-05-15T14:47:54.258707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":50,"num_write":130,"num_write_kb":35292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.521236+0000","last_change":"2024-05-15T14:27:56.878884+0000","last_active":"2024-05-15T14:46:42.521236+0000","last_peered":"2024-05-15T14:46:42.521236+0000","last_clean":"2024-05-15T14:46:42.521236+0000","last_became_active":"2024-05-15T14:27:56.878611+0000","last_became_peered":"2024-05-15T14:27:56.878611+0000","last_unstale":"2024-05-15T14:46:42.521236+0000","last_undegraded":"2024-05-15T14:46:42.521236+0000","last_fullsized":"2024-05-15T14:46:42.521236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:39.394172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"39'341","reported_seq":3164,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.066914+0000","last_change":"2024-05-15T14:27:58.884541+0000","last_active":"2024-05-15T14:48:26.066914+0000","last_peered":"2024-05-15T14:48:26.066914+0000","last_clean":"2024-05-15T14:48:26.066914+0000","last_became_active":"2024-05-15T14:27:58.884237+0000","last_became_peered":"2024-05-15T14:27:58.884237+0000","last_unstale":"2024-05-15T14:48:26.066914+0000","last_undegraded":"2024-05-15T14:48:26.066914+0000","last_fullsized":"2024-05-15T14:48:26.066914+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":8031,"num_read_kb":5511,"num_write":255,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.413851+0000","last_change":"2024-05-15T14:28:00.887075+0000","last_active":"2024-05-15T14:45:22.413851+0000","last_peered":"2024-05-15T14:45:22.413851+0000","last_clean":"2024-05-15T14:45:22.413851+0000","last_became_active":"2024-05-15T14:28:00.886539+0000","last_became_peered":"2024-05-15T14:28:00.886539+0000","last_unstale":"2024-05-15T14:45:22.413851+0000","last_undegraded":"2024-05-15T14:45:22.413851+0000","last_fullsized":"2024-05-15T14:45:22.413851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:29.042984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"39'21","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.728874+0000","last_change":"2024-05-15T14:28:02.892380+0000","last_active":"2024-05-15T14:47:53.728874+0000","last_peered":"2024-05-15T14:47:53.728874+0000","last_clean":"2024-05-15T14:47:53.728874+0000","last_became_active":"2024-05-15T14:28:02.892076+0000","last_became_peered":"2024-05-15T14:28:02.892076+0000","last_unstale":"2024-05-15T14:47:53.728874+0000","last_undegraded":"2024-05-15T14:47:53.728874+0000","last_fullsized":"2024-05-15T14:47:53.728874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:04.849548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.b","version":"39'3","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.409808+0000","last_change":"2024-05-15T14:31:16.592642+0000","last_active":"2024-05-15T14:44:47.409808+0000","last_peered":"2024-05-15T14:44:47.409808+0000","last_clean":"2024-05-15T14:44:47.409808+0000","last_became_active":"2024-05-15T14:31:16.592325+0000","last_became_peered":"2024-05-15T14:31:16.592325+0000","last_unstale":"2024-05-15T14:44:47.409808+0000","last_undegraded":"2024-05-15T14:44:47.409808+0000","last_fullsized":"2024-05-15T14:44:47.409808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:15.350673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'26","reported_seq":131,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.335536+0000","last_change":"2024-05-15T14:27:52.859118+0000","last_active":"2024-05-15T14:46:21.335536+0000","last_peered":"2024-05-15T14:46:21.335536+0000","last_clean":"2024-05-15T14:46:21.335536+0000","last_became_active":"2024-05-15T14:27:52.858631+0000","last_became_peered":"2024-05-15T14:27:52.858631+0000","last_unstale":"2024-05-15T14:46:21.335536+0000","last_undegraded":"2024-05-15T14:46:21.335536+0000","last_fullsized":"2024-05-15T14:46:21.335536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514045+0000","last_change":"2024-05-15T14:27:44.810189+0000","last_active":"2024-05-15T14:45:47.514045+0000","last_peered":"2024-05-15T14:45:47.514045+0000","last_clean":"2024-05-15T14:45:47.514045+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:45:47.514045+0000","last_undegraded":"2024-05-15T14:45:47.514045+0000","last_fullsized":"2024-05-15T14:45:47.514045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:29.474022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'9","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.076855+0000","last_change":"2024-05-15T14:27:50.833876+0000","last_active":"2024-05-15T14:48:26.076855+0000","last_peered":"2024-05-15T14:48:26.076855+0000","last_clean":"2024-05-15T14:48:26.076855+0000","last_became_active":"2024-05-15T14:27:50.833509+0000","last_became_peered":"2024-05-15T14:27:50.833509+0000","last_unstale":"2024-05-15T14:48:26.076855+0000","last_undegraded":"2024-05-15T14:48:26.076855+0000","last_fullsized":"2024-05-15T14:48:26.076855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":37,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407312+0000","last_change":"2024-05-15T14:27:56.876813+0000","last_active":"2024-05-15T14:45:17.407312+0000","last_peered":"2024-05-15T14:45:17.407312+0000","last_clean":"2024-05-15T14:45:17.407312+0000","last_became_active":"2024-05-15T14:27:56.876526+0000","last_became_peered":"2024-05-15T14:27:56.876526+0000","last_unstale":"2024-05-15T14:45:17.407312+0000","last_undegraded":"2024-05-15T14:45:17.407312+0000","last_fullsized":"2024-05-15T14:45:17.407312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:54.193440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"39'1087","reported_seq":2199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.228944+0000","last_change":"2024-05-15T14:27:58.887397+0000","last_active":"2024-05-15T14:48:26.228944+0000","last_peered":"2024-05-15T14:48:26.228944+0000","last_clean":"2024-05-15T14:48:26.228944+0000","last_became_active":"2024-05-15T14:27:58.887083+0000","last_became_peered":"2024-05-15T14:27:58.887083+0000","last_unstale":"2024-05-15T14:48:26.228944+0000","last_undegraded":"2024-05-15T14:48:26.228944+0000","last_fullsized":"2024-05-15T14:48:26.228944+0000","mapping_epoch":26,"log_start":"39'1000","ondisk_log_start":"39'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":1000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:41.397867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1707,"num_read_kb":1691,"num_write":402,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.521852+0000","last_change":"2024-05-15T14:28:00.890674+0000","last_active":"2024-05-15T14:46:47.521852+0000","last_peered":"2024-05-15T14:46:47.521852+0000","last_clean":"2024-05-15T14:46:47.521852+0000","last_became_active":"2024-05-15T14:28:00.890321+0000","last_became_peered":"2024-05-15T14:28:00.890321+0000","last_unstale":"2024-05-15T14:46:47.521852+0000","last_undegraded":"2024-05-15T14:46:47.521852+0000","last_fullsized":"2024-05-15T14:46:47.521852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:17.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"39'19","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.433552+0000","last_change":"2024-05-15T14:28:02.883575+0000","last_active":"2024-05-15T14:47:53.433552+0000","last_peered":"2024-05-15T14:47:53.433552+0000","last_clean":"2024-05-15T14:47:53.433552+0000","last_became_active":"2024-05-15T14:28:02.883249+0000","last_became_peered":"2024-05-15T14:28:02.883249+0000","last_unstale":"2024-05-15T14:47:53.433552+0000","last_undegraded":"2024-05-15T14:47:53.433552+0000","last_fullsized":"2024-05-15T14:47:53.433552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:15.023309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416034+0000","last_change":"2024-05-15T14:31:16.593784+0000","last_active":"2024-05-15T14:46:32.416034+0000","last_peered":"2024-05-15T14:46:32.416034+0000","last_clean":"2024-05-15T14:46:32.416034+0000","last_became_active":"2024-05-15T14:31:16.593500+0000","last_became_peered":"2024-05-15T14:31:16.593500+0000","last_unstale":"2024-05-15T14:46:32.416034+0000","last_undegraded":"2024-05-15T14:46:32.416034+0000","last_fullsized":"2024-05-15T14:46:32.416034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:01.704595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"39'14","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410547+0000","last_change":"2024-05-15T14:27:52.844475+0000","last_active":"2024-05-15T14:45:12.410547+0000","last_peered":"2024-05-15T14:45:12.410547+0000","last_clean":"2024-05-15T14:45:12.410547+0000","last_became_active":"2024-05-15T14:27:52.844149+0000","last_became_peered":"2024-05-15T14:27:52.844149+0000","last_unstale":"2024-05-15T14:45:12.410547+0000","last_undegraded":"2024-05-15T14:45:12.410547+0000","last_fullsized":"2024-05-15T14:45:12.410547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:37.250864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.508491+0000","last_change":"2024-05-15T14:27:45.305663+0000","last_active":"2024-05-15T14:46:27.508491+0000","last_peered":"2024-05-15T14:46:27.508491+0000","last_clean":"2024-05-15T14:46:27.508491+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:46:27.508491+0000","last_undegraded":"2024-05-15T14:46:27.508491+0000","last_fullsized":"2024-05-15T14:46:27.508491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.415809+0000","last_change":"2024-05-15T14:27:50.845090+0000","last_active":"2024-05-15T14:45:57.415809+0000","last_peered":"2024-05-15T14:45:57.415809+0000","last_clean":"2024-05-15T14:45:57.415809+0000","last_became_active":"2024-05-15T14:27:50.844771+0000","last_became_peered":"2024-05-15T14:27:50.844771+0000","last_unstale":"2024-05-15T14:45:57.415809+0000","last_undegraded":"2024-05-15T14:45:57.415809+0000","last_fullsized":"2024-05-15T14:45:57.415809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:04.000024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"39'12","reported_seq":720,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.907972+0000","last_change":"2024-05-15T14:27:56.880418+0000","last_active":"2024-05-15T14:48:25.907972+0000","last_peered":"2024-05-15T14:48:25.907972+0000","last_clean":"2024-05-15T14:48:25.907972+0000","last_became_active":"2024-05-15T14:27:56.880109+0000","last_became_peered":"2024-05-15T14:27:56.880109+0000","last_unstale":"2024-05-15T14:48:25.907972+0000","last_undegraded":"2024-05-15T14:48:25.907972+0000","last_fullsized":"2024-05-15T14:48:25.907972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:59.299924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":688,"num_read_kb":700,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"39'271","reported_seq":763,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.707634+0000","last_change":"2024-05-15T14:27:58.888770+0000","last_active":"2024-05-15T14:47:52.707634+0000","last_peered":"2024-05-15T14:47:52.707634+0000","last_clean":"2024-05-15T14:47:52.707634+0000","last_became_active":"2024-05-15T14:27:58.888477+0000","last_became_peered":"2024-05-15T14:27:58.888477+0000","last_unstale":"2024-05-15T14:47:52.707634+0000","last_undegraded":"2024-05-15T14:47:52.707634+0000","last_fullsized":"2024-05-15T14:47:52.707634+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:12.868288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":392,"num_write":265,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.423189+0000","last_change":"2024-05-15T14:28:00.880873+0000","last_active":"2024-05-15T14:46:47.423189+0000","last_peered":"2024-05-15T14:46:47.423189+0000","last_clean":"2024-05-15T14:46:47.423189+0000","last_became_active":"2024-05-15T14:28:00.880488+0000","last_became_peered":"2024-05-15T14:28:00.880488+0000","last_unstale":"2024-05-15T14:46:47.423189+0000","last_undegraded":"2024-05-15T14:46:47.423189+0000","last_fullsized":"2024-05-15T14:46:47.423189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:05.734987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'21","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.357011+0000","last_change":"2024-05-15T14:28:02.894486+0000","last_active":"2024-05-15T14:46:21.357011+0000","last_peered":"2024-05-15T14:46:21.357011+0000","last_clean":"2024-05-15T14:46:21.357011+0000","last_became_active":"2024-05-15T14:28:02.893812+0000","last_became_peered":"2024-05-15T14:28:02.893812+0000","last_unstale":"2024-05-15T14:46:21.357011+0000","last_undegraded":"2024-05-15T14:46:21.357011+0000","last_fullsized":"2024-05-15T14:46:21.357011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:44.592465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":112,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.420985+0000","last_change":"2024-05-15T14:31:16.589892+0000","last_active":"2024-05-15T14:46:27.420985+0000","last_peered":"2024-05-15T14:46:27.420985+0000","last_clean":"2024-05-15T14:46:27.420985+0000","last_became_active":"2024-05-15T14:31:16.589610+0000","last_became_peered":"2024-05-15T14:31:16.589610+0000","last_unstale":"2024-05-15T14:46:27.420985+0000","last_undegraded":"2024-05-15T14:46:27.420985+0000","last_fullsized":"2024-05-15T14:46:27.420985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:19:18.238793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"39'4","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421245+0000","last_change":"2024-05-15T14:27:52.840002+0000","last_active":"2024-05-15T14:46:37.421245+0000","last_peered":"2024-05-15T14:46:37.421245+0000","last_clean":"2024-05-15T14:46:37.421245+0000","last_became_active":"2024-05-15T14:27:52.839722+0000","last_became_peered":"2024-05-15T14:27:52.839722+0000","last_unstale":"2024-05-15T14:46:37.421245+0000","last_undegraded":"2024-05-15T14:46:37.421245+0000","last_fullsized":"2024-05-15T14:46:37.421245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:19.868710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416067+0000","last_change":"2024-05-15T14:27:44.810023+0000","last_active":"2024-05-15T14:46:32.416067+0000","last_peered":"2024-05-15T14:46:32.416067+0000","last_clean":"2024-05-15T14:46:32.416067+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:46:32.416067+0000","last_undegraded":"2024-05-15T14:46:32.416067+0000","last_fullsized":"2024-05-15T14:46:32.416067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'16","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416855+0000","last_change":"2024-05-15T14:27:50.837385+0000","last_active":"2024-05-15T14:46:37.416855+0000","last_peered":"2024-05-15T14:46:37.416855+0000","last_clean":"2024-05-15T14:46:37.416855+0000","last_became_active":"2024-05-15T14:27:50.836731+0000","last_became_peered":"2024-05-15T14:27:50.836731+0000","last_unstale":"2024-05-15T14:46:37.416855+0000","last_undegraded":"2024-05-15T14:46:37.416855+0000","last_fullsized":"2024-05-15T14:46:37.416855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.423213+0000","last_change":"2024-05-15T14:27:56.880397+0000","last_active":"2024-05-15T14:46:47.423213+0000","last_peered":"2024-05-15T14:46:47.423213+0000","last_clean":"2024-05-15T14:46:47.423213+0000","last_became_active":"2024-05-15T14:27:56.880118+0000","last_became_peered":"2024-05-15T14:27:56.880118+0000","last_unstale":"2024-05-15T14:46:47.423213+0000","last_undegraded":"2024-05-15T14:46:47.423213+0000","last_fullsized":"2024-05-15T14:46:47.423213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:58.838634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"39'330","reported_seq":83275,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.651627+0000","last_change":"2024-05-15T14:27:58.882371+0000","last_active":"2024-05-15T14:47:52.651627+0000","last_peered":"2024-05-15T14:47:52.651627+0000","last_clean":"2024-05-15T14:47:52.651627+0000","last_became_active":"2024-05-15T14:27:58.882039+0000","last_became_peered":"2024-05-15T14:27:58.882039+0000","last_unstale":"2024-05-15T14:47:52.651627+0000","last_undegraded":"2024-05-15T14:47:52.651627+0000","last_fullsized":"2024-05-15T14:47:52.651627+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:34.425254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207654,"num_read_kb":557003,"num_write":353,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.407638+0000","last_change":"2024-05-15T14:28:00.887372+0000","last_active":"2024-05-15T14:45:22.407638+0000","last_peered":"2024-05-15T14:45:22.407638+0000","last_clean":"2024-05-15T14:45:22.407638+0000","last_became_active":"2024-05-15T14:28:00.887095+0000","last_became_peered":"2024-05-15T14:28:00.887095+0000","last_unstale":"2024-05-15T14:45:22.407638+0000","last_undegraded":"2024-05-15T14:45:22.407638+0000","last_fullsized":"2024-05-15T14:45:22.407638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:30.018180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"39'14","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.259616+0000","last_change":"2024-05-15T14:28:02.892539+0000","last_active":"2024-05-15T14:46:21.259616+0000","last_peered":"2024-05-15T14:46:21.259616+0000","last_clean":"2024-05-15T14:46:21.259616+0000","last_became_active":"2024-05-15T14:28:02.892255+0000","last_became_peered":"2024-05-15T14:28:02.892255+0000","last_unstale":"2024-05-15T14:46:21.259616+0000","last_undegraded":"2024-05-15T14:46:21.259616+0000","last_fullsized":"2024-05-15T14:46:21.259616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:27.053905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.404020+0000","last_change":"2024-05-15T14:31:16.593868+0000","last_active":"2024-05-15T14:44:52.404020+0000","last_peered":"2024-05-15T14:44:52.404020+0000","last_clean":"2024-05-15T14:44:52.404020+0000","last_became_active":"2024-05-15T14:31:16.593582+0000","last_became_peered":"2024-05-15T14:31:16.593582+0000","last_unstale":"2024-05-15T14:44:52.404020+0000","last_undegraded":"2024-05-15T14:44:52.404020+0000","last_fullsized":"2024-05-15T14:44:52.404020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:38:46.732341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'44","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327700+0000","last_change":"2024-05-15T14:27:52.851444+0000","last_active":"2024-05-15T14:47:54.327700+0000","last_peered":"2024-05-15T14:47:54.327700+0000","last_clean":"2024-05-15T14:47:54.327700+0000","last_became_active":"2024-05-15T14:27:52.851166+0000","last_became_peered":"2024-05-15T14:27:52.851166+0000","last_unstale":"2024-05-15T14:47:54.327700+0000","last_undegraded":"2024-05-15T14:47:54.327700+0000","last_fullsized":"2024-05-15T14:47:54.327700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:55.341565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":125,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"39'8","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.286095+0000","last_change":"2024-05-15T14:28:37.941507+0000","last_active":"2024-05-15T14:47:54.286095+0000","last_peered":"2024-05-15T14:47:54.286095+0000","last_clean":"2024-05-15T14:47:54.286095+0000","last_became_active":"2024-05-15T14:28:37.941149+0000","last_became_peered":"2024-05-15T14:28:37.941149+0000","last_unstale":"2024-05-15T14:47:54.286095+0000","last_undegraded":"2024-05-15T14:47:54.286095+0000","last_fullsized":"2024-05-15T14:47:54.286095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:15.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11,"num_write":32,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420426+0000","last_change":"2024-05-15T14:27:45.305199+0000","last_active":"2024-05-15T14:46:32.420426+0000","last_peered":"2024-05-15T14:46:32.420426+0000","last_clean":"2024-05-15T14:46:32.420426+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:46:32.420426+0000","last_undegraded":"2024-05-15T14:46:32.420426+0000","last_fullsized":"2024-05-15T14:46:32.420426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.422662+0000","last_change":"2024-05-15T14:27:56.881338+0000","last_active":"2024-05-15T14:46:42.422662+0000","last_peered":"2024-05-15T14:46:42.422662+0000","last_clean":"2024-05-15T14:46:42.422662+0000","last_became_active":"2024-05-15T14:27:56.881083+0000","last_became_peered":"2024-05-15T14:27:56.881083+0000","last_unstale":"2024-05-15T14:46:42.422662+0000","last_undegraded":"2024-05-15T14:46:42.422662+0000","last_fullsized":"2024-05-15T14:46:42.422662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:32.643557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"39'477","reported_seq":926,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.069846+0000","last_change":"2024-05-15T14:27:58.884245+0000","last_active":"2024-05-15T14:48:26.069846+0000","last_peered":"2024-05-15T14:48:26.069846+0000","last_clean":"2024-05-15T14:48:26.069846+0000","last_became_active":"2024-05-15T14:27:58.883886+0000","last_became_peered":"2024-05-15T14:27:58.883886+0000","last_unstale":"2024-05-15T14:48:26.069846+0000","last_undegraded":"2024-05-15T14:48:26.069846+0000","last_fullsized":"2024-05-15T14:48:26.069846+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:12.868288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1019,"num_read_kb":1275,"num_write":493,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418087+0000","last_change":"2024-05-15T14:28:00.884599+0000","last_active":"2024-05-15T14:46:47.418087+0000","last_peered":"2024-05-15T14:46:47.418087+0000","last_clean":"2024-05-15T14:46:47.418087+0000","last_became_active":"2024-05-15T14:28:00.884315+0000","last_became_peered":"2024-05-15T14:28:00.884315+0000","last_unstale":"2024-05-15T14:46:47.418087+0000","last_undegraded":"2024-05-15T14:46:47.418087+0000","last_fullsized":"2024-05-15T14:46:47.418087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:29.042984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"39'35","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.812135+0000","last_change":"2024-05-15T14:28:02.889405+0000","last_active":"2024-05-15T14:47:53.812135+0000","last_peered":"2024-05-15T14:47:53.812135+0000","last_clean":"2024-05-15T14:47:53.812135+0000","last_became_active":"2024-05-15T14:28:02.889093+0000","last_became_peered":"2024-05-15T14:28:02.889093+0000","last_unstale":"2024-05-15T14:47:53.812135+0000","last_undegraded":"2024-05-15T14:47:53.812135+0000","last_fullsized":"2024-05-15T14:47:53.812135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:25.077865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":151,"num_write":63,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.500408+0000","last_change":"2024-05-15T14:31:38.627137+0000","last_active":"2024-05-15T14:45:12.500408+0000","last_peered":"2024-05-15T14:45:12.500408+0000","last_clean":"2024-05-15T14:45:12.500408+0000","last_became_active":"2024-05-15T14:31:38.626777+0000","last_became_peered":"2024-05-15T14:31:38.626777+0000","last_unstale":"2024-05-15T14:45:12.500408+0000","last_undegraded":"2024-05-15T14:45:12.500408+0000","last_fullsized":"2024-05-15T14:45:12.500408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:25.663025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'50","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422119+0000","last_change":"2024-05-15T14:27:52.846446+0000","last_active":"2024-05-15T14:46:37.422119+0000","last_peered":"2024-05-15T14:46:37.422119+0000","last_clean":"2024-05-15T14:46:37.422119+0000","last_became_active":"2024-05-15T14:27:52.846171+0000","last_became_peered":"2024-05-15T14:27:52.846171+0000","last_unstale":"2024-05-15T14:46:37.422119+0000","last_undegraded":"2024-05-15T14:46:37.422119+0000","last_fullsized":"2024-05-15T14:46:37.422119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":163,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.421256+0000","last_change":"2024-05-15T14:27:50.845054+0000","last_active":"2024-05-15T14:46:37.421256+0000","last_peered":"2024-05-15T14:46:37.421256+0000","last_clean":"2024-05-15T14:46:37.421256+0000","last_became_active":"2024-05-15T14:27:50.844741+0000","last_became_peered":"2024-05-15T14:27:50.844741+0000","last_unstale":"2024-05-15T14:46:37.421256+0000","last_undegraded":"2024-05-15T14:46:37.421256+0000","last_fullsized":"2024-05-15T14:46:37.421256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:59:36.164522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":80,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519875+0000","last_change":"2024-05-15T14:27:45.305329+0000","last_active":"2024-05-15T14:46:32.519875+0000","last_peered":"2024-05-15T14:46:32.519875+0000","last_clean":"2024-05-15T14:46:32.519875+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:46:32.519875+0000","last_undegraded":"2024-05-15T14:46:32.519875+0000","last_fullsized":"2024-05-15T14:46:32.519875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:38:59.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416750+0000","last_change":"2024-05-15T14:27:56.881115+0000","last_active":"2024-05-15T14:46:42.416750+0000","last_peered":"2024-05-15T14:46:42.416750+0000","last_clean":"2024-05-15T14:46:42.416750+0000","last_became_active":"2024-05-15T14:27:56.880842+0000","last_became_peered":"2024-05-15T14:27:56.880842+0000","last_unstale":"2024-05-15T14:46:42.416750+0000","last_undegraded":"2024-05-15T14:46:42.416750+0000","last_fullsized":"2024-05-15T14:46:42.416750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:23.904400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"39'491","reported_seq":504318,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.715981+0000","last_change":"2024-05-15T14:27:58.882555+0000","last_active":"2024-05-15T14:47:52.715981+0000","last_peered":"2024-05-15T14:47:52.715981+0000","last_clean":"2024-05-15T14:47:52.715981+0000","last_became_active":"2024-05-15T14:27:58.882284+0000","last_became_peered":"2024-05-15T14:27:58.882284+0000","last_unstale":"2024-05-15T14:47:52.715981+0000","last_undegraded":"2024-05-15T14:47:52.715981+0000","last_fullsized":"2024-05-15T14:47:52.715981+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:50.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1259744,"num_read_kb":3777635,"num_write":703,"num_write_kb":2009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"39'924","reported_seq":1369,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.088738+0000","last_change":"2024-05-15T14:28:00.892454+0000","last_active":"2024-05-15T14:48:26.088738+0000","last_peered":"2024-05-15T14:48:26.088738+0000","last_clean":"2024-05-15T14:48:26.088738+0000","last_became_active":"2024-05-15T14:28:00.891484+0000","last_became_peered":"2024-05-15T14:28:00.891484+0000","last_unstale":"2024-05-15T14:48:26.088738+0000","last_undegraded":"2024-05-15T14:48:26.088738+0000","last_fullsized":"2024-05-15T14:48:26.088738+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:42.711145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"39'18","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.426893+0000","last_change":"2024-05-15T14:28:02.891735+0000","last_active":"2024-05-15T14:47:52.426893+0000","last_peered":"2024-05-15T14:47:52.426893+0000","last_clean":"2024-05-15T14:47:52.426893+0000","last_became_active":"2024-05-15T14:28:02.891380+0000","last_became_peered":"2024-05-15T14:28:02.891380+0000","last_unstale":"2024-05-15T14:47:52.426893+0000","last_undegraded":"2024-05-15T14:47:52.426893+0000","last_fullsized":"2024-05-15T14:47:52.426893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:22.867716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":35,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.505963+0000","last_change":"2024-05-15T14:31:16.594082+0000","last_active":"2024-05-15T14:44:47.505963+0000","last_peered":"2024-05-15T14:44:47.505963+0000","last_clean":"2024-05-15T14:44:47.505963+0000","last_became_active":"2024-05-15T14:31:16.593811+0000","last_became_peered":"2024-05-15T14:31:16.593811+0000","last_unstale":"2024-05-15T14:44:47.505963+0000","last_undegraded":"2024-05-15T14:44:47.505963+0000","last_fullsized":"2024-05-15T14:44:47.505963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:50:49.314475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"39'18","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509629+0000","last_change":"2024-05-15T14:28:37.942802+0000","last_active":"2024-05-15T14:46:37.509629+0000","last_peered":"2024-05-15T14:46:37.509629+0000","last_clean":"2024-05-15T14:46:37.509629+0000","last_became_active":"2024-05-15T14:28:37.942459+0000","last_became_peered":"2024-05-15T14:28:37.942459+0000","last_unstale":"2024-05-15T14:46:37.509629+0000","last_undegraded":"2024-05-15T14:46:37.509629+0000","last_fullsized":"2024-05-15T14:46:37.509629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512553+0000","last_change":"2024-05-15T14:27:50.854562+0000","last_active":"2024-05-15T14:45:12.512553+0000","last_peered":"2024-05-15T14:45:12.512553+0000","last_clean":"2024-05-15T14:45:12.512553+0000","last_became_active":"2024-05-15T14:27:50.854248+0000","last_became_peered":"2024-05-15T14:27:50.854248+0000","last_unstale":"2024-05-15T14:45:12.512553+0000","last_undegraded":"2024-05-15T14:45:12.512553+0000","last_fullsized":"2024-05-15T14:45:12.512553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:38.281851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":50,"num_write_kb":8823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:02.409522+0000","last_change":"2024-05-15T14:27:44.808690+0000","last_active":"2024-05-15T14:45:02.409522+0000","last_peered":"2024-05-15T14:45:02.409522+0000","last_clean":"2024-05-15T14:45:02.409522+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:45:02.409522+0000","last_undegraded":"2024-05-15T14:45:02.409522+0000","last_fullsized":"2024-05-15T14:45:02.409522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'1","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.417441+0000","last_change":"2024-05-15T14:27:56.876363+0000","last_active":"2024-05-15T14:46:42.417441+0000","last_peered":"2024-05-15T14:46:42.417441+0000","last_clean":"2024-05-15T14:46:42.417441+0000","last_became_active":"2024-05-15T14:27:56.875993+0000","last_became_peered":"2024-05-15T14:27:56.875993+0000","last_unstale":"2024-05-15T14:46:42.417441+0000","last_undegraded":"2024-05-15T14:46:42.417441+0000","last_fullsized":"2024-05-15T14:46:42.417441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"39'225","reported_seq":383,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.703454+0000","last_change":"2024-05-15T14:27:58.885451+0000","last_active":"2024-05-15T14:47:52.703454+0000","last_peered":"2024-05-15T14:47:52.703454+0000","last_clean":"2024-05-15T14:47:52.703454+0000","last_became_active":"2024-05-15T14:27:58.885090+0000","last_became_peered":"2024-05-15T14:27:58.885090+0000","last_unstale":"2024-05-15T14:47:52.703454+0000","last_undegraded":"2024-05-15T14:47:52.703454+0000","last_fullsized":"2024-05-15T14:47:52.703454+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.266839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"39'924","reported_seq":1442,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.234813+0000","last_change":"2024-05-15T14:28:00.887968+0000","last_active":"2024-05-15T14:48:26.234813+0000","last_peered":"2024-05-15T14:48:26.234813+0000","last_clean":"2024-05-15T14:48:26.234813+0000","last_became_active":"2024-05-15T14:28:00.884286+0000","last_became_peered":"2024-05-15T14:28:00.884286+0000","last_unstale":"2024-05-15T14:48:26.234813+0000","last_undegraded":"2024-05-15T14:48:26.234813+0000","last_fullsized":"2024-05-15T14:48:26.234813+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:52.523948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"39'24","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.774098+0000","last_change":"2024-05-15T14:28:02.892844+0000","last_active":"2024-05-15T14:47:53.774098+0000","last_peered":"2024-05-15T14:47:53.774098+0000","last_clean":"2024-05-15T14:47:53.774098+0000","last_became_active":"2024-05-15T14:28:02.891822+0000","last_became_peered":"2024-05-15T14:28:02.891822+0000","last_unstale":"2024-05-15T14:47:53.774098+0000","last_undegraded":"2024-05-15T14:47:53.774098+0000","last_fullsized":"2024-05-15T14:47:53.774098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.509354+0000","last_change":"2024-05-15T14:31:16.596256+0000","last_active":"2024-05-15T14:44:47.509354+0000","last_peered":"2024-05-15T14:44:47.509354+0000","last_clean":"2024-05-15T14:44:47.509354+0000","last_became_active":"2024-05-15T14:31:16.595913+0000","last_became_peered":"2024-05-15T14:31:16.595913+0000","last_unstale":"2024-05-15T14:44:47.509354+0000","last_undegraded":"2024-05-15T14:44:47.509354+0000","last_fullsized":"2024-05-15T14:44:47.509354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:23:10.278842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"39'16","reported_seq":115,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416789+0000","last_change":"2024-05-15T14:27:52.848596+0000","last_active":"2024-05-15T14:46:37.416789+0000","last_peered":"2024-05-15T14:46:37.416789+0000","last_clean":"2024-05-15T14:46:37.416789+0000","last_became_active":"2024-05-15T14:27:52.848087+0000","last_became_peered":"2024-05-15T14:27:52.848087+0000","last_unstale":"2024-05-15T14:46:37.416789+0000","last_undegraded":"2024-05-15T14:46:37.416789+0000","last_fullsized":"2024-05-15T14:46:37.416789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.412695+0000","last_change":"2024-05-15T14:27:50.840684+0000","last_active":"2024-05-15T14:45:12.412695+0000","last_peered":"2024-05-15T14:45:12.412695+0000","last_clean":"2024-05-15T14:45:12.412695+0000","last_became_active":"2024-05-15T14:27:50.840365+0000","last_became_peered":"2024-05-15T14:27:50.840365+0000","last_unstale":"2024-05-15T14:45:12.412695+0000","last_undegraded":"2024-05-15T14:45:12.412695+0000","last_fullsized":"2024-05-15T14:45:12.412695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:31.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:07.405827+0000","last_change":"2024-05-15T14:27:44.808595+0000","last_active":"2024-05-15T14:45:07.405827+0000","last_peered":"2024-05-15T14:45:07.405827+0000","last_clean":"2024-05-15T14:45:07.405827+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:45:07.405827+0000","last_undegraded":"2024-05-15T14:45:07.405827+0000","last_fullsized":"2024-05-15T14:45:07.405827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"39'12","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.595287+0000","last_change":"2024-05-15T14:27:56.875443+0000","last_active":"2024-05-15T14:47:21.595287+0000","last_peered":"2024-05-15T14:47:21.595287+0000","last_clean":"2024-05-15T14:47:21.595287+0000","last_became_active":"2024-05-15T14:27:56.875166+0000","last_became_peered":"2024-05-15T14:27:56.875166+0000","last_unstale":"2024-05-15T14:47:21.595287+0000","last_undegraded":"2024-05-15T14:47:21.595287+0000","last_fullsized":"2024-05-15T14:47:21.595287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'539","reported_seq":951,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.019444+0000","last_change":"2024-05-15T14:27:58.881816+0000","last_active":"2024-05-15T14:48:26.019444+0000","last_peered":"2024-05-15T14:48:26.019444+0000","last_clean":"2024-05-15T14:48:26.019444+0000","last_became_active":"2024-05-15T14:27:58.881529+0000","last_became_peered":"2024-05-15T14:27:58.881529+0000","last_unstale":"2024-05-15T14:48:26.019444+0000","last_undegraded":"2024-05-15T14:48:26.019444+0000","last_fullsized":"2024-05-15T14:48:26.019444+0000","mapping_epoch":26,"log_start":"39'500","ondisk_log_start":"39'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:44.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":949,"num_read_kb":979,"num_write":696,"num_write_kb":2669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.526053+0000","last_change":"2024-05-15T14:28:00.892129+0000","last_active":"2024-05-15T14:46:47.526053+0000","last_peered":"2024-05-15T14:46:47.526053+0000","last_clean":"2024-05-15T14:46:47.526053+0000","last_became_active":"2024-05-15T14:28:00.890685+0000","last_became_peered":"2024-05-15T14:28:00.890685+0000","last_unstale":"2024-05-15T14:46:47.526053+0000","last_undegraded":"2024-05-15T14:46:47.526053+0000","last_fullsized":"2024-05-15T14:46:47.526053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:33.793001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"39'29","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.787639+0000","last_change":"2024-05-15T14:28:02.893523+0000","last_active":"2024-05-15T14:47:53.787639+0000","last_peered":"2024-05-15T14:47:53.787639+0000","last_clean":"2024-05-15T14:47:53.787639+0000","last_became_active":"2024-05-15T14:28:02.893174+0000","last_became_peered":"2024-05-15T14:28:02.893174+0000","last_unstale":"2024-05-15T14:47:53.787639+0000","last_undegraded":"2024-05-15T14:47:53.787639+0000","last_fullsized":"2024-05-15T14:47:53.787639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.413812+0000","last_change":"2024-05-15T14:31:16.593175+0000","last_active":"2024-05-15T14:45:22.413812+0000","last_peered":"2024-05-15T14:45:22.413812+0000","last_clean":"2024-05-15T14:45:22.413812+0000","last_became_active":"2024-05-15T14:31:16.592898+0000","last_became_peered":"2024-05-15T14:31:16.592898+0000","last_unstale":"2024-05-15T14:45:22.413812+0000","last_undegraded":"2024-05-15T14:45:22.413812+0000","last_fullsized":"2024-05-15T14:45:22.413812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:15.668825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'26","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.789319+0000","last_change":"2024-05-15T14:28:02.893742+0000","last_active":"2024-05-15T14:47:53.789319+0000","last_peered":"2024-05-15T14:47:53.789319+0000","last_clean":"2024-05-15T14:47:53.789319+0000","last_became_active":"2024-05-15T14:28:02.892547+0000","last_became_peered":"2024-05-15T14:28:02.892547+0000","last_unstale":"2024-05-15T14:47:53.789319+0000","last_undegraded":"2024-05-15T14:47:53.789319+0000","last_fullsized":"2024-05-15T14:47:53.789319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:30:24.259350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":37,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"39'44","reported_seq":129,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416184+0000","last_change":"2024-05-15T14:27:52.842978+0000","last_active":"2024-05-15T14:46:32.416184+0000","last_peered":"2024-05-15T14:46:32.416184+0000","last_clean":"2024-05-15T14:46:32.416184+0000","last_became_active":"2024-05-15T14:27:52.842733+0000","last_became_peered":"2024-05-15T14:27:52.842733+0000","last_unstale":"2024-05-15T14:46:32.416184+0000","last_undegraded":"2024-05-15T14:46:32.416184+0000","last_fullsized":"2024-05-15T14:46:32.416184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":143,"num_write":62,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"39'22","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:17.514606+0000","last_change":"2024-05-15T14:28:37.941321+0000","last_active":"2024-05-15T14:47:17.514606+0000","last_peered":"2024-05-15T14:47:17.514606+0000","last_clean":"2024-05-15T14:47:17.514606+0000","last_became_active":"2024-05-15T14:28:37.940961+0000","last_became_peered":"2024-05-15T14:28:37.940961+0000","last_unstale":"2024-05-15T14:47:17.514606+0000","last_undegraded":"2024-05-15T14:47:17.514606+0000","last_fullsized":"2024-05-15T14:47:17.514606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:20.511289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":33493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'2","reported_seq":1004,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.918986+0000","last_change":"2024-05-15T14:27:56.879335+0000","last_active":"2024-05-15T14:48:25.918986+0000","last_peered":"2024-05-15T14:48:25.918986+0000","last_clean":"2024-05-15T14:48:25.918986+0000","last_became_active":"2024-05-15T14:27:56.879047+0000","last_became_peered":"2024-05-15T14:27:56.879047+0000","last_unstale":"2024-05-15T14:48:25.918986+0000","last_undegraded":"2024-05-15T14:48:25.918986+0000","last_fullsized":"2024-05-15T14:48:25.918986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:55.716648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"39'700","reported_seq":1150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.045495+0000","last_change":"2024-05-15T14:27:58.882036+0000","last_active":"2024-05-15T14:48:26.045495+0000","last_peered":"2024-05-15T14:48:26.045495+0000","last_clean":"2024-05-15T14:48:26.045495+0000","last_became_active":"2024-05-15T14:27:58.881703+0000","last_became_peered":"2024-05-15T14:27:58.881703+0000","last_unstale":"2024-05-15T14:48:26.045495+0000","last_undegraded":"2024-05-15T14:48:26.045495+0000","last_fullsized":"2024-05-15T14:48:26.045495+0000","mapping_epoch":26,"log_start":"39'600","ondisk_log_start":"39'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1566,"num_read_kb":3600,"num_write":907,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.505836+0000","last_change":"2024-05-15T14:28:00.884111+0000","last_active":"2024-05-15T14:44:22.505836+0000","last_peered":"2024-05-15T14:44:22.505836+0000","last_clean":"2024-05-15T14:44:22.505836+0000","last_became_active":"2024-05-15T14:28:00.883811+0000","last_became_peered":"2024-05-15T14:28:00.883811+0000","last_unstale":"2024-05-15T14:44:22.505836+0000","last_undegraded":"2024-05-15T14:44:22.505836+0000","last_fullsized":"2024-05-15T14:44:22.505836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:25.050335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.415259+0000","last_change":"2024-05-15T14:31:16.592460+0000","last_active":"2024-05-15T14:45:52.415259+0000","last_peered":"2024-05-15T14:45:52.415259+0000","last_clean":"2024-05-15T14:45:52.415259+0000","last_became_active":"2024-05-15T14:31:16.592053+0000","last_became_peered":"2024-05-15T14:31:16.592053+0000","last_unstale":"2024-05-15T14:45:52.415259+0000","last_undegraded":"2024-05-15T14:45:52.415259+0000","last_fullsized":"2024-05-15T14:45:52.415259+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:36.246607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"39'29","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.772545+0000","last_change":"2024-05-15T14:28:02.894336+0000","last_active":"2024-05-15T14:47:53.772545+0000","last_peered":"2024-05-15T14:47:53.772545+0000","last_clean":"2024-05-15T14:47:53.772545+0000","last_became_active":"2024-05-15T14:28:02.894053+0000","last_became_peered":"2024-05-15T14:28:02.894053+0000","last_unstale":"2024-05-15T14:47:53.772545+0000","last_undegraded":"2024-05-15T14:47:53.772545+0000","last_fullsized":"2024-05-15T14:47:53.772545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:49:32.038155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"39'12","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420386+0000","last_change":"2024-05-15T14:27:52.849694+0000","last_active":"2024-05-15T14:46:32.420386+0000","last_peered":"2024-05-15T14:46:32.420386+0000","last_clean":"2024-05-15T14:46:32.420386+0000","last_became_active":"2024-05-15T14:27:52.849013+0000","last_became_peered":"2024-05-15T14:27:52.849013+0000","last_unstale":"2024-05-15T14:46:32.420386+0000","last_undegraded":"2024-05-15T14:46:32.420386+0000","last_fullsized":"2024-05-15T14:46:32.420386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:16.565935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"39'12","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.505977+0000","last_change":"2024-05-15T14:27:50.853302+0000","last_active":"2024-05-15T14:44:47.505977+0000","last_peered":"2024-05-15T14:44:47.505977+0000","last_clean":"2024-05-15T14:44:47.505977+0000","last_became_active":"2024-05-15T14:27:50.852755+0000","last_became_peered":"2024-05-15T14:27:50.852755+0000","last_unstale":"2024-05-15T14:44:47.505977+0000","last_undegraded":"2024-05-15T14:44:47.505977+0000","last_fullsized":"2024-05-15T14:44:47.505977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:17.505272+0000","last_change":"2024-05-15T14:27:56.883749+0000","last_active":"2024-05-15T14:44:17.505272+0000","last_peered":"2024-05-15T14:44:17.505272+0000","last_clean":"2024-05-15T14:44:17.505272+0000","last_became_active":"2024-05-15T14:27:56.883312+0000","last_became_peered":"2024-05-15T14:27:56.883312+0000","last_unstale":"2024-05-15T14:44:17.505272+0000","last_undegraded":"2024-05-15T14:44:17.505272+0000","last_fullsized":"2024-05-15T14:44:17.505272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'158","reported_seq":222582,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.527715+0000","last_change":"2024-05-15T14:27:58.884965+0000","last_active":"2024-05-15T14:47:52.527715+0000","last_peered":"2024-05-15T14:47:52.527715+0000","last_clean":"2024-05-15T14:47:52.527715+0000","last_became_active":"2024-05-15T14:27:58.884647+0000","last_became_peered":"2024-05-15T14:27:58.884647+0000","last_unstale":"2024-05-15T14:47:52.527715+0000","last_undegraded":"2024-05-15T14:47:52.527715+0000","last_fullsized":"2024-05-15T14:47:52.527715+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:11.016089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555956,"num_read_kb":2334405,"num_write":176,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.502471+0000","last_change":"2024-05-15T14:28:00.889155+0000","last_active":"2024-05-15T14:44:22.502471+0000","last_peered":"2024-05-15T14:44:22.502471+0000","last_clean":"2024-05-15T14:44:22.502471+0000","last_became_active":"2024-05-15T14:28:00.888834+0000","last_became_peered":"2024-05-15T14:28:00.888834+0000","last_unstale":"2024-05-15T14:44:22.502471+0000","last_undegraded":"2024-05-15T14:44:22.502471+0000","last_fullsized":"2024-05-15T14:44:22.502471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:51.080731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.419945+0000","last_change":"2024-05-15T14:31:16.594403+0000","last_active":"2024-05-15T14:46:17.419945+0000","last_peered":"2024-05-15T14:46:17.419945+0000","last_clean":"2024-05-15T14:46:17.419945+0000","last_became_active":"2024-05-15T14:31:16.594114+0000","last_became_peered":"2024-05-15T14:31:16.594114+0000","last_unstale":"2024-05-15T14:46:17.419945+0000","last_undegraded":"2024-05-15T14:46:17.419945+0000","last_fullsized":"2024-05-15T14:46:17.419945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:24.367502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"39'28","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.331459+0000","last_change":"2024-05-15T14:28:02.890351+0000","last_active":"2024-05-15T14:47:54.331459+0000","last_peered":"2024-05-15T14:47:54.331459+0000","last_clean":"2024-05-15T14:47:54.331459+0000","last_became_active":"2024-05-15T14:28:02.890071+0000","last_became_peered":"2024-05-15T14:28:02.890071+0000","last_unstale":"2024-05-15T14:47:54.331459+0000","last_undegraded":"2024-05-15T14:47:54.331459+0000","last_fullsized":"2024-05-15T14:47:54.331459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":114,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'10","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.523980+0000","last_change":"2024-05-15T14:27:52.852243+0000","last_active":"2024-05-15T14:46:32.523980+0000","last_peered":"2024-05-15T14:46:32.523980+0000","last_clean":"2024-05-15T14:46:32.523980+0000","last_became_active":"2024-05-15T14:27:52.851940+0000","last_became_peered":"2024-05-15T14:27:52.851940+0000","last_unstale":"2024-05-15T14:46:32.523980+0000","last_undegraded":"2024-05-15T14:46:32.523980+0000","last_fullsized":"2024-05-15T14:46:32.523980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403389+0000","last_change":"2024-05-15T14:27:50.846653+0000","last_active":"2024-05-15T14:44:47.403389+0000","last_peered":"2024-05-15T14:44:47.403389+0000","last_clean":"2024-05-15T14:44:47.403389+0000","last_became_active":"2024-05-15T14:27:50.846362+0000","last_became_peered":"2024-05-15T14:27:50.846362+0000","last_unstale":"2024-05-15T14:44:47.403389+0000","last_undegraded":"2024-05-15T14:44:47.403389+0000","last_fullsized":"2024-05-15T14:44:47.403389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"39'11","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.464655+0000","last_change":"2024-05-15T14:27:56.878406+0000","last_active":"2024-05-15T14:47:21.464655+0000","last_peered":"2024-05-15T14:47:21.464655+0000","last_clean":"2024-05-15T14:47:21.464655+0000","last_became_active":"2024-05-15T14:27:56.877413+0000","last_became_peered":"2024-05-15T14:27:56.877413+0000","last_unstale":"2024-05-15T14:47:21.464655+0000","last_undegraded":"2024-05-15T14:47:21.464655+0000","last_fullsized":"2024-05-15T14:47:21.464655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:59.085552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"39'246","reported_seq":460,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.003273+0000","last_change":"2024-05-15T14:27:58.881927+0000","last_active":"2024-05-15T14:48:26.003273+0000","last_peered":"2024-05-15T14:48:26.003273+0000","last_clean":"2024-05-15T14:48:26.003273+0000","last_became_active":"2024-05-15T14:27:58.881581+0000","last_became_peered":"2024-05-15T14:27:58.881581+0000","last_unstale":"2024-05-15T14:48:26.003273+0000","last_undegraded":"2024-05-15T14:48:26.003273+0000","last_fullsized":"2024-05-15T14:48:26.003273+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:40.707496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":385,"num_write":222,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.400519+0000","last_change":"2024-05-15T14:28:00.888057+0000","last_active":"2024-05-15T14:44:22.400519+0000","last_peered":"2024-05-15T14:44:22.400519+0000","last_clean":"2024-05-15T14:44:22.400519+0000","last_became_active":"2024-05-15T14:28:00.887738+0000","last_became_peered":"2024-05-15T14:28:00.887738+0000","last_unstale":"2024-05-15T14:44:22.400519+0000","last_undegraded":"2024-05-15T14:44:22.400519+0000","last_fullsized":"2024-05-15T14:44:22.400519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:59.723993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:17.419981+0000","last_change":"2024-05-15T14:31:16.591389+0000","last_active":"2024-05-15T14:46:17.419981+0000","last_peered":"2024-05-15T14:46:17.419981+0000","last_clean":"2024-05-15T14:46:17.419981+0000","last_became_active":"2024-05-15T14:31:16.590502+0000","last_became_peered":"2024-05-15T14:31:16.590502+0000","last_unstale":"2024-05-15T14:46:17.419981+0000","last_undegraded":"2024-05-15T14:46:17.419981+0000","last_fullsized":"2024-05-15T14:46:17.419981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:58:48.832872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'26","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.780086+0000","last_change":"2024-05-15T14:28:02.895306+0000","last_active":"2024-05-15T14:47:53.780086+0000","last_peered":"2024-05-15T14:47:53.780086+0000","last_clean":"2024-05-15T14:47:53.780086+0000","last_became_active":"2024-05-15T14:28:02.894280+0000","last_became_peered":"2024-05-15T14:28:02.894280+0000","last_unstale":"2024-05-15T14:47:53.780086+0000","last_undegraded":"2024-05-15T14:47:53.780086+0000","last_fullsized":"2024-05-15T14:47:53.780086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"39'66","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814583+0000","last_change":"2024-05-15T14:27:52.862502+0000","last_active":"2024-05-15T14:47:53.814583+0000","last_peered":"2024-05-15T14:47:53.814583+0000","last_clean":"2024-05-15T14:47:53.814583+0000","last_became_active":"2024-05-15T14:27:52.862259+0000","last_became_peered":"2024-05-15T14:27:52.862259+0000","last_unstale":"2024-05-15T14:47:53.814583+0000","last_undegraded":"2024-05-15T14:47:53.814583+0000","last_fullsized":"2024-05-15T14:47:53.814583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":205,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"39'8","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.409935+0000","last_change":"2024-05-15T14:27:50.844225+0000","last_active":"2024-05-15T14:44:47.409935+0000","last_peered":"2024-05-15T14:44:47.409935+0000","last_clean":"2024-05-15T14:44:47.409935+0000","last_became_active":"2024-05-15T14:27:50.843223+0000","last_became_peered":"2024-05-15T14:27:50.843223+0000","last_unstale":"2024-05-15T14:44:47.409935+0000","last_undegraded":"2024-05-15T14:44:47.409935+0000","last_fullsized":"2024-05-15T14:44:47.409935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"39'9","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.466203+0000","last_change":"2024-05-15T14:27:56.880459+0000","last_active":"2024-05-15T14:47:21.466203+0000","last_peered":"2024-05-15T14:47:21.466203+0000","last_clean":"2024-05-15T14:47:21.466203+0000","last_became_active":"2024-05-15T14:27:56.879589+0000","last_became_peered":"2024-05-15T14:27:56.879589+0000","last_unstale":"2024-05-15T14:47:21.466203+0000","last_undegraded":"2024-05-15T14:47:21.466203+0000","last_fullsized":"2024-05-15T14:47:21.466203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:15.202251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"39'199","reported_seq":391,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.993044+0000","last_change":"2024-05-15T14:27:58.885088+0000","last_active":"2024-05-15T14:48:25.993044+0000","last_peered":"2024-05-15T14:48:25.993044+0000","last_clean":"2024-05-15T14:48:25.993044+0000","last_became_active":"2024-05-15T14:27:58.884831+0000","last_became_peered":"2024-05-15T14:27:58.884831+0000","last_unstale":"2024-05-15T14:48:25.993044+0000","last_undegraded":"2024-05-15T14:48:25.993044+0000","last_fullsized":"2024-05-15T14:48:25.993044+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:27.597755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":320,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:22.406922+0000","last_change":"2024-05-15T14:28:00.887876+0000","last_active":"2024-05-15T14:44:22.406922+0000","last_peered":"2024-05-15T14:44:22.406922+0000","last_clean":"2024-05-15T14:44:22.406922+0000","last_became_active":"2024-05-15T14:28:00.887513+0000","last_became_peered":"2024-05-15T14:28:00.887513+0000","last_unstale":"2024-05-15T14:44:22.406922+0000","last_undegraded":"2024-05-15T14:44:22.406922+0000","last_fullsized":"2024-05-15T14:44:22.406922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:42.711145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407243+0000","last_change":"2024-05-15T14:31:16.594526+0000","last_active":"2024-05-15T14:45:17.407243+0000","last_peered":"2024-05-15T14:45:17.407243+0000","last_clean":"2024-05-15T14:45:17.407243+0000","last_became_active":"2024-05-15T14:31:16.594193+0000","last_became_peered":"2024-05-15T14:31:16.594193+0000","last_unstale":"2024-05-15T14:45:17.407243+0000","last_undegraded":"2024-05-15T14:45:17.407243+0000","last_fullsized":"2024-05-15T14:45:17.407243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:15:13.565975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"39'20","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814088+0000","last_change":"2024-05-15T14:27:52.847892+0000","last_active":"2024-05-15T14:47:53.814088+0000","last_peered":"2024-05-15T14:47:53.814088+0000","last_clean":"2024-05-15T14:47:53.814088+0000","last_became_active":"2024-05-15T14:27:52.847609+0000","last_became_peered":"2024-05-15T14:27:52.847609+0000","last_unstale":"2024-05-15T14:47:53.814088+0000","last_undegraded":"2024-05-15T14:47:53.814088+0000","last_fullsized":"2024-05-15T14:47:53.814088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:45.470476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":78,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.509233+0000","last_change":"2024-05-15T14:27:50.850851+0000","last_active":"2024-05-15T14:44:47.509233+0000","last_peered":"2024-05-15T14:44:47.509233+0000","last_clean":"2024-05-15T14:44:47.509233+0000","last_became_active":"2024-05-15T14:27:50.850524+0000","last_became_peered":"2024-05-15T14:27:50.850524+0000","last_unstale":"2024-05-15T14:44:47.509233+0000","last_undegraded":"2024-05-15T14:44:47.509233+0000","last_fullsized":"2024-05-15T14:44:47.509233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":18802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"39'11","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.908765+0000","last_change":"2024-05-15T14:27:56.882053+0000","last_active":"2024-05-15T14:48:25.908765+0000","last_peered":"2024-05-15T14:48:25.908765+0000","last_clean":"2024-05-15T14:48:25.908765+0000","last_became_active":"2024-05-15T14:27:56.881789+0000","last_became_peered":"2024-05-15T14:27:56.881789+0000","last_unstale":"2024-05-15T14:48:25.908765+0000","last_undegraded":"2024-05-15T14:48:25.908765+0000","last_fullsized":"2024-05-15T14:48:25.908765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:42.831889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":178,"num_write":22,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"39'270","reported_seq":550,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.063817+0000","last_change":"2024-05-15T14:27:58.887437+0000","last_active":"2024-05-15T14:48:26.063817+0000","last_peered":"2024-05-15T14:48:26.063817+0000","last_clean":"2024-05-15T14:48:26.063817+0000","last_became_active":"2024-05-15T14:27:58.887134+0000","last_became_peered":"2024-05-15T14:27:58.887134+0000","last_unstale":"2024-05-15T14:48:26.063817+0000","last_undegraded":"2024-05-15T14:48:26.063817+0000","last_fullsized":"2024-05-15T14:48:26.063817+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:48.300102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":460,"num_read_kb":450,"num_write":224,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.409142+0000","last_change":"2024-05-15T14:28:00.885482+0000","last_active":"2024-05-15T14:45:32.409142+0000","last_peered":"2024-05-15T14:45:32.409142+0000","last_clean":"2024-05-15T14:45:32.409142+0000","last_became_active":"2024-05-15T14:28:00.885174+0000","last_became_peered":"2024-05-15T14:28:00.885174+0000","last_unstale":"2024-05-15T14:45:32.409142+0000","last_undegraded":"2024-05-15T14:45:32.409142+0000","last_fullsized":"2024-05-15T14:45:32.409142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:03.551642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"39'30","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.322341+0000","last_change":"2024-05-15T14:28:02.894975+0000","last_active":"2024-05-15T14:47:54.322341+0000","last_peered":"2024-05-15T14:47:54.322341+0000","last_clean":"2024-05-15T14:47:54.322341+0000","last_became_active":"2024-05-15T14:28:02.894515+0000","last_became_peered":"2024-05-15T14:28:02.894515+0000","last_unstale":"2024-05-15T14:47:54.322341+0000","last_undegraded":"2024-05-15T14:47:54.322341+0000","last_fullsized":"2024-05-15T14:47:54.322341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:48.703371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.510012+0000","last_change":"2024-05-15T14:31:16.589730+0000","last_active":"2024-05-15T14:45:17.510012+0000","last_peered":"2024-05-15T14:45:17.510012+0000","last_clean":"2024-05-15T14:45:17.510012+0000","last_became_active":"2024-05-15T14:31:16.589442+0000","last_became_peered":"2024-05-15T14:31:16.589442+0000","last_unstale":"2024-05-15T14:45:17.510012+0000","last_undegraded":"2024-05-15T14:45:17.510012+0000","last_fullsized":"2024-05-15T14:45:17.510012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:32:21.556315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"39'56","reported_seq":140,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814321+0000","last_change":"2024-05-15T14:27:52.845888+0000","last_active":"2024-05-15T14:47:53.814321+0000","last_peered":"2024-05-15T14:47:53.814321+0000","last_clean":"2024-05-15T14:47:53.814321+0000","last_became_active":"2024-05-15T14:27:52.845557+0000","last_became_peered":"2024-05-15T14:27:52.845557+0000","last_unstale":"2024-05-15T14:47:53.814321+0000","last_undegraded":"2024-05-15T14:47:53.814321+0000","last_fullsized":"2024-05-15T14:47:53.814321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":171,"num_write":80,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"39'10","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.408489+0000","last_change":"2024-05-15T14:27:50.850506+0000","last_active":"2024-05-15T14:44:52.408489+0000","last_peered":"2024-05-15T14:44:52.408489+0000","last_clean":"2024-05-15T14:44:52.408489+0000","last_became_active":"2024-05-15T14:27:50.850175+0000","last_became_peered":"2024-05-15T14:27:50.850175+0000","last_unstale":"2024-05-15T14:44:52.408489+0000","last_undegraded":"2024-05-15T14:44:52.408489+0000","last_fullsized":"2024-05-15T14:44:52.408489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416792+0000","last_change":"2024-05-15T14:27:56.879893+0000","last_active":"2024-05-15T14:46:42.416792+0000","last_peered":"2024-05-15T14:46:42.416792+0000","last_clean":"2024-05-15T14:46:42.416792+0000","last_became_active":"2024-05-15T14:27:56.879634+0000","last_became_peered":"2024-05-15T14:27:56.879634+0000","last_unstale":"2024-05-15T14:46:42.416792+0000","last_undegraded":"2024-05-15T14:46:42.416792+0000","last_fullsized":"2024-05-15T14:46:42.416792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:06.597029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"39'500","reported_seq":1244,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.997567+0000","last_change":"2024-05-15T14:27:58.887413+0000","last_active":"2024-05-15T14:48:25.997567+0000","last_peered":"2024-05-15T14:48:25.997567+0000","last_clean":"2024-05-15T14:48:25.997567+0000","last_became_active":"2024-05-15T14:27:58.887144+0000","last_became_peered":"2024-05-15T14:27:58.887144+0000","last_unstale":"2024-05-15T14:48:25.997567+0000","last_undegraded":"2024-05-15T14:48:25.997567+0000","last_fullsized":"2024-05-15T14:48:25.997567+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:56.197135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":997,"num_read_kb":904,"num_write":673,"num_write_kb":1754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.412930+0000","last_change":"2024-05-15T14:28:00.891661+0000","last_active":"2024-05-15T14:45:32.412930+0000","last_peered":"2024-05-15T14:45:32.412930+0000","last_clean":"2024-05-15T14:45:32.412930+0000","last_became_active":"2024-05-15T14:28:00.891343+0000","last_became_peered":"2024-05-15T14:28:00.891343+0000","last_unstale":"2024-05-15T14:45:32.412930+0000","last_undegraded":"2024-05-15T14:45:32.412930+0000","last_fullsized":"2024-05-15T14:45:32.412930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:29.432233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"39'31","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.248871+0000","last_change":"2024-05-15T14:28:02.890221+0000","last_active":"2024-05-15T14:46:21.248871+0000","last_peered":"2024-05-15T14:46:21.248871+0000","last_clean":"2024-05-15T14:46:21.248871+0000","last_became_active":"2024-05-15T14:28:02.889940+0000","last_became_peered":"2024-05-15T14:28:02.889940+0000","last_unstale":"2024-05-15T14:46:21.248871+0000","last_undegraded":"2024-05-15T14:46:21.248871+0000","last_fullsized":"2024-05-15T14:46:21.248871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:48.842803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":111,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407852+0000","last_change":"2024-05-15T14:31:16.590555+0000","last_active":"2024-05-15T14:45:17.407852+0000","last_peered":"2024-05-15T14:45:17.407852+0000","last_clean":"2024-05-15T14:45:17.407852+0000","last_became_active":"2024-05-15T14:31:16.590270+0000","last_became_peered":"2024-05-15T14:31:16.590270+0000","last_unstale":"2024-05-15T14:45:17.407852+0000","last_undegraded":"2024-05-15T14:45:17.407852+0000","last_fullsized":"2024-05-15T14:45:17.407852+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:01:05.887839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'14","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.807073+0000","last_change":"2024-05-15T14:27:52.861766+0000","last_active":"2024-05-15T14:47:53.807073+0000","last_peered":"2024-05-15T14:47:53.807073+0000","last_clean":"2024-05-15T14:47:53.807073+0000","last_became_active":"2024-05-15T14:27:52.861459+0000","last_became_peered":"2024-05-15T14:27:52.861459+0000","last_unstale":"2024-05-15T14:47:53.807073+0000","last_undegraded":"2024-05-15T14:47:53.807073+0000","last_fullsized":"2024-05-15T14:47:53.807073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408411+0000","last_change":"2024-05-15T14:27:50.836665+0000","last_active":"2024-05-15T14:45:22.408411+0000","last_peered":"2024-05-15T14:45:22.408411+0000","last_clean":"2024-05-15T14:45:22.408411+0000","last_became_active":"2024-05-15T14:27:50.836343+0000","last_became_peered":"2024-05-15T14:27:50.836343+0000","last_unstale":"2024-05-15T14:45:22.408411+0000","last_undegraded":"2024-05-15T14:45:22.408411+0000","last_fullsized":"2024-05-15T14:45:22.408411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:38.935625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:27.408960+0000","last_change":"2024-05-15T14:27:56.877775+0000","last_active":"2024-05-15T14:45:27.408960+0000","last_peered":"2024-05-15T14:45:27.408960+0000","last_clean":"2024-05-15T14:45:27.408960+0000","last_became_active":"2024-05-15T14:27:56.876994+0000","last_became_peered":"2024-05-15T14:27:56.876994+0000","last_unstale":"2024-05-15T14:45:27.408960+0000","last_undegraded":"2024-05-15T14:45:27.408960+0000","last_fullsized":"2024-05-15T14:45:27.408960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"39'247","reported_seq":467,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.058303+0000","last_change":"2024-05-15T14:27:58.877101+0000","last_active":"2024-05-15T14:48:26.058303+0000","last_peered":"2024-05-15T14:48:26.058303+0000","last_clean":"2024-05-15T14:48:26.058303+0000","last_became_active":"2024-05-15T14:27:58.876807+0000","last_became_peered":"2024-05-15T14:27:58.876807+0000","last_unstale":"2024-05-15T14:48:26.058303+0000","last_undegraded":"2024-05-15T14:48:26.058303+0000","last_fullsized":"2024-05-15T14:48:26.058303+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:27.039335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":390,"num_write":224,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:07.417129+0000","last_change":"2024-05-15T14:28:00.891499+0000","last_active":"2024-05-15T14:46:07.417129+0000","last_peered":"2024-05-15T14:46:07.417129+0000","last_clean":"2024-05-15T14:46:07.417129+0000","last_became_active":"2024-05-15T14:28:00.891181+0000","last_became_peered":"2024-05-15T14:28:00.891181+0000","last_unstale":"2024-05-15T14:46:07.417129+0000","last_undegraded":"2024-05-15T14:46:07.417129+0000","last_fullsized":"2024-05-15T14:46:07.417129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:38:22.090345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"39'31","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.725546+0000","last_change":"2024-05-15T14:28:02.890319+0000","last_active":"2024-05-15T14:47:53.725546+0000","last_peered":"2024-05-15T14:47:53.725546+0000","last_clean":"2024-05-15T14:47:53.725546+0000","last_became_active":"2024-05-15T14:28:02.889976+0000","last_became_peered":"2024-05-15T14:28:02.889976+0000","last_unstale":"2024-05-15T14:47:53.725546+0000","last_undegraded":"2024-05-15T14:47:53.725546+0000","last_fullsized":"2024-05-15T14:47:53.725546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:35.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.509569+0000","last_change":"2024-05-15T14:31:16.592036+0000","last_active":"2024-05-15T14:45:17.509569+0000","last_peered":"2024-05-15T14:45:17.509569+0000","last_clean":"2024-05-15T14:45:17.509569+0000","last_became_active":"2024-05-15T14:31:16.591739+0000","last_became_peered":"2024-05-15T14:31:16.591739+0000","last_unstale":"2024-05-15T14:45:17.509569+0000","last_undegraded":"2024-05-15T14:45:17.509569+0000","last_fullsized":"2024-05-15T14:45:17.509569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:29:51.681101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1c","version":"39'60","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.859800+0000","last_change":"2024-05-15T14:27:52.838848+0000","last_active":"2024-05-15T14:47:53.859800+0000","last_peered":"2024-05-15T14:47:53.859800+0000","last_clean":"2024-05-15T14:47:53.859800+0000","last_became_active":"2024-05-15T14:27:52.838558+0000","last_became_peered":"2024-05-15T14:27:52.838558+0000","last_unstale":"2024-05-15T14:47:53.859800+0000","last_undegraded":"2024-05-15T14:47:53.859800+0000","last_fullsized":"2024-05-15T14:47:53.859800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:39.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":198,"num_write":84,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"39'14","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.431530+0000","last_change":"2024-05-15T14:27:50.834122+0000","last_active":"2024-05-15T14:47:52.431530+0000","last_peered":"2024-05-15T14:47:52.431530+0000","last_clean":"2024-05-15T14:47:52.431530+0000","last_became_active":"2024-05-15T14:27:50.833741+0000","last_became_peered":"2024-05-15T14:27:50.833741+0000","last_unstale":"2024-05-15T14:47:52.431530+0000","last_undegraded":"2024-05-15T14:47:52.431530+0000","last_fullsized":"2024-05-15T14:47:52.431530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20,"num_write":62,"num_write_kb":15860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":276,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:49.987139+0000","last_change":"2024-05-15T14:27:56.884180+0000","last_active":"2024-05-15T14:45:49.987139+0000","last_peered":"2024-05-15T14:45:49.987139+0000","last_clean":"2024-05-15T14:45:49.987139+0000","last_became_active":"2024-05-15T14:27:56.883663+0000","last_became_peered":"2024-05-15T14:27:56.883663+0000","last_unstale":"2024-05-15T14:45:49.987139+0000","last_undegraded":"2024-05-15T14:45:49.987139+0000","last_fullsized":"2024-05-15T14:45:49.987139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:26.556164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2211,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":456,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"39'289","reported_seq":645,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:55.118121+0000","last_change":"2024-05-15T14:27:58.880803+0000","last_active":"2024-05-15T14:47:55.118121+0000","last_peered":"2024-05-15T14:47:55.118121+0000","last_clean":"2024-05-15T14:47:55.118121+0000","last_became_active":"2024-05-15T14:27:58.880510+0000","last_became_peered":"2024-05-15T14:27:58.880510+0000","last_unstale":"2024-05-15T14:47:55.118121+0000","last_undegraded":"2024-05-15T14:47:55.118121+0000","last_fullsized":"2024-05-15T14:47:55.118121+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:03.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":979,"num_read_kb":1295,"num_write":324,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'924","reported_seq":2554,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.229886+0000","last_change":"2024-05-15T14:28:00.885605+0000","last_active":"2024-05-15T14:48:26.229886+0000","last_peered":"2024-05-15T14:48:26.229886+0000","last_clean":"2024-05-15T14:48:26.229886+0000","last_became_active":"2024-05-15T14:28:00.885293+0000","last_became_peered":"2024-05-15T14:28:00.885293+0000","last_unstale":"2024-05-15T14:48:26.229886+0000","last_undegraded":"2024-05-15T14:48:26.229886+0000","last_fullsized":"2024-05-15T14:48:26.229886+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":900,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:25.360934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"39'25","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.696985+0000","last_change":"2024-05-15T14:28:02.893269+0000","last_active":"2024-05-15T14:47:53.696985+0000","last_peered":"2024-05-15T14:47:53.696985+0000","last_clean":"2024-05-15T14:47:53.696985+0000","last_became_active":"2024-05-15T14:28:02.892984+0000","last_became_peered":"2024-05-15T14:28:02.892984+0000","last_unstale":"2024-05-15T14:47:53.696985+0000","last_undegraded":"2024-05-15T14:47:53.696985+0000","last_fullsized":"2024-05-15T14:47:53.696985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:44.714715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":37,"num_write":54,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.411080+0000","last_change":"2024-05-15T14:31:16.594309+0000","last_active":"2024-05-15T14:45:47.411080+0000","last_peered":"2024-05-15T14:45:47.411080+0000","last_clean":"2024-05-15T14:45:47.411080+0000","last_became_active":"2024-05-15T14:31:16.594019+0000","last_became_peered":"2024-05-15T14:31:16.594019+0000","last_unstale":"2024-05-15T14:45:47.411080+0000","last_undegraded":"2024-05-15T14:45:47.411080+0000","last_fullsized":"2024-05-15T14:45:47.411080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:25:09.888037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"39'52","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.320806+0000","last_change":"2024-05-15T14:27:52.854866+0000","last_active":"2024-05-15T14:47:54.320806+0000","last_peered":"2024-05-15T14:47:54.320806+0000","last_clean":"2024-05-15T14:47:54.320806+0000","last_became_active":"2024-05-15T14:27:52.854479+0000","last_became_peered":"2024-05-15T14:27:52.854479+0000","last_unstale":"2024-05-15T14:47:54.320806+0000","last_undegraded":"2024-05-15T14:47:54.320806+0000","last_fullsized":"2024-05-15T14:47:54.320806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":157,"num_write":72,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408007+0000","last_change":"2024-05-15T14:27:50.841154+0000","last_active":"2024-05-15T14:45:22.408007+0000","last_peered":"2024-05-15T14:45:22.408007+0000","last_clean":"2024-05-15T14:45:22.408007+0000","last_became_active":"2024-05-15T14:27:50.840771+0000","last_became_peered":"2024-05-15T14:27:50.840771+0000","last_unstale":"2024-05-15T14:45:22.408007+0000","last_undegraded":"2024-05-15T14:45:22.408007+0000","last_fullsized":"2024-05-15T14:45:22.408007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:18.416733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'25","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.593035+0000","last_change":"2024-05-15T14:27:56.878204+0000","last_active":"2024-05-15T14:47:21.593035+0000","last_peered":"2024-05-15T14:47:21.593035+0000","last_clean":"2024-05-15T14:47:21.593035+0000","last_became_active":"2024-05-15T14:27:56.877367+0000","last_became_peered":"2024-05-15T14:27:56.877367+0000","last_unstale":"2024-05-15T14:47:21.593035+0000","last_undegraded":"2024-05-15T14:47:21.593035+0000","last_fullsized":"2024-05-15T14:47:21.593035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:48.893192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":101,"num_read_kb":87,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"39'408","reported_seq":22976,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.077957+0000","last_change":"2024-05-15T14:27:58.882407+0000","last_active":"2024-05-15T14:48:26.077957+0000","last_peered":"2024-05-15T14:48:26.077957+0000","last_clean":"2024-05-15T14:48:26.077957+0000","last_became_active":"2024-05-15T14:27:58.882139+0000","last_became_peered":"2024-05-15T14:27:58.882139+0000","last_unstale":"2024-05-15T14:48:26.077957+0000","last_undegraded":"2024-05-15T14:48:26.077957+0000","last_fullsized":"2024-05-15T14:48:26.077957+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:49.077081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56365,"num_read_kb":194190,"num_write":402,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.410843+0000","last_change":"2024-05-15T14:28:00.886162+0000","last_active":"2024-05-15T14:44:57.410843+0000","last_peered":"2024-05-15T14:44:57.410843+0000","last_clean":"2024-05-15T14:44:57.410843+0000","last_became_active":"2024-05-15T14:28:00.885872+0000","last_became_peered":"2024-05-15T14:28:00.885872+0000","last_unstale":"2024-05-15T14:44:57.410843+0000","last_undegraded":"2024-05-15T14:44:57.410843+0000","last_fullsized":"2024-05-15T14:44:57.410843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:35:42.856744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"39'21","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.251279+0000","last_change":"2024-05-15T14:28:02.896566+0000","last_active":"2024-05-15T14:47:54.251279+0000","last_peered":"2024-05-15T14:47:54.251279+0000","last_clean":"2024-05-15T14:47:54.251279+0000","last_became_active":"2024-05-15T14:28:02.896293+0000","last_became_peered":"2024-05-15T14:28:02.896293+0000","last_unstale":"2024-05-15T14:47:54.251279+0000","last_undegraded":"2024-05-15T14:47:54.251279+0000","last_fullsized":"2024-05-15T14:47:54.251279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:31.046554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514146+0000","last_change":"2024-05-15T14:31:16.594407+0000","last_active":"2024-05-15T14:45:47.514146+0000","last_peered":"2024-05-15T14:45:47.514146+0000","last_clean":"2024-05-15T14:45:47.514146+0000","last_became_active":"2024-05-15T14:31:16.594144+0000","last_became_peered":"2024-05-15T14:31:16.594144+0000","last_unstale":"2024-05-15T14:45:47.514146+0000","last_undegraded":"2024-05-15T14:45:47.514146+0000","last_fullsized":"2024-05-15T14:45:47.514146+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:01:05.887839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"39'56","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288903+0000","last_change":"2024-05-15T14:27:52.854982+0000","last_active":"2024-05-15T14:47:54.288903+0000","last_peered":"2024-05-15T14:47:54.288903+0000","last_clean":"2024-05-15T14:47:54.288903+0000","last_became_active":"2024-05-15T14:27:52.854517+0000","last_became_peered":"2024-05-15T14:27:52.854517+0000","last_unstale":"2024-05-15T14:47:54.288903+0000","last_undegraded":"2024-05-15T14:47:54.288903+0000","last_fullsized":"2024-05-15T14:47:54.288903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:03.135228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":183,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408040+0000","last_change":"2024-05-15T14:27:50.840481+0000","last_active":"2024-05-15T14:45:22.408040+0000","last_peered":"2024-05-15T14:45:22.408040+0000","last_clean":"2024-05-15T14:45:22.408040+0000","last_became_active":"2024-05-15T14:27:50.839960+0000","last_became_peered":"2024-05-15T14:27:50.839960+0000","last_unstale":"2024-05-15T14:45:22.408040+0000","last_undegraded":"2024-05-15T14:45:22.408040+0000","last_fullsized":"2024-05-15T14:45:22.408040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:50.553074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.588072+0000","last_change":"2024-05-15T14:27:56.883585+0000","last_active":"2024-05-15T14:47:21.588072+0000","last_peered":"2024-05-15T14:47:21.588072+0000","last_clean":"2024-05-15T14:47:21.588072+0000","last_became_active":"2024-05-15T14:27:56.883267+0000","last_became_peered":"2024-05-15T14:27:56.883267+0000","last_unstale":"2024-05-15T14:47:21.588072+0000","last_undegraded":"2024-05-15T14:47:21.588072+0000","last_fullsized":"2024-05-15T14:47:21.588072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"39'216","reported_seq":413,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.080784+0000","last_change":"2024-05-15T14:27:58.882536+0000","last_active":"2024-05-15T14:48:26.080784+0000","last_peered":"2024-05-15T14:48:26.080784+0000","last_clean":"2024-05-15T14:48:26.080784+0000","last_became_active":"2024-05-15T14:27:58.882239+0000","last_became_peered":"2024-05-15T14:27:58.882239+0000","last_unstale":"2024-05-15T14:48:26.080784+0000","last_undegraded":"2024-05-15T14:48:26.080784+0000","last_fullsized":"2024-05-15T14:48:26.080784+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:44.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":340,"num_read_kb":332,"num_write":192,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:02.405124+0000","last_change":"2024-05-15T14:28:00.887245+0000","last_active":"2024-05-15T14:45:02.405124+0000","last_peered":"2024-05-15T14:45:02.405124+0000","last_clean":"2024-05-15T14:45:02.405124+0000","last_became_active":"2024-05-15T14:28:00.886898+0000","last_became_peered":"2024-05-15T14:28:00.886898+0000","last_unstale":"2024-05-15T14:45:02.405124+0000","last_undegraded":"2024-05-15T14:45:02.405124+0000","last_fullsized":"2024-05-15T14:45:02.405124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:11.178263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"39'12","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.428797+0000","last_change":"2024-05-15T14:28:02.890898+0000","last_active":"2024-05-15T14:47:52.428797+0000","last_peered":"2024-05-15T14:47:52.428797+0000","last_clean":"2024-05-15T14:47:52.428797+0000","last_became_active":"2024-05-15T14:28:02.890595+0000","last_became_peered":"2024-05-15T14:28:02.890595+0000","last_unstale":"2024-05-15T14:47:52.428797+0000","last_undegraded":"2024-05-15T14:47:52.428797+0000","last_fullsized":"2024-05-15T14:47:52.428797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:15:31.656577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.411631+0000","last_change":"2024-05-15T14:31:16.597622+0000","last_active":"2024-05-15T14:45:22.411631+0000","last_peered":"2024-05-15T14:45:22.411631+0000","last_clean":"2024-05-15T14:45:22.411631+0000","last_became_active":"2024-05-15T14:31:16.597207+0000","last_became_peered":"2024-05-15T14:31:16.597207+0000","last_unstale":"2024-05-15T14:45:22.411631+0000","last_undegraded":"2024-05-15T14:45:22.411631+0000","last_fullsized":"2024-05-15T14:45:22.411631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:03:58.603941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"39'94","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.288855+0000","last_change":"2024-05-15T14:27:52.852789+0000","last_active":"2024-05-15T14:47:54.288855+0000","last_peered":"2024-05-15T14:47:54.288855+0000","last_clean":"2024-05-15T14:47:54.288855+0000","last_became_active":"2024-05-15T14:27:52.852536+0000","last_became_peered":"2024-05-15T14:27:52.852536+0000","last_unstale":"2024-05-15T14:47:54.288855+0000","last_undegraded":"2024-05-15T14:47:54.288855+0000","last_fullsized":"2024-05-15T14:47:54.288855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":296,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"39'22","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518672+0000","last_change":"2024-05-15T14:27:50.848136+0000","last_active":"2024-05-15T14:45:52.518672+0000","last_peered":"2024-05-15T14:45:52.518672+0000","last_clean":"2024-05-15T14:45:52.518672+0000","last_became_active":"2024-05-15T14:27:50.847850+0000","last_became_peered":"2024-05-15T14:27:50.847850+0000","last_unstale":"2024-05-15T14:45:52.518672+0000","last_undegraded":"2024-05-15T14:45:52.518672+0000","last_fullsized":"2024-05-15T14:45:52.518672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":44,"num_write":110,"num_write_kb":26471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"32'3","reported_seq":1305,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:25.920310+0000","last_change":"2024-05-15T14:27:56.879855+0000","last_active":"2024-05-15T14:48:25.920310+0000","last_peered":"2024-05-15T14:48:25.920310+0000","last_clean":"2024-05-15T14:48:25.920310+0000","last_became_active":"2024-05-15T14:27:56.879092+0000","last_became_peered":"2024-05-15T14:27:56.879092+0000","last_unstale":"2024-05-15T14:48:25.920310+0000","last_undegraded":"2024-05-15T14:48:25.920310+0000","last_fullsized":"2024-05-15T14:48:25.920310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1591,"num_read_kb":1589,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'230","reported_seq":386,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.051621+0000","last_change":"2024-05-15T14:27:58.883107+0000","last_active":"2024-05-15T14:48:26.051621+0000","last_peered":"2024-05-15T14:48:26.051621+0000","last_clean":"2024-05-15T14:48:26.051621+0000","last_became_active":"2024-05-15T14:27:58.882703+0000","last_became_peered":"2024-05-15T14:27:58.882703+0000","last_unstale":"2024-05-15T14:48:26.051621+0000","last_undegraded":"2024-05-15T14:48:26.051621+0000","last_fullsized":"2024-05-15T14:48:26.051621+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:03.731337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":436,"num_read_kb":463,"num_write":435,"num_write_kb":1979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.409428+0000","last_change":"2024-05-15T14:28:00.884804+0000","last_active":"2024-05-15T14:45:32.409428+0000","last_peered":"2024-05-15T14:45:32.409428+0000","last_clean":"2024-05-15T14:45:32.409428+0000","last_became_active":"2024-05-15T14:28:00.884499+0000","last_became_peered":"2024-05-15T14:28:00.884499+0000","last_unstale":"2024-05-15T14:45:32.409428+0000","last_undegraded":"2024-05-15T14:45:32.409428+0000","last_fullsized":"2024-05-15T14:45:32.409428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:22:45.934449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"39'18","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.258684+0000","last_change":"2024-05-15T14:28:02.896315+0000","last_active":"2024-05-15T14:46:21.258684+0000","last_peered":"2024-05-15T14:46:21.258684+0000","last_clean":"2024-05-15T14:46:21.258684+0000","last_became_active":"2024-05-15T14:28:02.895999+0000","last_became_peered":"2024-05-15T14:28:02.895999+0000","last_unstale":"2024-05-15T14:46:21.258684+0000","last_undegraded":"2024-05-15T14:46:21.258684+0000","last_fullsized":"2024-05-15T14:46:21.258684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:38.432473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514109+0000","last_change":"2024-05-15T14:31:16.593403+0000","last_active":"2024-05-15T14:45:47.514109+0000","last_peered":"2024-05-15T14:45:47.514109+0000","last_clean":"2024-05-15T14:45:47.514109+0000","last_became_active":"2024-05-15T14:31:16.593126+0000","last_became_peered":"2024-05-15T14:31:16.593126+0000","last_unstale":"2024-05-15T14:45:47.514109+0000","last_undegraded":"2024-05-15T14:45:47.514109+0000","last_fullsized":"2024-05-15T14:45:47.514109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:32.457272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.404758+0000","last_change":"2024-05-15T14:27:52.844385+0000","last_active":"2024-05-15T14:44:47.404758+0000","last_peered":"2024-05-15T14:44:47.404758+0000","last_clean":"2024-05-15T14:44:47.404758+0000","last_became_active":"2024-05-15T14:27:52.844112+0000","last_became_peered":"2024-05-15T14:27:52.844112+0000","last_unstale":"2024-05-15T14:44:47.404758+0000","last_undegraded":"2024-05-15T14:44:47.404758+0000","last_fullsized":"2024-05-15T14:44:47.404758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"39'20","reported_seq":98,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.422176+0000","last_change":"2024-05-15T14:27:50.844543+0000","last_active":"2024-05-15T14:46:37.422176+0000","last_peered":"2024-05-15T14:46:37.422176+0000","last_clean":"2024-05-15T14:46:37.422176+0000","last_became_active":"2024-05-15T14:27:50.843701+0000","last_became_peered":"2024-05-15T14:27:50.843701+0000","last_unstale":"2024-05-15T14:46:37.422176+0000","last_undegraded":"2024-05-15T14:46:37.422176+0000","last_fullsized":"2024-05-15T14:46:37.422176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":100,"num_write_kb":23517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.408964+0000","last_change":"2024-05-15T14:27:56.883840+0000","last_active":"2024-05-15T14:44:57.408964+0000","last_peered":"2024-05-15T14:44:57.408964+0000","last_clean":"2024-05-15T14:44:57.408964+0000","last_became_active":"2024-05-15T14:27:56.883534+0000","last_became_peered":"2024-05-15T14:27:56.883534+0000","last_unstale":"2024-05-15T14:44:57.408964+0000","last_undegraded":"2024-05-15T14:44:57.408964+0000","last_fullsized":"2024-05-15T14:44:57.408964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:44.326726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"39'319","reported_seq":521,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.060192+0000","last_change":"2024-05-15T14:27:58.886044+0000","last_active":"2024-05-15T14:48:26.060192+0000","last_peered":"2024-05-15T14:48:26.060192+0000","last_clean":"2024-05-15T14:48:26.060192+0000","last_became_active":"2024-05-15T14:27:58.885479+0000","last_became_peered":"2024-05-15T14:27:58.885479+0000","last_unstale":"2024-05-15T14:48:26.060192+0000","last_undegraded":"2024-05-15T14:48:26.060192+0000","last_fullsized":"2024-05-15T14:48:26.060192+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:42.051812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":600,"num_write":516,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.414924+0000","last_change":"2024-05-15T14:28:00.885531+0000","last_active":"2024-05-15T14:45:32.414924+0000","last_peered":"2024-05-15T14:45:32.414924+0000","last_clean":"2024-05-15T14:45:32.414924+0000","last_became_active":"2024-05-15T14:28:00.885171+0000","last_became_peered":"2024-05-15T14:28:00.885171+0000","last_unstale":"2024-05-15T14:45:32.414924+0000","last_undegraded":"2024-05-15T14:45:32.414924+0000","last_fullsized":"2024-05-15T14:45:32.414924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:03.551642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'26","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.418188+0000","last_change":"2024-05-15T14:28:02.888549+0000","last_active":"2024-05-15T14:46:47.418188+0000","last_peered":"2024-05-15T14:46:47.418188+0000","last_clean":"2024-05-15T14:46:47.418188+0000","last_became_active":"2024-05-15T14:28:02.888247+0000","last_became_peered":"2024-05-15T14:28:02.888247+0000","last_unstale":"2024-05-15T14:46:47.418188+0000","last_undegraded":"2024-05-15T14:46:47.418188+0000","last_fullsized":"2024-05-15T14:46:47.418188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":30,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"39'16","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410536+0000","last_change":"2024-05-15T14:27:52.844877+0000","last_active":"2024-05-15T14:45:12.410536+0000","last_peered":"2024-05-15T14:45:12.410536+0000","last_clean":"2024-05-15T14:45:12.410536+0000","last_became_active":"2024-05-15T14:27:52.844292+0000","last_became_peered":"2024-05-15T14:27:52.844292+0000","last_unstale":"2024-05-15T14:45:12.410536+0000","last_undegraded":"2024-05-15T14:45:12.410536+0000","last_fullsized":"2024-05-15T14:45:12.410536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:16.074039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"39'20","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.028581+0000","last_change":"2024-05-15T14:27:50.853660+0000","last_active":"2024-05-15T14:48:26.028581+0000","last_peered":"2024-05-15T14:48:26.028581+0000","last_clean":"2024-05-15T14:48:26.028581+0000","last_became_active":"2024-05-15T14:27:50.853042+0000","last_became_peered":"2024-05-15T14:27:50.853042+0000","last_unstale":"2024-05-15T14:48:26.028581+0000","last_undegraded":"2024-05-15T14:48:26.028581+0000","last_fullsized":"2024-05-15T14:48:26.028581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:39:59.963824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":35,"num_write":92,"num_write_kb":30554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"39'20","reported_seq":112,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304259+0000","last_change":"2024-05-15T14:27:52.842491+0000","last_active":"2024-05-15T14:47:54.304259+0000","last_peered":"2024-05-15T14:47:54.304259+0000","last_clean":"2024-05-15T14:47:54.304259+0000","last_became_active":"2024-05-15T14:27:52.840716+0000","last_became_peered":"2024-05-15T14:27:52.840716+0000","last_unstale":"2024-05-15T14:47:54.304259+0000","last_undegraded":"2024-05-15T14:47:54.304259+0000","last_fullsized":"2024-05-15T14:47:54.304259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:20.425917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"39'16","reported_seq":98,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.509652+0000","last_change":"2024-05-15T14:28:38.451032+0000","last_active":"2024-05-15T14:46:37.509652+0000","last_peered":"2024-05-15T14:46:37.509652+0000","last_clean":"2024-05-15T14:46:37.509652+0000","last_became_active":"2024-05-15T14:28:38.450578+0000","last_became_peered":"2024-05-15T14:28:38.450578+0000","last_unstale":"2024-05-15T14:46:37.509652+0000","last_undegraded":"2024-05-15T14:46:37.509652+0000","last_fullsized":"2024-05-15T14:46:37.509652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:19.965962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"39'26","reported_seq":110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.385094+0000","last_change":"2024-05-15T14:27:52.841680+0000","last_active":"2024-05-15T14:46:21.385094+0000","last_peered":"2024-05-15T14:46:21.385094+0000","last_clean":"2024-05-15T14:46:21.385094+0000","last_became_active":"2024-05-15T14:27:52.841192+0000","last_became_peered":"2024-05-15T14:27:52.841192+0000","last_unstale":"2024-05-15T14:46:21.385094+0000","last_undegraded":"2024-05-15T14:46:21.385094+0000","last_fullsized":"2024-05-15T14:46:21.385094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":93,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"39'18","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416631+0000","last_change":"2024-05-15T14:28:38.450889+0000","last_active":"2024-05-15T14:46:37.416631+0000","last_peered":"2024-05-15T14:46:37.416631+0000","last_clean":"2024-05-15T14:46:37.416631+0000","last_became_active":"2024-05-15T14:28:38.450592+0000","last_became_peered":"2024-05-15T14:28:38.450592+0000","last_unstale":"2024-05-15T14:46:37.416631+0000","last_undegraded":"2024-05-15T14:46:37.416631+0000","last_fullsized":"2024-05-15T14:46:37.416631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:32.536677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"39'72","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.411796+0000","last_change":"2024-05-15T14:28:37.941694+0000","last_active":"2024-05-15T14:45:57.411796+0000","last_peered":"2024-05-15T14:45:57.411796+0000","last_clean":"2024-05-15T14:45:57.411796+0000","last_became_active":"2024-05-15T14:28:37.941389+0000","last_became_peered":"2024-05-15T14:28:37.941389+0000","last_unstale":"2024-05-15T14:45:57.411796+0000","last_undegraded":"2024-05-15T14:45:57.411796+0000","last_fullsized":"2024-05-15T14:45:57.411796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:12.821111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":236,"num_write":102,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"39'18","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.028033+0000","last_change":"2024-05-15T14:27:50.849038+0000","last_active":"2024-05-15T14:48:26.028033+0000","last_peered":"2024-05-15T14:48:26.028033+0000","last_clean":"2024-05-15T14:48:26.028033+0000","last_became_active":"2024-05-15T14:27:50.848763+0000","last_became_peered":"2024-05-15T14:27:50.848763+0000","last_unstale":"2024-05-15T14:48:26.028033+0000","last_undegraded":"2024-05-15T14:48:26.028033+0000","last_fullsized":"2024-05-15T14:48:26.028033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:50.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":82,"num_write_kb":24675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"39'82","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327631+0000","last_change":"2024-05-15T14:27:52.853939+0000","last_active":"2024-05-15T14:47:54.327631+0000","last_peered":"2024-05-15T14:47:54.327631+0000","last_clean":"2024-05-15T14:47:54.327631+0000","last_became_active":"2024-05-15T14:27:52.851068+0000","last_became_peered":"2024-05-15T14:27:52.851068+0000","last_unstale":"2024-05-15T14:47:54.327631+0000","last_undegraded":"2024-05-15T14:47:54.327631+0000","last_fullsized":"2024-05-15T14:47:54.327631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":322,"num_read_kb":258,"num_write":116,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512532+0000","last_change":"2024-05-15T14:27:50.847365+0000","last_active":"2024-05-15T14:45:12.512532+0000","last_peered":"2024-05-15T14:45:12.512532+0000","last_clean":"2024-05-15T14:45:12.512532+0000","last_became_active":"2024-05-15T14:27:50.847042+0000","last_became_peered":"2024-05-15T14:27:50.847042+0000","last_unstale":"2024-05-15T14:45:12.512532+0000","last_undegraded":"2024-05-15T14:45:12.512532+0000","last_fullsized":"2024-05-15T14:45:12.512532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'66","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327563+0000","last_change":"2024-05-15T14:27:52.847215+0000","last_active":"2024-05-15T14:47:54.327563+0000","last_peered":"2024-05-15T14:47:54.327563+0000","last_clean":"2024-05-15T14:47:54.327563+0000","last_became_active":"2024-05-15T14:27:52.846918+0000","last_became_peered":"2024-05-15T14:27:52.846918+0000","last_unstale":"2024-05-15T14:47:54.327563+0000","last_undegraded":"2024-05-15T14:47:54.327563+0000","last_fullsized":"2024-05-15T14:47:54.327563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":226,"num_write":90,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.410488+0000","last_change":"2024-05-15T14:27:50.850495+0000","last_active":"2024-05-15T14:45:12.410488+0000","last_peered":"2024-05-15T14:45:12.410488+0000","last_clean":"2024-05-15T14:45:12.410488+0000","last_became_active":"2024-05-15T14:27:50.849910+0000","last_became_peered":"2024-05-15T14:27:50.849910+0000","last_unstale":"2024-05-15T14:45:12.410488+0000","last_undegraded":"2024-05-15T14:45:12.410488+0000","last_fullsized":"2024-05-15T14:45:12.410488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:15.302265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.524589+0000","last_change":"2024-05-15T14:27:52.862477+0000","last_active":"2024-05-15T14:46:37.524589+0000","last_peered":"2024-05-15T14:46:37.524589+0000","last_clean":"2024-05-15T14:46:37.524589+0000","last_became_active":"2024-05-15T14:27:52.862227+0000","last_became_peered":"2024-05-15T14:27:52.862227+0000","last_unstale":"2024-05-15T14:46:37.524589+0000","last_undegraded":"2024-05-15T14:46:37.524589+0000","last_fullsized":"2024-05-15T14:46:37.524589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:51.680958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"39'14","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.406550+0000","last_change":"2024-05-15T14:28:37.942575+0000","last_active":"2024-05-15T14:45:12.406550+0000","last_peered":"2024-05-15T14:45:12.406550+0000","last_clean":"2024-05-15T14:45:12.406550+0000","last_became_active":"2024-05-15T14:28:37.942198+0000","last_became_peered":"2024-05-15T14:28:37.942198+0000","last_unstale":"2024-05-15T14:45:12.406550+0000","last_undegraded":"2024-05-15T14:45:12.406550+0000","last_fullsized":"2024-05-15T14:45:12.406550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:26:58.883367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416154+0000","last_change":"2024-05-15T14:27:52.841198+0000","last_active":"2024-05-15T14:46:37.416154+0000","last_peered":"2024-05-15T14:46:37.416154+0000","last_clean":"2024-05-15T14:46:37.416154+0000","last_became_active":"2024-05-15T14:27:52.840941+0000","last_became_peered":"2024-05-15T14:27:52.840941+0000","last_unstale":"2024-05-15T14:46:37.416154+0000","last_undegraded":"2024-05-15T14:46:37.416154+0000","last_fullsized":"2024-05-15T14:46:37.416154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:17.311449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.512566+0000","last_change":"2024-05-15T14:27:50.849503+0000","last_active":"2024-05-15T14:45:12.512566+0000","last_peered":"2024-05-15T14:45:12.512566+0000","last_clean":"2024-05-15T14:45:12.512566+0000","last_became_active":"2024-05-15T14:27:50.847998+0000","last_became_peered":"2024-05-15T14:27:50.847998+0000","last_unstale":"2024-05-15T14:45:12.512566+0000","last_undegraded":"2024-05-15T14:45:12.512566+0000","last_fullsized":"2024-05-15T14:45:12.512566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:50.553074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"39'8","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.421601+0000","last_change":"2024-05-15T14:27:52.853614+0000","last_active":"2024-05-15T14:46:32.421601+0000","last_peered":"2024-05-15T14:46:32.421601+0000","last_clean":"2024-05-15T14:46:32.421601+0000","last_became_active":"2024-05-15T14:27:52.852947+0000","last_became_peered":"2024-05-15T14:27:52.852947+0000","last_unstale":"2024-05-15T14:46:32.421601+0000","last_undegraded":"2024-05-15T14:46:32.421601+0000","last_fullsized":"2024-05-15T14:46:32.421601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:27.422621+0000","last_change":"2024-05-15T14:27:50.856154+0000","last_active":"2024-05-15T14:47:27.422621+0000","last_peered":"2024-05-15T14:47:27.422621+0000","last_clean":"2024-05-15T14:47:27.422621+0000","last_became_active":"2024-05-15T14:27:50.855927+0000","last_became_peered":"2024-05-15T14:27:50.855927+0000","last_unstale":"2024-05-15T14:47:27.422621+0000","last_undegraded":"2024-05-15T14:47:27.422621+0000","last_fullsized":"2024-05-15T14:47:27.422621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:14.556752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24,"num_write":62,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"39'24","reported_seq":110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416239+0000","last_change":"2024-05-15T14:27:52.854135+0000","last_active":"2024-05-15T14:46:32.416239+0000","last_peered":"2024-05-15T14:46:32.416239+0000","last_clean":"2024-05-15T14:46:32.416239+0000","last_became_active":"2024-05-15T14:27:52.853857+0000","last_became_peered":"2024-05-15T14:27:52.853857+0000","last_unstale":"2024-05-15T14:46:32.416239+0000","last_undegraded":"2024-05-15T14:46:32.416239+0000","last_fullsized":"2024-05-15T14:46:32.416239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":91,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"39'18","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518609+0000","last_change":"2024-05-15T14:27:50.844170+0000","last_active":"2024-05-15T14:45:52.518609+0000","last_peered":"2024-05-15T14:45:52.518609+0000","last_clean":"2024-05-15T14:45:52.518609+0000","last_became_active":"2024-05-15T14:27:50.843874+0000","last_became_peered":"2024-05-15T14:27:50.843874+0000","last_unstale":"2024-05-15T14:45:52.518609+0000","last_undegraded":"2024-05-15T14:45:52.518609+0000","last_fullsized":"2024-05-15T14:45:52.518609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:48.618636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"39'58","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.504998+0000","last_change":"2024-05-15T14:27:52.847675+0000","last_active":"2024-05-15T14:45:52.504998+0000","last_peered":"2024-05-15T14:45:52.504998+0000","last_clean":"2024-05-15T14:45:52.504998+0000","last_became_active":"2024-05-15T14:27:52.847362+0000","last_became_peered":"2024-05-15T14:27:52.847362+0000","last_unstale":"2024-05-15T14:45:52.504998+0000","last_undegraded":"2024-05-15T14:45:52.504998+0000","last_fullsized":"2024-05-15T14:45:52.504998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:06:52.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":172,"num_write":84,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411173+0000","last_change":"2024-05-15T14:27:50.846611+0000","last_active":"2024-05-15T14:45:52.411173+0000","last_peered":"2024-05-15T14:45:52.411173+0000","last_clean":"2024-05-15T14:45:52.411173+0000","last_became_active":"2024-05-15T14:27:50.846291+0000","last_became_peered":"2024-05-15T14:27:50.846291+0000","last_unstale":"2024-05-15T14:45:52.411173+0000","last_undegraded":"2024-05-15T14:45:52.411173+0000","last_fullsized":"2024-05-15T14:45:52.411173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:01.126044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":14702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"39'74","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327403+0000","last_change":"2024-05-15T14:27:52.848460+0000","last_active":"2024-05-15T14:47:54.327403+0000","last_peered":"2024-05-15T14:47:54.327403+0000","last_clean":"2024-05-15T14:47:54.327403+0000","last_became_active":"2024-05-15T14:27:52.848173+0000","last_became_peered":"2024-05-15T14:27:52.848173+0000","last_unstale":"2024-05-15T14:47:54.327403+0000","last_undegraded":"2024-05-15T14:47:54.327403+0000","last_fullsized":"2024-05-15T14:47:54.327403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":248,"num_write":102,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.417142+0000","last_change":"2024-05-15T14:27:50.847115+0000","last_active":"2024-05-15T14:45:52.417142+0000","last_peered":"2024-05-15T14:45:52.417142+0000","last_clean":"2024-05-15T14:45:52.417142+0000","last_became_active":"2024-05-15T14:27:50.846782+0000","last_became_peered":"2024-05-15T14:27:50.846782+0000","last_unstale":"2024-05-15T14:45:52.417142+0000","last_undegraded":"2024-05-15T14:45:52.417142+0000","last_fullsized":"2024-05-15T14:45:52.417142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"39'30","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840678+0000","last_change":"2024-05-15T14:27:52.851930+0000","last_active":"2024-05-15T14:47:53.840678+0000","last_peered":"2024-05-15T14:47:53.840678+0000","last_clean":"2024-05-15T14:47:53.840678+0000","last_became_active":"2024-05-15T14:27:52.851642+0000","last_became_peered":"2024-05-15T14:27:52.851642+0000","last_unstale":"2024-05-15T14:47:53.840678+0000","last_undegraded":"2024-05-15T14:47:53.840678+0000","last_fullsized":"2024-05-15T14:47:53.840678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":127,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.410649+0000","last_change":"2024-05-15T14:27:50.840821+0000","last_active":"2024-05-15T14:45:52.410649+0000","last_peered":"2024-05-15T14:45:52.410649+0000","last_clean":"2024-05-15T14:45:52.410649+0000","last_became_active":"2024-05-15T14:27:50.840467+0000","last_became_peered":"2024-05-15T14:27:50.840467+0000","last_unstale":"2024-05-15T14:45:52.410649+0000","last_undegraded":"2024-05-15T14:45:52.410649+0000","last_fullsized":"2024-05-15T14:45:52.410649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:07:30.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"39'92","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.328290+0000","last_change":"2024-05-15T14:27:52.860211+0000","last_active":"2024-05-15T14:47:54.328290+0000","last_peered":"2024-05-15T14:47:54.328290+0000","last_clean":"2024-05-15T14:47:54.328290+0000","last_became_active":"2024-05-15T14:27:52.859926+0000","last_became_peered":"2024-05-15T14:27:52.859926+0000","last_unstale":"2024-05-15T14:47:54.328290+0000","last_undegraded":"2024-05-15T14:47:54.328290+0000","last_fullsized":"2024-05-15T14:47:54.328290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":270,"num_write":132,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"39'24","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.532445+0000","last_change":"2024-05-15T14:27:50.850215+0000","last_active":"2024-05-15T14:48:07.532445+0000","last_peered":"2024-05-15T14:48:07.532445+0000","last_clean":"2024-05-15T14:48:07.532445+0000","last_became_active":"2024-05-15T14:27:50.849936+0000","last_became_peered":"2024-05-15T14:27:50.849936+0000","last_unstale":"2024-05-15T14:48:07.532445+0000","last_undegraded":"2024-05-15T14:48:07.532445+0000","last_fullsized":"2024-05-15T14:48:07.532445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:18.416733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":112,"num_write_kb":36442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"39'62","reported_seq":162,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.518575+0000","last_change":"2024-05-15T14:27:52.857096+0000","last_active":"2024-05-15T14:45:52.518575+0000","last_peered":"2024-05-15T14:45:52.518575+0000","last_clean":"2024-05-15T14:45:52.518575+0000","last_became_active":"2024-05-15T14:27:52.856767+0000","last_became_peered":"2024-05-15T14:27:52.856767+0000","last_unstale":"2024-05-15T14:45:52.518575+0000","last_undegraded":"2024-05-15T14:45:52.518575+0000","last_fullsized":"2024-05-15T14:45:52.518575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:22.520473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":205,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"39'18","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.509004+0000","last_change":"2024-05-15T14:27:50.842853+0000","last_active":"2024-05-15T14:46:32.509004+0000","last_peered":"2024-05-15T14:46:32.509004+0000","last_clean":"2024-05-15T14:46:32.509004+0000","last_became_active":"2024-05-15T14:27:50.842512+0000","last_became_peered":"2024-05-15T14:27:50.842512+0000","last_unstale":"2024-05-15T14:46:32.509004+0000","last_undegraded":"2024-05-15T14:46:32.509004+0000","last_fullsized":"2024-05-15T14:46:32.509004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:21.227696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"39'56","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304223+0000","last_change":"2024-05-15T14:27:52.855227+0000","last_active":"2024-05-15T14:47:54.304223+0000","last_peered":"2024-05-15T14:47:54.304223+0000","last_clean":"2024-05-15T14:47:54.304223+0000","last_became_active":"2024-05-15T14:27:52.854841+0000","last_became_peered":"2024-05-15T14:27:52.854841+0000","last_unstale":"2024-05-15T14:47:54.304223+0000","last_undegraded":"2024-05-15T14:47:54.304223+0000","last_fullsized":"2024-05-15T14:47:54.304223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":78,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"39'20","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416132+0000","last_change":"2024-05-15T14:27:50.848570+0000","last_active":"2024-05-15T14:46:32.416132+0000","last_peered":"2024-05-15T14:46:32.416132+0000","last_clean":"2024-05-15T14:46:32.416132+0000","last_became_active":"2024-05-15T14:27:50.848291+0000","last_became_peered":"2024-05-15T14:27:50.848291+0000","last_unstale":"2024-05-15T14:46:32.416132+0000","last_undegraded":"2024-05-15T14:46:32.416132+0000","last_fullsized":"2024-05-15T14:46:32.416132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":40,"num_write":100,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416004+0000","last_change":"2024-05-15T14:27:50.842699+0000","last_active":"2024-05-15T14:46:32.416004+0000","last_peered":"2024-05-15T14:46:32.416004+0000","last_clean":"2024-05-15T14:46:32.416004+0000","last_became_active":"2024-05-15T14:27:50.842420+0000","last_became_peered":"2024-05-15T14:27:50.842420+0000","last_unstale":"2024-05-15T14:46:32.416004+0000","last_undegraded":"2024-05-15T14:46:32.416004+0000","last_fullsized":"2024-05-15T14:46:32.416004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":90,"num_write_kb":20587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304330+0000","last_change":"2024-05-15T14:27:52.853871+0000","last_active":"2024-05-15T14:47:54.304330+0000","last_peered":"2024-05-15T14:47:54.304330+0000","last_clean":"2024-05-15T14:47:54.304330+0000","last_became_active":"2024-05-15T14:27:52.853329+0000","last_became_peered":"2024-05-15T14:27:52.853329+0000","last_unstale":"2024-05-15T14:47:54.304330+0000","last_undegraded":"2024-05-15T14:47:54.304330+0000","last_fullsized":"2024-05-15T14:47:54.304330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:03.135228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.420349+0000","last_change":"2024-05-15T14:27:50.839786+0000","last_active":"2024-05-15T14:46:32.420349+0000","last_peered":"2024-05-15T14:46:32.420349+0000","last_clean":"2024-05-15T14:46:32.420349+0000","last_became_active":"2024-05-15T14:27:50.839496+0000","last_became_peered":"2024-05-15T14:27:50.839496+0000","last_unstale":"2024-05-15T14:46:32.420349+0000","last_undegraded":"2024-05-15T14:46:32.420349+0000","last_fullsized":"2024-05-15T14:46:32.420349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:53.186276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":17647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"39'70","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304247+0000","last_change":"2024-05-15T14:27:52.852295+0000","last_active":"2024-05-15T14:47:54.304247+0000","last_peered":"2024-05-15T14:47:54.304247+0000","last_clean":"2024-05-15T14:47:54.304247+0000","last_became_active":"2024-05-15T14:27:52.851973+0000","last_became_peered":"2024-05-15T14:27:52.851973+0000","last_unstale":"2024-05-15T14:47:54.304247+0000","last_undegraded":"2024-05-15T14:47:54.304247+0000","last_fullsized":"2024-05-15T14:47:54.304247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":234,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3423,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1381,"num_read_kb":1449,"num_write":1045,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":6846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":830,"ondisk_log_size":830,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11724,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":2162624,"num_read_kb":7062025,"num_write":12227,"num_write_kb":15784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1856,"ondisk_log_size":1856,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":14929,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5654,"num_read_kb":6894,"num_write":192,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":29858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9598,"num_read_kb":7988,"num_write":3212,"num_write_kb":1308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2246,"ondisk_log_size":2246,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2611,"num_read_kb":1724,"num_write":4445,"num_write_kb":1235021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575104,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335408,"statfs":{"total":96636764160,"available":96599457792,"internally_reserved":0,"allocated":1118208,"data_stored":815108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575105,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":487424,"data_stored":221551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575104,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44184,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327656,"statfs":{"total":96636764160,"available":96591519744,"internally_reserved":0,"allocated":536576,"data_stored":225223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575105,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":227462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575105,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":532480,"data_stored":222205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575105,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":491520,"data_stored":224011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575105,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":222247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575106,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1118208,"data_stored":816897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":68,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:48:58.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T14:48:58.573 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:48:58.574 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":39,"fsid":"7b76a29b-9591-4fa3-8f6d-706a5bf01a89","created":"2024-05-15T14:27:32.006075+0000","modified":"2024-05-15T14:31:38.618026+0000","last_up_change":"2024-05-15T14:27:41.780704+0000","last_in_change":"2024-05-15T14:27:34.196289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T14:27:42.397255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-15T14:27:42.873261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"MyZone.rgw.buckets.data","create_time":"2024-05-15T14:27:49.588733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"MyZone.rgw.buckets.index","create_time":"2024-05-15T14:27:51.172595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-15T14:27:55.027017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"MyZone.rgw.log","create_time":"2024-05-15T14:27:57.234916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"MyZone.rgw.control","create_time":"2024-05-15T14:27:58.893227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"MyZone.rgw.meta","create_time":"2024-05-15T14:28:00.946166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"MyZone.rgw.buckets.non-ec","create_time":"2024-05-15T14:31:15.492336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"82e38010-356d-4bc4-871a-0f2e1432fb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6825","nonce":3725803698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6827","nonce":3725803698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6831","nonce":3725803698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":3725803698},{"type":"v1","addr":"172.21.15.18:6829","nonce":3725803698}]},"public_addr":"172.21.15.18:6825/3725803698","cluster_addr":"172.21.15.18:6827/3725803698","heartbeat_back_addr":"172.21.15.18:6831/3725803698","heartbeat_front_addr":"172.21.15.18:6829/3725803698","state":["exists","up"]},{"osd":1,"uuid":"be1a5e4f-4dfe-4cea-81ec-524c172fffcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6801","nonce":3228695091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6803","nonce":3228695091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6807","nonce":3228695091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3228695091},{"type":"v1","addr":"172.21.15.18:6805","nonce":3228695091}]},"public_addr":"172.21.15.18:6801/3228695091","cluster_addr":"172.21.15.18:6803/3228695091","heartbeat_back_addr":"172.21.15.18:6807/3228695091","heartbeat_front_addr":"172.21.15.18:6805/3228695091","state":["exists","up"]},{"osd":2,"uuid":"ebd5f9e3-29f1-40f3-9f58-1479a1b8ed3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6814","nonce":2500301093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6818","nonce":2500301093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6823","nonce":2500301093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2500301093},{"type":"v1","addr":"172.21.15.18:6821","nonce":2500301093}]},"public_addr":"172.21.15.18:6814/2500301093","cluster_addr":"172.21.15.18:6818/2500301093","heartbeat_back_addr":"172.21.15.18:6823/2500301093","heartbeat_front_addr":"172.21.15.18:6821/2500301093","state":["exists","up"]},{"osd":3,"uuid":"84736067-d077-46fe-9fac-c403119aa108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6809","nonce":2567457164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6811","nonce":2567457164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6820","nonce":2567457164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6813","nonce":2567457164},{"type":"v1","addr":"172.21.15.18:6815","nonce":2567457164}]},"public_addr":"172.21.15.18:6809/2567457164","cluster_addr":"172.21.15.18:6811/2567457164","heartbeat_back_addr":"172.21.15.18:6820/2567457164","heartbeat_front_addr":"172.21.15.18:6815/2567457164","state":["exists","up"]},{"osd":4,"uuid":"650f8100-a2ce-4713-af49-30d0ecc6a42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6822","nonce":4115055233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6826","nonce":4115055233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6831","nonce":4115055233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4115055233},{"type":"v1","addr":"172.21.15.70:6829","nonce":4115055233}]},"public_addr":"172.21.15.70:6822/4115055233","cluster_addr":"172.21.15.70:6826/4115055233","heartbeat_back_addr":"172.21.15.70:6831/4115055233","heartbeat_front_addr":"172.21.15.70:6829/4115055233","state":["exists","up"]},{"osd":5,"uuid":"b2868c5e-de69-43ce-a5f9-e72d9dcb1bd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6803","nonce":2586885345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6808","nonce":2586885345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6815","nonce":2586885345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2586885345},{"type":"v1","addr":"172.21.15.70:6813","nonce":2586885345}]},"public_addr":"172.21.15.70:6803/2586885345","cluster_addr":"172.21.15.70:6808/2586885345","heartbeat_back_addr":"172.21.15.70:6815/2586885345","heartbeat_front_addr":"172.21.15.70:6813/2586885345","state":["exists","up"]},{"osd":6,"uuid":"e813ec9c-769d-47bc-8dc9-12742bcb42df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6817","nonce":1716851624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6819","nonce":1716851624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6827","nonce":1716851624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1716851624},{"type":"v1","addr":"172.21.15.70:6823","nonce":1716851624}]},"public_addr":"172.21.15.70:6817/1716851624","cluster_addr":"172.21.15.70:6819/1716851624","heartbeat_back_addr":"172.21.15.70:6827/1716851624","heartbeat_front_addr":"172.21.15.70:6823/1716851624","state":["exists","up"]},{"osd":7,"uuid":"caefff72-54ba-4680-be60-861b292fab19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6801","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6802","nonce":2407810716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6805","nonce":2407810716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6812","nonce":2407810716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2407810716},{"type":"v1","addr":"172.21.15.70:6809","nonce":2407810716}]},"public_addr":"172.21.15.70:6802/2407810716","cluster_addr":"172.21.15.70:6805/2407810716","heartbeat_back_addr":"172.21.15.70:6812/2407810716","heartbeat_front_addr":"172.21.15.70:6809/2407810716","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.333113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.345670+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.340644+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.327808+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.304551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.342242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.332781+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T14:27:39.307236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"9.e","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T14:48:59.588 INFO:tasks.ceph:Scrubbing osd.0 2024-05-15T14:48:59.588 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-15T14:48:59.732 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:48:59.805 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T14:48:59.805 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:48:59.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-15T14:49:00.116 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-05-15T14:49:00.129 INFO:tasks.ceph:Scrubbing osd.1 2024-05-15T14:49:00.130 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-15T14:49:00.260 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:49:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T14:49:00.260 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:49:00.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-15T14:49:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-05-15T14:49:00.593 INFO:tasks.ceph:Scrubbing osd.2 2024-05-15T14:49:00.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-15T14:49:00.723 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:49:00.723 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T14:49:00.723 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:49:00.734 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-15T14:49:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-05-15T14:49:01.061 INFO:tasks.ceph:Scrubbing osd.3 2024-05-15T14:49:01.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-15T14:49:01.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.1 has been restored 2024-05-15T14:49:01.192 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:49:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T14:49:01.192 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:49:01.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-15T14:49:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-05-15T14:49:01.523 INFO:tasks.ceph:Scrubbing osd.4 2024-05-15T14:49:01.523 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-15T14:49:01.653 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:49:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T14:49:01.654 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:49:01.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-15T14:49:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 4 to deep-scrub 2024-05-15T14:49:01.990 INFO:tasks.ceph:Scrubbing osd.5 2024-05-15T14:49:01.991 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-15T14:49:02.123 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:49:02.124 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T14:49:02.124 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:49:02.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-15T14:49:02.445 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 5 to deep-scrub 2024-05-15T14:49:02.459 INFO:tasks.ceph:Scrubbing osd.6 2024-05-15T14:49:02.460 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-15T14:49:02.590 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:49:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T14:49:02.591 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:49:02.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-15T14:49:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 6 to deep-scrub 2024-05-15T14:49:02.926 INFO:tasks.ceph:Scrubbing osd.7 2024-05-15T14:49:02.927 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-15T14:49:03.057 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-05-15T14:49:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T14:49:03.057 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-05-15T14:49:03.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-15T14:49:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 7 to deep-scrub 2024-05-15T14:49:03.388 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:49:03.721 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:49:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:49:03.730 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":672,"stamp":"2024-05-15T14:49:02.771697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620444,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":2182158,"num_read_kb":7080366,"num_write":21294,"num_write_kb":1254163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6260,"ondisk_log_size":6260,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275400,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699320,"statfs":{"total":773094113280,"available":772812103680,"internally_reserved":0,"allocated":5316608,"data_stored":2974704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":223,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003911"},"pg_stats":[{"pgid":"3.3f","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.520606+0000","last_change":"2024-05-15T14:27:50.850244+0000","last_active":"2024-05-15T14:46:37.520606+0000","last_peered":"2024-05-15T14:46:37.520606+0000","last_clean":"2024-05-15T14:46:37.520606+0000","last_became_active":"2024-05-15T14:27:50.849951+0000","last_became_peered":"2024-05-15T14:27:50.849951+0000","last_unstale":"2024-05-15T14:46:37.520606+0000","last_undegraded":"2024-05-15T14:46:37.520606+0000","last_fullsized":"2024-05-15T14:46:37.520606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:35.241681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'2","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.860511+0000","last_change":"2024-05-15T14:27:52.844115+0000","last_active":"2024-05-15T14:47:53.860511+0000","last_peered":"2024-05-15T14:47:53.860511+0000","last_clean":"2024-05-15T14:47:53.860511+0000","last_became_active":"2024-05-15T14:27:52.843836+0000","last_became_peered":"2024-05-15T14:27:52.843836+0000","last_unstale":"2024-05-15T14:47:53.860511+0000","last_undegraded":"2024-05-15T14:47:53.860511+0000","last_fullsized":"2024-05-15T14:47:53.860511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:17.317899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437684+0000","last_change":"2024-05-15T14:27:50.837638+0000","last_active":"2024-05-15T14:48:42.437684+0000","last_peered":"2024-05-15T14:48:42.437684+0000","last_clean":"2024-05-15T14:48:42.437684+0000","last_became_active":"2024-05-15T14:27:50.837321+0000","last_became_peered":"2024-05-15T14:27:50.837321+0000","last_unstale":"2024-05-15T14:48:42.437684+0000","last_undegraded":"2024-05-15T14:48:42.437684+0000","last_fullsized":"2024-05-15T14:48:42.437684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":50,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"39'10","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304257+0000","last_change":"2024-05-15T14:27:52.841298+0000","last_active":"2024-05-15T14:47:54.304257+0000","last_peered":"2024-05-15T14:47:54.304257+0000","last_clean":"2024-05-15T14:47:54.304257+0000","last_became_active":"2024-05-15T14:27:52.840977+0000","last_became_peered":"2024-05-15T14:27:52.840977+0000","last_unstale":"2024-05-15T14:47:54.304257+0000","last_undegraded":"2024-05-15T14:47:54.304257+0000","last_fullsized":"2024-05-15T14:47:54.304257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:50.627819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"39'8","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437757+0000","last_change":"2024-05-15T14:27:50.846251+0000","last_active":"2024-05-15T14:48:42.437757+0000","last_peered":"2024-05-15T14:48:42.437757+0000","last_clean":"2024-05-15T14:48:42.437757+0000","last_became_active":"2024-05-15T14:27:50.844989+0000","last_became_peered":"2024-05-15T14:27:50.844989+0000","last_unstale":"2024-05-15T14:48:42.437757+0000","last_undegraded":"2024-05-15T14:48:42.437757+0000","last_fullsized":"2024-05-15T14:48:42.437757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'24","reported_seq":125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840782+0000","last_change":"2024-05-15T14:27:52.850744+0000","last_active":"2024-05-15T14:47:53.840782+0000","last_peered":"2024-05-15T14:47:53.840782+0000","last_clean":"2024-05-15T14:47:53.840782+0000","last_became_active":"2024-05-15T14:27:52.850449+0000","last_became_peered":"2024-05-15T14:27:52.850449+0000","last_unstale":"2024-05-15T14:47:53.840782+0000","last_undegraded":"2024-05-15T14:47:53.840782+0000","last_fullsized":"2024-05-15T14:47:53.840782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":101,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"39'22","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.426566+0000","last_change":"2024-05-15T14:27:50.852104+0000","last_active":"2024-05-15T14:47:57.426566+0000","last_peered":"2024-05-15T14:47:57.426566+0000","last_clean":"2024-05-15T14:47:57.426566+0000","last_became_active":"2024-05-15T14:27:50.851846+0000","last_became_peered":"2024-05-15T14:27:50.851846+0000","last_unstale":"2024-05-15T14:47:57.426566+0000","last_undegraded":"2024-05-15T14:47:57.426566+0000","last_fullsized":"2024-05-15T14:47:57.426566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":27630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"39'4","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814384+0000","last_change":"2024-05-15T14:27:52.854744+0000","last_active":"2024-05-15T14:47:53.814384+0000","last_peered":"2024-05-15T14:47:53.814384+0000","last_clean":"2024-05-15T14:47:53.814384+0000","last_became_active":"2024-05-15T14:27:52.854481+0000","last_became_peered":"2024-05-15T14:27:52.854481+0000","last_unstale":"2024-05-15T14:47:53.814384+0000","last_undegraded":"2024-05-15T14:47:53.814384+0000","last_fullsized":"2024-05-15T14:47:53.814384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"39'8","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.510681+0000","last_change":"2024-05-15T14:27:50.853255+0000","last_active":"2024-05-15T14:45:22.510681+0000","last_peered":"2024-05-15T14:45:22.510681+0000","last_clean":"2024-05-15T14:45:22.510681+0000","last_became_active":"2024-05-15T14:27:50.851756+0000","last_became_peered":"2024-05-15T14:27:50.851756+0000","last_unstale":"2024-05-15T14:45:22.510681+0000","last_undegraded":"2024-05-15T14:45:22.510681+0000","last_fullsized":"2024-05-15T14:45:22.510681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:50.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14,"num_write":40,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"39'8","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.411312+0000","last_change":"2024-05-15T14:27:52.845713+0000","last_active":"2024-05-15T14:45:57.411312+0000","last_peered":"2024-05-15T14:45:57.411312+0000","last_clean":"2024-05-15T14:45:57.411312+0000","last_became_active":"2024-05-15T14:27:52.844904+0000","last_became_peered":"2024-05-15T14:27:52.844904+0000","last_unstale":"2024-05-15T14:45:57.411312+0000","last_undegraded":"2024-05-15T14:45:57.411312+0000","last_fullsized":"2024-05-15T14:45:57.411312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:52.927880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"39'8","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026317+0000","last_change":"2024-05-15T14:27:50.847389+0000","last_active":"2024-05-15T14:48:26.026317+0000","last_peered":"2024-05-15T14:48:26.026317+0000","last_clean":"2024-05-15T14:48:26.026317+0000","last_became_active":"2024-05-15T14:27:50.847121+0000","last_became_peered":"2024-05-15T14:27:50.847121+0000","last_unstale":"2024-05-15T14:48:26.026317+0000","last_undegraded":"2024-05-15T14:48:26.026317+0000","last_fullsized":"2024-05-15T14:48:26.026317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:48.618636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":24,"num_write_kb":14074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'100","reported_seq":209,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432137+0000","last_change":"2024-05-15T14:27:52.848754+0000","last_active":"2024-05-15T14:48:42.432137+0000","last_peered":"2024-05-15T14:48:42.432137+0000","last_clean":"2024-05-15T14:48:42.432137+0000","last_became_active":"2024-05-15T14:27:52.848482+0000","last_became_peered":"2024-05-15T14:27:52.848482+0000","last_unstale":"2024-05-15T14:48:42.432137+0000","last_undegraded":"2024-05-15T14:48:42.432137+0000","last_fullsized":"2024-05-15T14:48:42.432137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":302,"num_write":142,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"39'10","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.510650+0000","last_change":"2024-05-15T14:27:50.852930+0000","last_active":"2024-05-15T14:45:22.510650+0000","last_peered":"2024-05-15T14:45:22.510650+0000","last_clean":"2024-05-15T14:45:22.510650+0000","last_became_active":"2024-05-15T14:27:50.852659+0000","last_became_peered":"2024-05-15T14:27:50.852659+0000","last_unstale":"2024-05-15T14:45:22.510650+0000","last_undegraded":"2024-05-15T14:45:22.510650+0000","last_fullsized":"2024-05-15T14:45:22.510650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840691+0000","last_change":"2024-05-15T14:27:52.839571+0000","last_active":"2024-05-15T14:47:53.840691+0000","last_peered":"2024-05-15T14:47:53.840691+0000","last_clean":"2024-05-15T14:47:53.840691+0000","last_became_active":"2024-05-15T14:27:52.839017+0000","last_became_peered":"2024-05-15T14:27:52.839017+0000","last_unstale":"2024-05-15T14:47:53.840691+0000","last_undegraded":"2024-05-15T14:47:53.840691+0000","last_fullsized":"2024-05-15T14:47:53.840691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:35.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.279937+0000","last_change":"2024-05-15T14:27:50.854894+0000","last_active":"2024-05-15T14:47:54.279937+0000","last_peered":"2024-05-15T14:47:54.279937+0000","last_clean":"2024-05-15T14:47:54.279937+0000","last_became_active":"2024-05-15T14:27:50.854408+0000","last_became_peered":"2024-05-15T14:27:50.854408+0000","last_unstale":"2024-05-15T14:47:54.279937+0000","last_undegraded":"2024-05-15T14:47:54.279937+0000","last_fullsized":"2024-05-15T14:47:54.279937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25,"num_write":70,"num_write_kb":17643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"39'10","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.524508+0000","last_change":"2024-05-15T14:27:52.853989+0000","last_active":"2024-05-15T14:48:42.524508+0000","last_peered":"2024-05-15T14:48:42.524508+0000","last_clean":"2024-05-15T14:48:42.524508+0000","last_became_active":"2024-05-15T14:27:52.853688+0000","last_became_peered":"2024-05-15T14:27:52.853688+0000","last_unstale":"2024-05-15T14:48:42.524508+0000","last_undegraded":"2024-05-15T14:48:42.524508+0000","last_fullsized":"2024-05-15T14:48:42.524508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"39'4","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433289+0000","last_change":"2024-05-15T14:27:52.850830+0000","last_active":"2024-05-15T14:48:52.433289+0000","last_peered":"2024-05-15T14:48:52.433289+0000","last_clean":"2024-05-15T14:48:52.433289+0000","last_became_active":"2024-05-15T14:27:52.850532+0000","last_became_peered":"2024-05-15T14:27:52.850532+0000","last_unstale":"2024-05-15T14:48:52.433289+0000","last_undegraded":"2024-05-15T14:48:52.433289+0000","last_fullsized":"2024-05-15T14:48:52.433289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.267909+0000","last_change":"2024-05-15T14:27:50.852471+0000","last_active":"2024-05-15T14:47:54.267909+0000","last_peered":"2024-05-15T14:47:54.267909+0000","last_clean":"2024-05-15T14:47:54.267909+0000","last_became_active":"2024-05-15T14:27:50.852229+0000","last_became_peered":"2024-05-15T14:27:50.852229+0000","last_unstale":"2024-05-15T14:47:54.267909+0000","last_undegraded":"2024-05-15T14:47:54.267909+0000","last_fullsized":"2024-05-15T14:47:54.267909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:31.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"39'34","reported_seq":129,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.865681+0000","last_change":"2024-05-15T14:27:52.858540+0000","last_active":"2024-05-15T14:47:53.865681+0000","last_peered":"2024-05-15T14:47:53.865681+0000","last_clean":"2024-05-15T14:47:53.865681+0000","last_became_active":"2024-05-15T14:27:52.858331+0000","last_became_peered":"2024-05-15T14:27:52.858331+0000","last_unstale":"2024-05-15T14:47:53.865681+0000","last_undegraded":"2024-05-15T14:47:53.865681+0000","last_fullsized":"2024-05-15T14:47:53.865681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:50:40.291035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":123,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403413+0000","last_change":"2024-05-15T14:27:50.849840+0000","last_active":"2024-05-15T14:44:47.403413+0000","last_peered":"2024-05-15T14:44:47.403413+0000","last_clean":"2024-05-15T14:44:47.403413+0000","last_became_active":"2024-05-15T14:27:50.849526+0000","last_became_peered":"2024-05-15T14:27:50.849526+0000","last_unstale":"2024-05-15T14:44:47.403413+0000","last_undegraded":"2024-05-15T14:44:47.403413+0000","last_fullsized":"2024-05-15T14:44:47.403413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:59.762815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"39'6","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.866162+0000","last_change":"2024-05-15T14:27:52.840106+0000","last_active":"2024-05-15T14:47:53.866162+0000","last_peered":"2024-05-15T14:47:53.866162+0000","last_clean":"2024-05-15T14:47:53.866162+0000","last_became_active":"2024-05-15T14:27:52.838137+0000","last_became_peered":"2024-05-15T14:27:52.838137+0000","last_unstale":"2024-05-15T14:47:53.866162+0000","last_undegraded":"2024-05-15T14:47:53.866162+0000","last_fullsized":"2024-05-15T14:47:53.866162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:21.975145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403404+0000","last_change":"2024-05-15T14:27:50.842514+0000","last_active":"2024-05-15T14:44:47.403404+0000","last_peered":"2024-05-15T14:44:47.403404+0000","last_clean":"2024-05-15T14:44:47.403404+0000","last_became_active":"2024-05-15T14:27:50.842240+0000","last_became_peered":"2024-05-15T14:27:50.842240+0000","last_unstale":"2024-05-15T14:44:47.403404+0000","last_undegraded":"2024-05-15T14:44:47.403404+0000","last_fullsized":"2024-05-15T14:44:47.403404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:45:32.046811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":70,"num_write_kb":11769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"39'44","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.514094+0000","last_change":"2024-05-15T14:27:52.855297+0000","last_active":"2024-05-15T14:47:12.514094+0000","last_peered":"2024-05-15T14:47:12.514094+0000","last_clean":"2024-05-15T14:47:12.514094+0000","last_became_active":"2024-05-15T14:27:52.854742+0000","last_became_peered":"2024-05-15T14:27:52.854742+0000","last_unstale":"2024-05-15T14:47:12.514094+0000","last_undegraded":"2024-05-15T14:47:12.514094+0000","last_fullsized":"2024-05-15T14:47:12.514094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":128,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.420991+0000","last_change":"2024-05-15T14:27:50.840673+0000","last_active":"2024-05-15T14:47:12.420991+0000","last_peered":"2024-05-15T14:47:12.420991+0000","last_clean":"2024-05-15T14:47:12.420991+0000","last_became_active":"2024-05-15T14:27:50.840405+0000","last_became_peered":"2024-05-15T14:27:50.840405+0000","last_unstale":"2024-05-15T14:47:12.420991+0000","last_undegraded":"2024-05-15T14:47:12.420991+0000","last_fullsized":"2024-05-15T14:47:12.420991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'52","reported_seq":150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.311985+0000","last_change":"2024-05-15T14:27:52.851060+0000","last_active":"2024-05-15T14:47:54.311985+0000","last_peered":"2024-05-15T14:47:54.311985+0000","last_clean":"2024-05-15T14:47:54.311985+0000","last_became_active":"2024-05-15T14:27:52.850696+0000","last_became_peered":"2024-05-15T14:27:52.850696+0000","last_unstale":"2024-05-15T14:47:54.311985+0000","last_undegraded":"2024-05-15T14:47:54.311985+0000","last_fullsized":"2024-05-15T14:47:54.311985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":72,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.264671+0000","last_change":"2024-05-15T14:27:50.849634+0000","last_active":"2024-05-15T14:47:54.264671+0000","last_peered":"2024-05-15T14:47:54.264671+0000","last_clean":"2024-05-15T14:47:54.264671+0000","last_became_active":"2024-05-15T14:27:50.848542+0000","last_became_peered":"2024-05-15T14:27:50.848542+0000","last_unstale":"2024-05-15T14:47:54.264671+0000","last_undegraded":"2024-05-15T14:47:54.264671+0000","last_fullsized":"2024-05-15T14:47:54.264671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":70,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"39'28","reported_seq":117,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.421016+0000","last_change":"2024-05-15T14:27:52.861455+0000","last_active":"2024-05-15T14:47:12.421016+0000","last_peered":"2024-05-15T14:47:12.421016+0000","last_clean":"2024-05-15T14:47:12.421016+0000","last_became_active":"2024-05-15T14:27:52.861166+0000","last_became_peered":"2024-05-15T14:27:52.861166+0000","last_unstale":"2024-05-15T14:47:12.421016+0000","last_undegraded":"2024-05-15T14:47:12.421016+0000","last_fullsized":"2024-05-15T14:47:12.421016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":102,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.439875+0000","last_change":"2024-05-15T14:27:50.837948+0000","last_active":"2024-05-15T14:48:57.439875+0000","last_peered":"2024-05-15T14:48:57.439875+0000","last_clean":"2024-05-15T14:48:57.439875+0000","last_became_active":"2024-05-15T14:27:50.837594+0000","last_became_peered":"2024-05-15T14:27:50.837594+0000","last_unstale":"2024-05-15T14:48:57.439875+0000","last_undegraded":"2024-05-15T14:48:57.439875+0000","last_fullsized":"2024-05-15T14:48:57.439875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.537224+0000","last_change":"2024-05-15T14:31:16.589931+0000","last_active":"2024-05-15T14:48:12.537224+0000","last_peered":"2024-05-15T14:48:12.537224+0000","last_clean":"2024-05-15T14:48:12.537224+0000","last_became_active":"2024-05-15T14:31:16.589649+0000","last_became_peered":"2024-05-15T14:31:16.589649+0000","last_unstale":"2024-05-15T14:48:12.537224+0000","last_undegraded":"2024-05-15T14:48:12.537224+0000","last_fullsized":"2024-05-15T14:48:12.537224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"39'24","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.843062+0000","last_change":"2024-05-15T14:28:02.891667+0000","last_active":"2024-05-15T14:47:53.843062+0000","last_peered":"2024-05-15T14:47:53.843062+0000","last_clean":"2024-05-15T14:47:53.843062+0000","last_became_active":"2024-05-15T14:28:02.891340+0000","last_became_peered":"2024-05-15T14:28:02.891340+0000","last_unstale":"2024-05-15T14:47:53.843062+0000","last_undegraded":"2024-05-15T14:47:53.843062+0000","last_fullsized":"2024-05-15T14:47:53.843062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":38,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"39'78","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.542401+0000","last_change":"2024-05-15T14:27:52.863225+0000","last_active":"2024-05-15T14:48:52.542401+0000","last_peered":"2024-05-15T14:48:52.542401+0000","last_clean":"2024-05-15T14:48:52.542401+0000","last_became_active":"2024-05-15T14:27:52.862960+0000","last_became_peered":"2024-05-15T14:27:52.862960+0000","last_unstale":"2024-05-15T14:48:52.542401+0000","last_undegraded":"2024-05-15T14:48:52.542401+0000","last_fullsized":"2024-05-15T14:48:52.542401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":231,"num_write":112,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519858+0000","last_change":"2024-05-15T14:27:50.849295+0000","last_active":"2024-05-15T14:46:32.519858+0000","last_peered":"2024-05-15T14:46:32.519858+0000","last_clean":"2024-05-15T14:46:32.519858+0000","last_became_active":"2024-05-15T14:27:50.849039+0000","last_became_peered":"2024-05-15T14:27:50.849039+0000","last_unstale":"2024-05-15T14:46:32.519858+0000","last_undegraded":"2024-05-15T14:46:32.519858+0000","last_fullsized":"2024-05-15T14:46:32.519858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:14.556752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.403978+0000","last_change":"2024-05-15T14:27:56.876839+0000","last_active":"2024-05-15T14:44:52.403978+0000","last_peered":"2024-05-15T14:44:52.403978+0000","last_clean":"2024-05-15T14:44:52.403978+0000","last_became_active":"2024-05-15T14:27:56.876559+0000","last_became_peered":"2024-05-15T14:27:56.876559+0000","last_unstale":"2024-05-15T14:44:52.403978+0000","last_undegraded":"2024-05-15T14:44:52.403978+0000","last_fullsized":"2024-05-15T14:44:52.403978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:25.594060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"39'267","reported_seq":547,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.008122+0000","last_change":"2024-05-15T14:27:58.884292+0000","last_active":"2024-05-15T14:48:57.008122+0000","last_peered":"2024-05-15T14:48:57.008122+0000","last_clean":"2024-05-15T14:48:57.008122+0000","last_became_active":"2024-05-15T14:27:58.883983+0000","last_became_peered":"2024-05-15T14:27:58.883983+0000","last_unstale":"2024-05-15T14:48:57.008122+0000","last_undegraded":"2024-05-15T14:48:57.008122+0000","last_fullsized":"2024-05-15T14:48:57.008122+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":459,"num_read_kb":564,"num_write":244,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:57.507472+0000","last_change":"2024-05-15T14:28:00.888232+0000","last_active":"2024-05-15T14:44:57.507472+0000","last_peered":"2024-05-15T14:44:57.507472+0000","last_clean":"2024-05-15T14:44:57.507472+0000","last_became_active":"2024-05-15T14:28:00.887947+0000","last_became_peered":"2024-05-15T14:28:00.887947+0000","last_unstale":"2024-05-15T14:44:57.507472+0000","last_undegraded":"2024-05-15T14:44:57.507472+0000","last_fullsized":"2024-05-15T14:44:57.507472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:52.242951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.410185+0000","last_change":"2024-05-15T14:31:16.588732+0000","last_active":"2024-05-15T14:45:47.410185+0000","last_peered":"2024-05-15T14:45:47.410185+0000","last_clean":"2024-05-15T14:45:47.410185+0000","last_became_active":"2024-05-15T14:31:16.588437+0000","last_became_peered":"2024-05-15T14:31:16.588437+0000","last_unstale":"2024-05-15T14:45:47.410185+0000","last_undegraded":"2024-05-15T14:45:47.410185+0000","last_fullsized":"2024-05-15T14:45:47.410185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:07:39.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"39'109","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.330362+0000","last_change":"2024-05-15T14:28:02.890784+0000","last_active":"2024-05-15T14:47:54.330362+0000","last_peered":"2024-05-15T14:47:54.330362+0000","last_clean":"2024-05-15T14:47:54.330362+0000","last_became_active":"2024-05-15T14:28:02.890477+0000","last_became_peered":"2024-05-15T14:28:02.890477+0000","last_unstale":"2024-05-15T14:47:54.330362+0000","last_undegraded":"2024-05-15T14:47:54.330362+0000","last_fullsized":"2024-05-15T14:47:54.330362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:28:18.439604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":241,"num_write":191,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"39'4","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.833264+0000","last_change":"2024-05-15T14:27:52.841464+0000","last_active":"2024-05-15T14:47:53.833264+0000","last_peered":"2024-05-15T14:47:53.833264+0000","last_clean":"2024-05-15T14:47:53.833264+0000","last_became_active":"2024-05-15T14:27:52.840847+0000","last_became_peered":"2024-05-15T14:27:52.840847+0000","last_unstale":"2024-05-15T14:47:53.833264+0000","last_undegraded":"2024-05-15T14:47:53.833264+0000","last_fullsized":"2024-05-15T14:47:53.833264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.260717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439056+0000","last_change":"2024-05-15T14:27:50.846344+0000","last_active":"2024-05-15T14:48:52.439056+0000","last_peered":"2024-05-15T14:48:52.439056+0000","last_clean":"2024-05-15T14:48:52.439056+0000","last_became_active":"2024-05-15T14:27:50.845923+0000","last_became_peered":"2024-05-15T14:27:50.845923+0000","last_unstale":"2024-05-15T14:48:52.439056+0000","last_undegraded":"2024-05-15T14:48:52.439056+0000","last_fullsized":"2024-05-15T14:48:52.439056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32,"num_write":82,"num_write_kb":27622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.542905+0000","last_change":"2024-05-15T14:27:56.876632+0000","last_active":"2024-05-15T14:48:57.542905+0000","last_peered":"2024-05-15T14:48:57.542905+0000","last_clean":"2024-05-15T14:48:57.542905+0000","last_became_active":"2024-05-15T14:27:56.876325+0000","last_became_peered":"2024-05-15T14:27:56.876325+0000","last_unstale":"2024-05-15T14:48:57.542905+0000","last_undegraded":"2024-05-15T14:48:57.542905+0000","last_fullsized":"2024-05-15T14:48:57.542905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"39'141","reported_seq":255,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.815928+0000","last_change":"2024-05-15T14:27:58.884267+0000","last_active":"2024-05-15T14:47:53.815928+0000","last_peered":"2024-05-15T14:47:53.815928+0000","last_clean":"2024-05-15T14:47:53.815928+0000","last_became_active":"2024-05-15T14:27:58.883792+0000","last_became_peered":"2024-05-15T14:27:58.883792+0000","last_unstale":"2024-05-15T14:47:53.815928+0000","last_undegraded":"2024-05-15T14:47:53.815928+0000","last_fullsized":"2024-05-15T14:47:53.815928+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":205,"num_write":143,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.422341+0000","last_change":"2024-05-15T14:28:00.886183+0000","last_active":"2024-05-15T14:47:22.422341+0000","last_peered":"2024-05-15T14:47:22.422341+0000","last_clean":"2024-05-15T14:47:22.422341+0000","last_became_active":"2024-05-15T14:28:00.885933+0000","last_became_peered":"2024-05-15T14:28:00.885933+0000","last_unstale":"2024-05-15T14:47:22.422341+0000","last_undegraded":"2024-05-15T14:47:22.422341+0000","last_fullsized":"2024-05-15T14:47:22.422341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.541759+0000","last_change":"2024-05-15T14:31:16.594655+0000","last_active":"2024-05-15T14:48:47.541759+0000","last_peered":"2024-05-15T14:48:47.541759+0000","last_clean":"2024-05-15T14:48:47.541759+0000","last_became_active":"2024-05-15T14:31:16.594357+0000","last_became_peered":"2024-05-15T14:31:16.594357+0000","last_unstale":"2024-05-15T14:48:47.541759+0000","last_undegraded":"2024-05-15T14:48:47.541759+0000","last_fullsized":"2024-05-15T14:48:47.541759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"39'16","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.432760+0000","last_change":"2024-05-15T14:28:02.893788+0000","last_active":"2024-05-15T14:48:02.432760+0000","last_peered":"2024-05-15T14:48:02.432760+0000","last_clean":"2024-05-15T14:48:02.432760+0000","last_became_active":"2024-05-15T14:28:02.892764+0000","last_became_peered":"2024-05-15T14:28:02.892764+0000","last_unstale":"2024-05-15T14:48:02.432760+0000","last_undegraded":"2024-05-15T14:48:02.432760+0000","last_fullsized":"2024-05-15T14:48:02.432760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"39'26","reported_seq":125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840703+0000","last_change":"2024-05-15T14:27:52.853179+0000","last_active":"2024-05-15T14:47:53.840703+0000","last_peered":"2024-05-15T14:47:53.840703+0000","last_clean":"2024-05-15T14:47:53.840703+0000","last_became_active":"2024-05-15T14:27:52.852883+0000","last_became_peered":"2024-05-15T14:27:52.852883+0000","last_unstale":"2024-05-15T14:47:53.840703+0000","last_undegraded":"2024-05-15T14:47:53.840703+0000","last_fullsized":"2024-05-15T14:47:53.840703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"39'12","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519834+0000","last_change":"2024-05-15T14:27:50.848690+0000","last_active":"2024-05-15T14:46:32.519834+0000","last_peered":"2024-05-15T14:46:32.519834+0000","last_clean":"2024-05-15T14:46:32.519834+0000","last_became_active":"2024-05-15T14:27:50.848412+0000","last_became_peered":"2024-05-15T14:27:50.848412+0000","last_unstale":"2024-05-15T14:46:32.519834+0000","last_undegraded":"2024-05-15T14:46:32.519834+0000","last_fullsized":"2024-05-15T14:46:32.519834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"39'14","reported_seq":696,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.901760+0000","last_change":"2024-05-15T14:27:56.877306+0000","last_active":"2024-05-15T14:48:56.901760+0000","last_peered":"2024-05-15T14:48:56.901760+0000","last_clean":"2024-05-15T14:48:56.901760+0000","last_became_active":"2024-05-15T14:27:56.877039+0000","last_became_peered":"2024-05-15T14:27:56.877039+0000","last_unstale":"2024-05-15T14:48:56.901760+0000","last_undegraded":"2024-05-15T14:48:56.901760+0000","last_fullsized":"2024-05-15T14:48:56.901760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":635,"num_read_kb":635,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"39'242","reported_seq":405,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.048560+0000","last_change":"2024-05-15T14:27:58.888330+0000","last_active":"2024-05-15T14:49:01.048560+0000","last_peered":"2024-05-15T14:49:01.048560+0000","last_clean":"2024-05-15T14:49:01.048560+0000","last_became_active":"2024-05-15T14:27:58.887969+0000","last_became_peered":"2024-05-15T14:27:58.887969+0000","last_unstale":"2024-05-15T14:49:01.048560+0000","last_undegraded":"2024-05-15T14:49:01.048560+0000","last_fullsized":"2024-05-15T14:49:01.048560+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":351,"num_read_kb":343,"num_write":242,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'927","reported_seq":1433,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.908094+0000","last_change":"2024-05-15T14:28:00.893106+0000","last_active":"2024-05-15T14:48:56.908094+0000","last_peered":"2024-05-15T14:48:56.908094+0000","last_clean":"2024-05-15T14:48:56.908094+0000","last_became_active":"2024-05-15T14:28:00.892864+0000","last_became_peered":"2024-05-15T14:28:00.892864+0000","last_unstale":"2024-05-15T14:48:56.908094+0000","last_undegraded":"2024-05-15T14:48:56.908094+0000","last_fullsized":"2024-05-15T14:48:56.908094+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:44.055462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.541728+0000","last_change":"2024-05-15T14:31:16.584361+0000","last_active":"2024-05-15T14:48:47.541728+0000","last_peered":"2024-05-15T14:48:47.541728+0000","last_clean":"2024-05-15T14:48:47.541728+0000","last_became_active":"2024-05-15T14:31:16.583997+0000","last_became_peered":"2024-05-15T14:31:16.583997+0000","last_unstale":"2024-05-15T14:48:47.541728+0000","last_undegraded":"2024-05-15T14:48:47.541728+0000","last_fullsized":"2024-05-15T14:48:47.541728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"39'29","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.427225+0000","last_change":"2024-05-15T14:28:02.887587+0000","last_active":"2024-05-15T14:48:02.427225+0000","last_peered":"2024-05-15T14:48:02.427225+0000","last_clean":"2024-05-15T14:48:02.427225+0000","last_became_active":"2024-05-15T14:28:02.887257+0000","last_became_peered":"2024-05-15T14:28:02.887257+0000","last_unstale":"2024-05-15T14:48:02.427225+0000","last_undegraded":"2024-05-15T14:48:02.427225+0000","last_fullsized":"2024-05-15T14:48:02.427225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":53,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"39'24","reported_seq":109,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.529452+0000","last_change":"2024-05-15T14:27:52.852418+0000","last_active":"2024-05-15T14:47:12.529452+0000","last_peered":"2024-05-15T14:47:12.529452+0000","last_clean":"2024-05-15T14:47:12.529452+0000","last_became_active":"2024-05-15T14:27:52.851979+0000","last_became_peered":"2024-05-15T14:27:52.851979+0000","last_unstale":"2024-05-15T14:47:12.529452+0000","last_undegraded":"2024-05-15T14:47:12.529452+0000","last_fullsized":"2024-05-15T14:47:12.529452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":90,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"39'6","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.415609+0000","last_change":"2024-05-15T14:27:50.841076+0000","last_active":"2024-05-15T14:46:32.415609+0000","last_peered":"2024-05-15T14:46:32.415609+0000","last_clean":"2024-05-15T14:46:32.415609+0000","last_became_active":"2024-05-15T14:27:50.840772+0000","last_became_peered":"2024-05-15T14:27:50.840772+0000","last_unstale":"2024-05-15T14:46:32.415609+0000","last_undegraded":"2024-05-15T14:46:32.415609+0000","last_fullsized":"2024-05-15T14:46:32.415609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:48:10.102924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":30,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.404007+0000","last_change":"2024-05-15T14:27:56.878098+0000","last_active":"2024-05-15T14:44:52.404007+0000","last_peered":"2024-05-15T14:44:52.404007+0000","last_clean":"2024-05-15T14:44:52.404007+0000","last_became_active":"2024-05-15T14:27:56.877825+0000","last_became_peered":"2024-05-15T14:27:56.877825+0000","last_unstale":"2024-05-15T14:44:52.404007+0000","last_undegraded":"2024-05-15T14:44:52.404007+0000","last_fullsized":"2024-05-15T14:44:52.404007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:42.822420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"39'276","reported_seq":23284,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.991382+0000","last_change":"2024-05-15T14:27:58.887851+0000","last_active":"2024-05-15T14:48:56.991382+0000","last_peered":"2024-05-15T14:48:56.991382+0000","last_clean":"2024-05-15T14:48:56.991382+0000","last_became_active":"2024-05-15T14:27:58.887424+0000","last_became_peered":"2024-05-15T14:27:58.887424+0000","last_unstale":"2024-05-15T14:48:56.991382+0000","last_undegraded":"2024-05-15T14:48:56.991382+0000","last_fullsized":"2024-05-15T14:48:56.991382+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:51.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57546,"num_read_kb":170986,"num_write":274,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'927","reported_seq":2600,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.509700+0000","last_change":"2024-05-15T14:28:00.887805+0000","last_active":"2024-05-15T14:49:01.509700+0000","last_peered":"2024-05-15T14:49:01.509700+0000","last_clean":"2024-05-15T14:49:01.509700+0000","last_became_active":"2024-05-15T14:28:00.887493+0000","last_became_peered":"2024-05-15T14:28:00.887493+0000","last_unstale":"2024-05-15T14:49:01.509700+0000","last_undegraded":"2024-05-15T14:49:01.509700+0000","last_fullsized":"2024-05-15T14:49:01.509700+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.432811+0000","last_change":"2024-05-15T14:31:16.592231+0000","last_active":"2024-05-15T14:48:02.432811+0000","last_peered":"2024-05-15T14:48:02.432811+0000","last_clean":"2024-05-15T14:48:02.432811+0000","last_became_active":"2024-05-15T14:31:16.591945+0000","last_became_peered":"2024-05-15T14:31:16.591945+0000","last_unstale":"2024-05-15T14:48:02.432811+0000","last_undegraded":"2024-05-15T14:48:02.432811+0000","last_fullsized":"2024-05-15T14:48:02.432811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"39'16","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304202+0000","last_change":"2024-05-15T14:27:52.842530+0000","last_active":"2024-05-15T14:47:54.304202+0000","last_peered":"2024-05-15T14:47:54.304202+0000","last_clean":"2024-05-15T14:47:54.304202+0000","last_became_active":"2024-05-15T14:27:52.842056+0000","last_became_peered":"2024-05-15T14:27:52.842056+0000","last_unstale":"2024-05-15T14:47:54.304202+0000","last_undegraded":"2024-05-15T14:47:54.304202+0000","last_fullsized":"2024-05-15T14:47:54.304202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:55.049861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.267576+0000","last_change":"2024-05-15T14:27:50.850292+0000","last_active":"2024-05-15T14:47:54.267576+0000","last_peered":"2024-05-15T14:47:54.267576+0000","last_clean":"2024-05-15T14:47:54.267576+0000","last_became_active":"2024-05-15T14:27:50.849981+0000","last_became_peered":"2024-05-15T14:27:50.849981+0000","last_unstale":"2024-05-15T14:47:54.267576+0000","last_undegraded":"2024-05-15T14:47:54.267576+0000","last_fullsized":"2024-05-15T14:47:54.267576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:33.576570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"39'1","reported_seq":128,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.825445+0000","last_change":"2024-05-15T14:27:56.878571+0000","last_active":"2024-05-15T14:46:21.825445+0000","last_peered":"2024-05-15T14:46:21.825445+0000","last_clean":"2024-05-15T14:46:21.825445+0000","last_became_active":"2024-05-15T14:27:56.878269+0000","last_became_peered":"2024-05-15T14:27:56.878269+0000","last_unstale":"2024-05-15T14:46:21.825445+0000","last_undegraded":"2024-05-15T14:46:21.825445+0000","last_fullsized":"2024-05-15T14:46:21.825445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:26.010836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":160,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"39'427","reported_seq":738,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.018500+0000","last_change":"2024-05-15T14:27:58.883936+0000","last_active":"2024-05-15T14:48:57.018500+0000","last_peered":"2024-05-15T14:48:57.018500+0000","last_clean":"2024-05-15T14:48:57.018500+0000","last_became_active":"2024-05-15T14:27:58.883546+0000","last_became_peered":"2024-05-15T14:27:58.883546+0000","last_unstale":"2024-05-15T14:48:57.018500+0000","last_undegraded":"2024-05-15T14:48:57.018500+0000","last_fullsized":"2024-05-15T14:48:57.018500+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.266839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":668,"num_read_kb":656,"num_write":402,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:17.434467+0000","last_change":"2024-05-15T14:28:00.892179+0000","last_active":"2024-05-15T14:48:17.434467+0000","last_peered":"2024-05-15T14:48:17.434467+0000","last_clean":"2024-05-15T14:48:17.434467+0000","last_became_active":"2024-05-15T14:28:00.891863+0000","last_became_peered":"2024-05-15T14:28:00.891863+0000","last_unstale":"2024-05-15T14:48:17.434467+0000","last_undegraded":"2024-05-15T14:48:17.434467+0000","last_fullsized":"2024-05-15T14:48:17.434467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"39'26","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.306684+0000","last_change":"2024-05-15T14:28:02.890786+0000","last_active":"2024-05-15T14:47:54.306684+0000","last_peered":"2024-05-15T14:47:54.306684+0000","last_clean":"2024-05-15T14:47:54.306684+0000","last_became_active":"2024-05-15T14:28:02.890450+0000","last_became_peered":"2024-05-15T14:28:02.890450+0000","last_unstale":"2024-05-15T14:47:54.306684+0000","last_undegraded":"2024-05-15T14:47:54.306684+0000","last_fullsized":"2024-05-15T14:47:54.306684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:54.527518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.431631+0000","last_change":"2024-05-15T14:31:16.596637+0000","last_active":"2024-05-15T14:47:57.431631+0000","last_peered":"2024-05-15T14:47:57.431631+0000","last_clean":"2024-05-15T14:47:57.431631+0000","last_became_active":"2024-05-15T14:31:16.596344+0000","last_became_peered":"2024-05-15T14:31:16.596344+0000","last_unstale":"2024-05-15T14:47:57.431631+0000","last_undegraded":"2024-05-15T14:47:57.431631+0000","last_fullsized":"2024-05-15T14:47:57.431631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'6","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.311891+0000","last_change":"2024-05-15T14:27:52.861403+0000","last_active":"2024-05-15T14:47:54.311891+0000","last_peered":"2024-05-15T14:47:54.311891+0000","last_clean":"2024-05-15T14:47:54.311891+0000","last_became_active":"2024-05-15T14:27:52.861131+0000","last_became_peered":"2024-05-15T14:27:52.861131+0000","last_unstale":"2024-05-15T14:47:54.311891+0000","last_undegraded":"2024-05-15T14:47:54.311891+0000","last_fullsized":"2024-05-15T14:47:54.311891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514795+0000","last_change":"2024-05-15T14:27:50.848143+0000","last_active":"2024-05-15T14:45:52.514795+0000","last_peered":"2024-05-15T14:45:52.514795+0000","last_clean":"2024-05-15T14:45:52.514795+0000","last_became_active":"2024-05-15T14:27:50.847875+0000","last_became_peered":"2024-05-15T14:27:50.847875+0000","last_unstale":"2024-05-15T14:45:52.514795+0000","last_undegraded":"2024-05-15T14:45:52.514795+0000","last_fullsized":"2024-05-15T14:45:52.514795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:35.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":11761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"39'2","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.405650+0000","last_change":"2024-05-15T14:49:01.405677+0000","last_active":"2024-05-15T14:49:01.405650+0000","last_peered":"2024-05-15T14:49:01.405650+0000","last_clean":"2024-05-15T14:49:01.405650+0000","last_became_active":"2024-05-15T14:27:56.881088+0000","last_became_peered":"2024-05-15T14:27:56.881088+0000","last_unstale":"2024-05-15T14:49:01.405650+0000","last_undegraded":"2024-05-15T14:49:01.405650+0000","last_fullsized":"2024-05-15T14:49:01.405650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:01.405573+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:01.405573+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.405573+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:12:23.625819+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"39'625","reported_seq":1012,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.962200+0000","last_change":"2024-05-15T14:27:58.883054+0000","last_active":"2024-05-15T14:48:56.962200+0000","last_peered":"2024-05-15T14:48:56.962200+0000","last_clean":"2024-05-15T14:48:56.962200+0000","last_became_active":"2024-05-15T14:27:58.882302+0000","last_became_peered":"2024-05-15T14:27:58.882302+0000","last_unstale":"2024-05-15T14:48:56.962200+0000","last_undegraded":"2024-05-15T14:48:56.962200+0000","last_fullsized":"2024-05-15T14:48:56.962200+0000","mapping_epoch":26,"log_start":"39'598","ondisk_log_start":"39'598","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":598,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1288,"num_read_kb":3202,"num_write":806,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:32.532284+0000","last_change":"2024-05-15T14:28:00.887671+0000","last_active":"2024-05-15T14:47:32.532284+0000","last_peered":"2024-05-15T14:47:32.532284+0000","last_clean":"2024-05-15T14:47:32.532284+0000","last_became_active":"2024-05-15T14:28:00.887335+0000","last_became_peered":"2024-05-15T14:28:00.887335+0000","last_unstale":"2024-05-15T14:47:32.532284+0000","last_undegraded":"2024-05-15T14:47:32.532284+0000","last_fullsized":"2024-05-15T14:47:32.532284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"39'15","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.325229+0000","last_change":"2024-05-15T14:28:02.889484+0000","last_active":"2024-05-15T14:47:54.325229+0000","last_peered":"2024-05-15T14:47:54.325229+0000","last_clean":"2024-05-15T14:47:54.325229+0000","last_became_active":"2024-05-15T14:28:02.889193+0000","last_became_peered":"2024-05-15T14:28:02.889193+0000","last_unstale":"2024-05-15T14:47:54.325229+0000","last_undegraded":"2024-05-15T14:47:54.325229+0000","last_fullsized":"2024-05-15T14:47:54.325229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:38.654471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.415472+0000","last_change":"2024-05-15T14:31:16.591065+0000","last_active":"2024-05-15T14:46:27.415472+0000","last_peered":"2024-05-15T14:46:27.415472+0000","last_clean":"2024-05-15T14:46:27.415472+0000","last_became_active":"2024-05-15T14:31:16.590510+0000","last_became_peered":"2024-05-15T14:31:16.590510+0000","last_unstale":"2024-05-15T14:46:27.415472+0000","last_undegraded":"2024-05-15T14:46:27.415472+0000","last_fullsized":"2024-05-15T14:46:27.415472+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:15.350673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"39'64","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.296114+0000","last_change":"2024-05-15T14:27:52.861599+0000","last_active":"2024-05-15T14:47:54.296114+0000","last_peered":"2024-05-15T14:47:54.296114+0000","last_clean":"2024-05-15T14:47:54.296114+0000","last_became_active":"2024-05-15T14:27:52.861183+0000","last_became_peered":"2024-05-15T14:27:52.861183+0000","last_unstale":"2024-05-15T14:47:54.296114+0000","last_undegraded":"2024-05-15T14:47:54.296114+0000","last_fullsized":"2024-05-15T14:47:54.296114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:37.266001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":194,"num_write":90,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514768+0000","last_change":"2024-05-15T14:27:50.853049+0000","last_active":"2024-05-15T14:45:52.514768+0000","last_peered":"2024-05-15T14:45:52.514768+0000","last_clean":"2024-05-15T14:45:52.514768+0000","last_became_active":"2024-05-15T14:27:50.852376+0000","last_became_peered":"2024-05-15T14:27:50.852376+0000","last_unstale":"2024-05-15T14:45:52.514768+0000","last_undegraded":"2024-05-15T14:45:52.514768+0000","last_fullsized":"2024-05-15T14:45:52.514768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:14.064855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.442355+0000","last_change":"2024-05-15T14:49:02.442381+0000","last_active":"2024-05-15T14:49:02.442355+0000","last_peered":"2024-05-15T14:49:02.442355+0000","last_clean":"2024-05-15T14:49:02.442355+0000","last_became_active":"2024-05-15T14:27:56.881701+0000","last_became_peered":"2024-05-15T14:27:56.881701+0000","last_unstale":"2024-05-15T14:49:02.442355+0000","last_undegraded":"2024-05-15T14:49:02.442355+0000","last_fullsized":"2024-05-15T14:49:02.442355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:02.442283+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:02.442283+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.442283+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:35:32.123039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"39'434","reported_seq":797,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.024802+0000","last_change":"2024-05-15T14:27:58.886060+0000","last_active":"2024-05-15T14:48:57.024802+0000","last_peered":"2024-05-15T14:48:57.024802+0000","last_clean":"2024-05-15T14:48:57.024802+0000","last_became_active":"2024-05-15T14:27:58.885487+0000","last_became_peered":"2024-05-15T14:27:58.885487+0000","last_unstale":"2024-05-15T14:48:57.024802+0000","last_undegraded":"2024-05-15T14:48:57.024802+0000","last_fullsized":"2024-05-15T14:48:57.024802+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:27.428584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":878,"num_read_kb":1340,"num_write":447,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"39'927","reported_seq":1548,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.061584+0000","last_change":"2024-05-15T14:28:00.893226+0000","last_active":"2024-05-15T14:48:57.061584+0000","last_peered":"2024-05-15T14:48:57.061584+0000","last_clean":"2024-05-15T14:48:57.061584+0000","last_became_active":"2024-05-15T14:28:00.892897+0000","last_became_peered":"2024-05-15T14:28:00.892897+0000","last_unstale":"2024-05-15T14:48:57.061584+0000","last_undegraded":"2024-05-15T14:48:57.061584+0000","last_fullsized":"2024-05-15T14:48:57.061584+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"39'14","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.754565+0000","last_change":"2024-05-15T14:28:02.894508+0000","last_active":"2024-05-15T14:47:53.754565+0000","last_peered":"2024-05-15T14:47:53.754565+0000","last_clean":"2024-05-15T14:47:53.754565+0000","last_became_active":"2024-05-15T14:28:02.894071+0000","last_became_peered":"2024-05-15T14:28:02.894071+0000","last_unstale":"2024-05-15T14:47:53.754565+0000","last_undegraded":"2024-05-15T14:47:53.754565+0000","last_fullsized":"2024-05-15T14:47:53.754565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:27.415437+0000","last_change":"2024-05-15T14:31:16.591474+0000","last_active":"2024-05-15T14:46:27.415437+0000","last_peered":"2024-05-15T14:46:27.415437+0000","last_clean":"2024-05-15T14:46:27.415437+0000","last_became_active":"2024-05-15T14:31:16.591166+0000","last_became_peered":"2024-05-15T14:31:16.591166+0000","last_unstale":"2024-05-15T14:46:27.415437+0000","last_undegraded":"2024-05-15T14:46:27.415437+0000","last_fullsized":"2024-05-15T14:46:27.415437+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:19:18.238793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'114","reported_seq":207,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.433495+0000","last_change":"2024-05-15T14:27:52.860101+0000","last_active":"2024-05-15T14:48:07.433495+0000","last_peered":"2024-05-15T14:48:07.433495+0000","last_clean":"2024-05-15T14:48:07.433495+0000","last_became_active":"2024-05-15T14:27:52.859814+0000","last_became_peered":"2024-05-15T14:27:52.859814+0000","last_unstale":"2024-05-15T14:48:07.433495+0000","last_undegraded":"2024-05-15T14:48:07.433495+0000","last_fullsized":"2024-05-15T14:48:07.433495+0000","mapping_epoch":20,"log_start":"39'100","ondisk_log_start":"39'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":332,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411210+0000","last_change":"2024-05-15T14:27:50.849872+0000","last_active":"2024-05-15T14:45:52.411210+0000","last_peered":"2024-05-15T14:45:52.411210+0000","last_clean":"2024-05-15T14:45:52.411210+0000","last_became_active":"2024-05-15T14:27:50.849548+0000","last_became_peered":"2024-05-15T14:27:50.849548+0000","last_unstale":"2024-05-15T14:45:52.411210+0000","last_undegraded":"2024-05-15T14:45:52.411210+0000","last_fullsized":"2024-05-15T14:45:52.411210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:17.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"39'6","reported_seq":648,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.813433+0000","last_change":"2024-05-15T14:27:56.871956+0000","last_active":"2024-05-15T14:48:52.813433+0000","last_peered":"2024-05-15T14:48:52.813433+0000","last_clean":"2024-05-15T14:48:52.813433+0000","last_became_active":"2024-05-15T14:27:56.871644+0000","last_became_peered":"2024-05-15T14:27:56.871644+0000","last_unstale":"2024-05-15T14:48:52.813433+0000","last_undegraded":"2024-05-15T14:48:52.813433+0000","last_fullsized":"2024-05-15T14:48:52.813433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":148,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'281","reported_seq":575,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.032547+0000","last_change":"2024-05-15T14:27:58.881240+0000","last_active":"2024-05-15T14:48:57.032547+0000","last_peered":"2024-05-15T14:48:57.032547+0000","last_clean":"2024-05-15T14:48:57.032547+0000","last_became_active":"2024-05-15T14:27:58.880926+0000","last_became_peered":"2024-05-15T14:27:58.880926+0000","last_unstale":"2024-05-15T14:48:57.032547+0000","last_undegraded":"2024-05-15T14:48:57.032547+0000","last_fullsized":"2024-05-15T14:48:57.032547+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":467,"num_write":232,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:32.516345+0000","last_change":"2024-05-15T14:28:00.886629+0000","last_active":"2024-05-15T14:47:32.516345+0000","last_peered":"2024-05-15T14:47:32.516345+0000","last_clean":"2024-05-15T14:47:32.516345+0000","last_became_active":"2024-05-15T14:28:00.886359+0000","last_became_peered":"2024-05-15T14:28:00.886359+0000","last_unstale":"2024-05-15T14:47:32.516345+0000","last_undegraded":"2024-05-15T14:47:32.516345+0000","last_fullsized":"2024-05-15T14:47:32.516345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"39'29","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.335124+0000","last_change":"2024-05-15T14:28:02.892567+0000","last_active":"2024-05-15T14:47:54.335124+0000","last_peered":"2024-05-15T14:47:54.335124+0000","last_clean":"2024-05-15T14:47:54.335124+0000","last_became_active":"2024-05-15T14:28:02.892287+0000","last_became_peered":"2024-05-15T14:28:02.892287+0000","last_unstale":"2024-05-15T14:47:54.335124+0000","last_undegraded":"2024-05-15T14:47:54.335124+0000","last_fullsized":"2024-05-15T14:47:54.335124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.535310+0000","last_change":"2024-05-15T14:31:16.590519+0000","last_active":"2024-05-15T14:47:57.535310+0000","last_peered":"2024-05-15T14:47:57.535310+0000","last_clean":"2024-05-15T14:47:57.535310+0000","last_became_active":"2024-05-15T14:31:16.590227+0000","last_became_peered":"2024-05-15T14:31:16.590227+0000","last_unstale":"2024-05-15T14:47:57.535310+0000","last_undegraded":"2024-05-15T14:47:57.535310+0000","last_fullsized":"2024-05-15T14:47:57.535310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427780+0000","last_change":"2024-05-15T14:27:52.851931+0000","last_active":"2024-05-15T14:48:07.427780+0000","last_peered":"2024-05-15T14:48:07.427780+0000","last_clean":"2024-05-15T14:48:07.427780+0000","last_became_active":"2024-05-15T14:27:52.851589+0000","last_became_peered":"2024-05-15T14:27:52.851589+0000","last_unstale":"2024-05-15T14:48:07.427780+0000","last_undegraded":"2024-05-15T14:48:07.427780+0000","last_fullsized":"2024-05-15T14:48:07.427780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"39'14","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.027357+0000","last_change":"2024-05-15T14:27:50.850680+0000","last_active":"2024-05-15T14:48:26.027357+0000","last_peered":"2024-05-15T14:48:26.027357+0000","last_clean":"2024-05-15T14:48:26.027357+0000","last_became_active":"2024-05-15T14:27:50.850389+0000","last_became_peered":"2024-05-15T14:27:50.850389+0000","last_unstale":"2024-05-15T14:48:26.027357+0000","last_undegraded":"2024-05-15T14:48:26.027357+0000","last_fullsized":"2024-05-15T14:48:26.027357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":19,"num_write":54,"num_write_kb":19955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"25'1","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.520879+0000","last_change":"2024-05-15T14:27:56.877565+0000","last_active":"2024-05-15T14:48:12.520879+0000","last_peered":"2024-05-15T14:48:12.520879+0000","last_clean":"2024-05-15T14:48:12.520879+0000","last_became_active":"2024-05-15T14:27:56.876626+0000","last_became_peered":"2024-05-15T14:27:56.876626+0000","last_unstale":"2024-05-15T14:48:12.520879+0000","last_undegraded":"2024-05-15T14:48:12.520879+0000","last_fullsized":"2024-05-15T14:48:12.520879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"39'365","reported_seq":592,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.974633+0000","last_change":"2024-05-15T14:27:58.885446+0000","last_active":"2024-05-15T14:48:56.974633+0000","last_peered":"2024-05-15T14:48:56.974633+0000","last_clean":"2024-05-15T14:48:56.974633+0000","last_became_active":"2024-05-15T14:27:58.885156+0000","last_became_peered":"2024-05-15T14:27:58.885156+0000","last_unstale":"2024-05-15T14:48:56.974633+0000","last_undegraded":"2024-05-15T14:48:56.974633+0000","last_fullsized":"2024-05-15T14:48:56.974633+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":666,"num_write":563,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:22.435313+0000","last_change":"2024-05-15T14:28:00.885938+0000","last_active":"2024-05-15T14:48:22.435313+0000","last_peered":"2024-05-15T14:48:22.435313+0000","last_clean":"2024-05-15T14:48:22.435313+0000","last_became_active":"2024-05-15T14:28:00.885582+0000","last_became_peered":"2024-05-15T14:28:00.885582+0000","last_unstale":"2024-05-15T14:48:22.435313+0000","last_undegraded":"2024-05-15T14:48:22.435313+0000","last_fullsized":"2024-05-15T14:48:22.435313+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"39'25","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.644153+0000","last_change":"2024-05-15T14:49:01.644201+0000","last_active":"2024-05-15T14:49:01.644153+0000","last_peered":"2024-05-15T14:49:01.644153+0000","last_clean":"2024-05-15T14:49:01.644153+0000","last_became_active":"2024-05-15T14:28:02.891419+0000","last_became_peered":"2024-05-15T14:28:02.891419+0000","last_unstale":"2024-05-15T14:49:01.644153+0000","last_undegraded":"2024-05-15T14:49:01.644153+0000","last_fullsized":"2024-05-15T14:49:01.644153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:01.644062+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:01.644062+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.644062+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:25.023932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427234+0000","last_change":"2024-05-15T14:31:16.594272+0000","last_active":"2024-05-15T14:47:22.427234+0000","last_peered":"2024-05-15T14:47:22.427234+0000","last_clean":"2024-05-15T14:47:22.427234+0000","last_became_active":"2024-05-15T14:31:16.593942+0000","last_became_peered":"2024-05-15T14:31:16.593942+0000","last_unstale":"2024-05-15T14:47:22.427234+0000","last_undegraded":"2024-05-15T14:47:22.427234+0000","last_fullsized":"2024-05-15T14:47:22.427234+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'62","reported_seq":169,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427817+0000","last_change":"2024-05-15T14:27:52.854103+0000","last_active":"2024-05-15T14:48:07.427817+0000","last_peered":"2024-05-15T14:48:07.427817+0000","last_clean":"2024-05-15T14:48:07.427817+0000","last_became_active":"2024-05-15T14:27:52.853828+0000","last_became_peered":"2024-05-15T14:27:52.853828+0000","last_unstale":"2024-05-15T14:48:07.427817+0000","last_undegraded":"2024-05-15T14:48:07.427817+0000","last_fullsized":"2024-05-15T14:48:07.427817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":210,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407053+0000","last_change":"2024-05-15T14:27:50.838852+0000","last_active":"2024-05-15T14:45:17.407053+0000","last_peered":"2024-05-15T14:45:17.407053+0000","last_clean":"2024-05-15T14:45:17.407053+0000","last_became_active":"2024-05-15T14:27:50.838561+0000","last_became_peered":"2024-05-15T14:27:50.838561+0000","last_unstale":"2024-05-15T14:45:17.407053+0000","last_undegraded":"2024-05-15T14:45:17.407053+0000","last_fullsized":"2024-05-15T14:45:17.407053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:04.000024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.433734+0000","last_change":"2024-05-15T14:27:56.885185+0000","last_active":"2024-05-15T14:48:12.433734+0000","last_peered":"2024-05-15T14:48:12.433734+0000","last_clean":"2024-05-15T14:48:12.433734+0000","last_became_active":"2024-05-15T14:27:56.884903+0000","last_became_peered":"2024-05-15T14:27:56.884903+0000","last_unstale":"2024-05-15T14:48:12.433734+0000","last_undegraded":"2024-05-15T14:48:12.433734+0000","last_fullsized":"2024-05-15T14:48:12.433734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"39'344","reported_seq":608,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.051361+0000","last_change":"2024-05-15T14:27:58.876510+0000","last_active":"2024-05-15T14:48:57.051361+0000","last_peered":"2024-05-15T14:48:57.051361+0000","last_clean":"2024-05-15T14:48:57.051361+0000","last_became_active":"2024-05-15T14:27:58.876221+0000","last_became_peered":"2024-05-15T14:27:58.876221+0000","last_unstale":"2024-05-15T14:48:57.051361+0000","last_undegraded":"2024-05-15T14:48:57.051361+0000","last_fullsized":"2024-05-15T14:48:57.051361+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":528,"num_write":320,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'927","reported_seq":1401,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.057438+0000","last_change":"2024-05-15T14:28:00.884330+0000","last_active":"2024-05-15T14:48:57.057438+0000","last_peered":"2024-05-15T14:48:57.057438+0000","last_clean":"2024-05-15T14:48:57.057438+0000","last_became_active":"2024-05-15T14:28:00.884042+0000","last_became_peered":"2024-05-15T14:28:00.884042+0000","last_unstale":"2024-05-15T14:48:57.057438+0000","last_undegraded":"2024-05-15T14:48:57.057438+0000","last_fullsized":"2024-05-15T14:48:57.057438+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"39'23","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439050+0000","last_change":"2024-05-15T14:28:02.888922+0000","last_active":"2024-05-15T14:48:52.439050+0000","last_peered":"2024-05-15T14:48:52.439050+0000","last_clean":"2024-05-15T14:48:52.439050+0000","last_became_active":"2024-05-15T14:28:02.888602+0000","last_became_peered":"2024-05-15T14:28:02.888602+0000","last_unstale":"2024-05-15T14:48:52.439050+0000","last_undegraded":"2024-05-15T14:48:52.439050+0000","last_fullsized":"2024-05-15T14:48:52.439050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.514713+0000","last_change":"2024-05-15T14:31:16.591991+0000","last_active":"2024-05-15T14:45:52.514713+0000","last_peered":"2024-05-15T14:45:52.514713+0000","last_clean":"2024-05-15T14:45:52.514713+0000","last_became_active":"2024-05-15T14:31:16.591677+0000","last_became_peered":"2024-05-15T14:31:16.591677+0000","last_unstale":"2024-05-15T14:45:52.514713+0000","last_undegraded":"2024-05-15T14:45:52.514713+0000","last_fullsized":"2024-05-15T14:45:52.514713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:14:24.885155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'72","reported_seq":200,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427845+0000","last_change":"2024-05-15T14:27:52.844483+0000","last_active":"2024-05-15T14:48:07.427845+0000","last_peered":"2024-05-15T14:48:07.427845+0000","last_clean":"2024-05-15T14:48:07.427845+0000","last_became_active":"2024-05-15T14:27:52.844221+0000","last_became_peered":"2024-05-15T14:27:52.844221+0000","last_unstale":"2024-05-15T14:48:07.427845+0000","last_undegraded":"2024-05-15T14:48:07.427845+0000","last_fullsized":"2024-05-15T14:48:07.427845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":255,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.027273+0000","last_change":"2024-05-15T14:27:50.849342+0000","last_active":"2024-05-15T14:48:26.027273+0000","last_peered":"2024-05-15T14:48:26.027273+0000","last_clean":"2024-05-15T14:48:26.027273+0000","last_became_active":"2024-05-15T14:27:50.846927+0000","last_became_peered":"2024-05-15T14:27:50.846927+0000","last_unstale":"2024-05-15T14:48:26.027273+0000","last_undegraded":"2024-05-15T14:48:26.027273+0000","last_fullsized":"2024-05-15T14:48:26.027273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":82,"num_write_kb":24687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'6","reported_seq":803,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.885683+0000","last_change":"2024-05-15T14:27:56.882327+0000","last_active":"2024-05-15T14:48:56.885683+0000","last_peered":"2024-05-15T14:48:56.885683+0000","last_clean":"2024-05-15T14:48:56.885683+0000","last_became_active":"2024-05-15T14:27:56.882055+0000","last_became_peered":"2024-05-15T14:27:56.882055+0000","last_unstale":"2024-05-15T14:48:56.885683+0000","last_undegraded":"2024-05-15T14:48:56.885683+0000","last_fullsized":"2024-05-15T14:48:56.885683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:49.672371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1075,"num_read_kb":1818,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"39'231","reported_seq":385,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:17.537992+0000","last_change":"2024-05-15T14:27:58.878945+0000","last_active":"2024-05-15T14:48:17.537992+0000","last_peered":"2024-05-15T14:48:17.537992+0000","last_clean":"2024-05-15T14:48:17.537992+0000","last_became_active":"2024-05-15T14:27:58.878514+0000","last_became_peered":"2024-05-15T14:27:58.878514+0000","last_unstale":"2024-05-15T14:48:17.537992+0000","last_undegraded":"2024-05-15T14:48:17.537992+0000","last_fullsized":"2024-05-15T14:48:17.537992+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":332,"num_write":230,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'927","reported_seq":1432,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.910150+0000","last_change":"2024-05-15T14:28:00.891775+0000","last_active":"2024-05-15T14:48:56.910150+0000","last_peered":"2024-05-15T14:48:56.910150+0000","last_clean":"2024-05-15T14:48:56.910150+0000","last_became_active":"2024-05-15T14:28:00.891535+0000","last_became_peered":"2024-05-15T14:28:00.891535+0000","last_unstale":"2024-05-15T14:48:56.910150+0000","last_undegraded":"2024-05-15T14:48:56.910150+0000","last_fullsized":"2024-05-15T14:48:56.910150+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:38:03.092896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"39'19","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433349+0000","last_change":"2024-05-15T14:28:02.889970+0000","last_active":"2024-05-15T14:48:52.433349+0000","last_peered":"2024-05-15T14:48:52.433349+0000","last_clean":"2024-05-15T14:48:52.433349+0000","last_became_active":"2024-05-15T14:28:02.889039+0000","last_became_peered":"2024-05-15T14:28:02.889039+0000","last_unstale":"2024-05-15T14:48:52.433349+0000","last_undegraded":"2024-05-15T14:48:52.433349+0000","last_fullsized":"2024-05-15T14:48:52.433349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.535332+0000","last_change":"2024-05-15T14:31:16.593519+0000","last_active":"2024-05-15T14:47:57.535332+0000","last_peered":"2024-05-15T14:47:57.535332+0000","last_clean":"2024-05-15T14:47:57.535332+0000","last_became_active":"2024-05-15T14:31:16.593216+0000","last_became_peered":"2024-05-15T14:31:16.593216+0000","last_unstale":"2024-05-15T14:47:57.535332+0000","last_undegraded":"2024-05-15T14:47:57.535332+0000","last_fullsized":"2024-05-15T14:47:57.535332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'24","reported_seq":119,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.433784+0000","last_change":"2024-05-15T14:27:52.855239+0000","last_active":"2024-05-15T14:48:12.433784+0000","last_peered":"2024-05-15T14:48:12.433784+0000","last_clean":"2024-05-15T14:48:12.433784+0000","last_became_active":"2024-05-15T14:27:52.854963+0000","last_became_peered":"2024-05-15T14:27:52.854963+0000","last_unstale":"2024-05-15T14:48:12.433784+0000","last_undegraded":"2024-05-15T14:48:12.433784+0000","last_fullsized":"2024-05-15T14:48:12.433784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.530848+0000","last_change":"2024-05-15T14:27:50.847492+0000","last_active":"2024-05-15T14:47:22.530848+0000","last_peered":"2024-05-15T14:47:22.530848+0000","last_clean":"2024-05-15T14:47:22.530848+0000","last_became_active":"2024-05-15T14:27:50.847163+0000","last_became_peered":"2024-05-15T14:27:50.847163+0000","last_unstale":"2024-05-15T14:47:22.530848+0000","last_undegraded":"2024-05-15T14:47:22.530848+0000","last_fullsized":"2024-05-15T14:47:22.530848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.428485+0000","last_change":"2024-05-15T14:27:56.880246+0000","last_active":"2024-05-15T14:48:12.428485+0000","last_peered":"2024-05-15T14:48:12.428485+0000","last_clean":"2024-05-15T14:48:12.428485+0000","last_became_active":"2024-05-15T14:27:56.879526+0000","last_became_peered":"2024-05-15T14:27:56.879526+0000","last_unstale":"2024-05-15T14:48:12.428485+0000","last_undegraded":"2024-05-15T14:48:12.428485+0000","last_fullsized":"2024-05-15T14:48:12.428485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"39'408","reported_seq":693,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.010059+0000","last_change":"2024-05-15T14:27:58.883156+0000","last_active":"2024-05-15T14:48:57.010059+0000","last_peered":"2024-05-15T14:48:57.010059+0000","last_clean":"2024-05-15T14:48:57.010059+0000","last_became_active":"2024-05-15T14:27:58.882886+0000","last_became_peered":"2024-05-15T14:27:58.882886+0000","last_unstale":"2024-05-15T14:48:57.010059+0000","last_undegraded":"2024-05-15T14:48:57.010059+0000","last_fullsized":"2024-05-15T14:48:57.010059+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:42.051812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":660,"num_read_kb":650,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:02.412107+0000","last_change":"2024-05-15T14:28:00.885713+0000","last_active":"2024-05-15T14:46:02.412107+0000","last_peered":"2024-05-15T14:46:02.412107+0000","last_clean":"2024-05-15T14:46:02.412107+0000","last_became_active":"2024-05-15T14:28:00.885434+0000","last_became_peered":"2024-05-15T14:28:00.885434+0000","last_unstale":"2024-05-15T14:46:02.412107+0000","last_undegraded":"2024-05-15T14:46:02.412107+0000","last_fullsized":"2024-05-15T14:46:02.412107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:30.563508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"39'18","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439122+0000","last_change":"2024-05-15T14:28:02.890234+0000","last_active":"2024-05-15T14:48:52.439122+0000","last_peered":"2024-05-15T14:48:52.439122+0000","last_clean":"2024-05-15T14:48:52.439122+0000","last_became_active":"2024-05-15T14:28:02.889918+0000","last_became_peered":"2024-05-15T14:28:02.889918+0000","last_unstale":"2024-05-15T14:48:52.439122+0000","last_undegraded":"2024-05-15T14:48:52.439122+0000","last_fullsized":"2024-05-15T14:48:52.439122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.540394+0000","last_change":"2024-05-15T14:31:16.594123+0000","last_active":"2024-05-15T14:48:37.540394+0000","last_peered":"2024-05-15T14:48:37.540394+0000","last_clean":"2024-05-15T14:48:37.540394+0000","last_became_active":"2024-05-15T14:31:16.593813+0000","last_became_peered":"2024-05-15T14:31:16.593813+0000","last_unstale":"2024-05-15T14:48:37.540394+0000","last_undegraded":"2024-05-15T14:48:37.540394+0000","last_fullsized":"2024-05-15T14:48:37.540394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'64","reported_seq":184,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840377+0000","last_change":"2024-05-15T14:27:52.846883+0000","last_active":"2024-05-15T14:47:53.840377+0000","last_peered":"2024-05-15T14:47:53.840377+0000","last_clean":"2024-05-15T14:47:53.840377+0000","last_became_active":"2024-05-15T14:27:52.846508+0000","last_became_peered":"2024-05-15T14:27:52.846508+0000","last_unstale":"2024-05-15T14:47:53.840377+0000","last_undegraded":"2024-05-15T14:47:53.840377+0000","last_fullsized":"2024-05-15T14:47:53.840377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:40.944809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":231,"num_write":88,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514066+0000","last_change":"2024-05-15T14:27:43.806336+0000","last_active":"2024-05-15T14:45:47.514066+0000","last_peered":"2024-05-15T14:45:47.514066+0000","last_clean":"2024-05-15T14:45:47.514066+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:45:47.514066+0000","last_undegraded":"2024-05-15T14:45:47.514066+0000","last_fullsized":"2024-05-15T14:45:47.514066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_clean_scrub_stamp":"2024-05-15T14:27:42.789461+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:25.195322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416082+0000","last_change":"2024-05-15T14:27:44.808919+0000","last_active":"2024-05-15T14:46:32.416082+0000","last_peered":"2024-05-15T14:46:32.416082+0000","last_clean":"2024-05-15T14:46:32.416082+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:46:32.416082+0000","last_undegraded":"2024-05-15T14:46:32.416082+0000","last_fullsized":"2024-05-15T14:46:32.416082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:14:06.922563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"39'26","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.541056+0000","last_change":"2024-05-15T14:27:50.850434+0000","last_active":"2024-05-15T14:48:42.541056+0000","last_peered":"2024-05-15T14:48:42.541056+0000","last_clean":"2024-05-15T14:48:42.541056+0000","last_became_active":"2024-05-15T14:27:50.849731+0000","last_became_peered":"2024-05-15T14:27:50.849731+0000","last_unstale":"2024-05-15T14:48:42.541056+0000","last_undegraded":"2024-05-15T14:48:42.541056+0000","last_fullsized":"2024-05-15T14:48:42.541056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":50,"num_write":130,"num_write_kb":35292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.521236+0000","last_change":"2024-05-15T14:27:56.878884+0000","last_active":"2024-05-15T14:46:42.521236+0000","last_peered":"2024-05-15T14:46:42.521236+0000","last_clean":"2024-05-15T14:46:42.521236+0000","last_became_active":"2024-05-15T14:27:56.878611+0000","last_became_peered":"2024-05-15T14:27:56.878611+0000","last_unstale":"2024-05-15T14:46:42.521236+0000","last_undegraded":"2024-05-15T14:46:42.521236+0000","last_fullsized":"2024-05-15T14:46:42.521236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:17:39.394172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"39'350","reported_seq":3185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.044185+0000","last_change":"2024-05-15T14:27:58.884541+0000","last_active":"2024-05-15T14:48:57.044185+0000","last_peered":"2024-05-15T14:48:57.044185+0000","last_clean":"2024-05-15T14:48:57.044185+0000","last_became_active":"2024-05-15T14:27:58.884237+0000","last_became_peered":"2024-05-15T14:27:58.884237+0000","last_unstale":"2024-05-15T14:48:57.044185+0000","last_undegraded":"2024-05-15T14:48:57.044185+0000","last_fullsized":"2024-05-15T14:48:57.044185+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:50.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":8049,"num_read_kb":5529,"num_write":261,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:32.428730+0000","last_change":"2024-05-15T14:28:00.887075+0000","last_active":"2024-05-15T14:47:32.428730+0000","last_peered":"2024-05-15T14:47:32.428730+0000","last_clean":"2024-05-15T14:47:32.428730+0000","last_became_active":"2024-05-15T14:28:00.886539+0000","last_became_peered":"2024-05-15T14:28:00.886539+0000","last_unstale":"2024-05-15T14:47:32.428730+0000","last_undegraded":"2024-05-15T14:47:32.428730+0000","last_fullsized":"2024-05-15T14:47:32.428730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"39'21","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.728874+0000","last_change":"2024-05-15T14:28:02.892380+0000","last_active":"2024-05-15T14:47:53.728874+0000","last_peered":"2024-05-15T14:47:53.728874+0000","last_clean":"2024-05-15T14:47:53.728874+0000","last_became_active":"2024-05-15T14:28:02.892076+0000","last_became_peered":"2024-05-15T14:28:02.892076+0000","last_unstale":"2024-05-15T14:47:53.728874+0000","last_undegraded":"2024-05-15T14:47:53.728874+0000","last_fullsized":"2024-05-15T14:47:53.728874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:04.849548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.b","version":"39'3","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:02.424845+0000","last_change":"2024-05-15T14:31:16.592642+0000","last_active":"2024-05-15T14:47:02.424845+0000","last_peered":"2024-05-15T14:47:02.424845+0000","last_clean":"2024-05-15T14:47:02.424845+0000","last_became_active":"2024-05-15T14:31:16.592325+0000","last_became_peered":"2024-05-15T14:31:16.592325+0000","last_unstale":"2024-05-15T14:47:02.424845+0000","last_undegraded":"2024-05-15T14:47:02.424845+0000","last_fullsized":"2024-05-15T14:47:02.424845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'26","reported_seq":132,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427528+0000","last_change":"2024-05-15T14:27:52.859118+0000","last_active":"2024-05-15T14:47:22.427528+0000","last_peered":"2024-05-15T14:47:22.427528+0000","last_clean":"2024-05-15T14:47:22.427528+0000","last_became_active":"2024-05-15T14:27:52.858631+0000","last_became_peered":"2024-05-15T14:27:52.858631+0000","last_unstale":"2024-05-15T14:47:22.427528+0000","last_undegraded":"2024-05-15T14:47:22.427528+0000","last_fullsized":"2024-05-15T14:47:22.427528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514045+0000","last_change":"2024-05-15T14:27:44.810189+0000","last_active":"2024-05-15T14:45:47.514045+0000","last_peered":"2024-05-15T14:45:47.514045+0000","last_clean":"2024-05-15T14:45:47.514045+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:45:47.514045+0000","last_undegraded":"2024-05-15T14:45:47.514045+0000","last_fullsized":"2024-05-15T14:45:47.514045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:29.474022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'9","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437689+0000","last_change":"2024-05-15T14:27:50.833876+0000","last_active":"2024-05-15T14:48:42.437689+0000","last_peered":"2024-05-15T14:48:42.437689+0000","last_clean":"2024-05-15T14:48:42.437689+0000","last_became_active":"2024-05-15T14:27:50.833509+0000","last_became_peered":"2024-05-15T14:27:50.833509+0000","last_unstale":"2024-05-15T14:48:42.437689+0000","last_undegraded":"2024-05-15T14:48:42.437689+0000","last_fullsized":"2024-05-15T14:48:42.437689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":37,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407312+0000","last_change":"2024-05-15T14:27:56.876813+0000","last_active":"2024-05-15T14:45:17.407312+0000","last_peered":"2024-05-15T14:45:17.407312+0000","last_clean":"2024-05-15T14:45:17.407312+0000","last_became_active":"2024-05-15T14:27:56.876526+0000","last_became_peered":"2024-05-15T14:27:56.876526+0000","last_unstale":"2024-05-15T14:45:17.407312+0000","last_undegraded":"2024-05-15T14:45:17.407312+0000","last_fullsized":"2024-05-15T14:45:17.407312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:54.193440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"39'1098","reported_seq":2224,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.053386+0000","last_change":"2024-05-15T14:27:58.887397+0000","last_active":"2024-05-15T14:48:57.053386+0000","last_peered":"2024-05-15T14:48:57.053386+0000","last_clean":"2024-05-15T14:48:57.053386+0000","last_became_active":"2024-05-15T14:27:58.887083+0000","last_became_peered":"2024-05-15T14:27:58.887083+0000","last_unstale":"2024-05-15T14:48:57.053386+0000","last_undegraded":"2024-05-15T14:48:57.053386+0000","last_fullsized":"2024-05-15T14:48:57.053386+0000","mapping_epoch":26,"log_start":"39'1000","ondisk_log_start":"39'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1728,"num_read_kb":1712,"num_write":408,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:47.521852+0000","last_change":"2024-05-15T14:28:00.890674+0000","last_active":"2024-05-15T14:46:47.521852+0000","last_peered":"2024-05-15T14:46:47.521852+0000","last_clean":"2024-05-15T14:46:47.521852+0000","last_became_active":"2024-05-15T14:28:00.890321+0000","last_became_peered":"2024-05-15T14:28:00.890321+0000","last_unstale":"2024-05-15T14:46:47.521852+0000","last_undegraded":"2024-05-15T14:46:47.521852+0000","last_fullsized":"2024-05-15T14:46:47.521852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:17.270488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"39'20","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.124776+0000","last_change":"2024-05-15T14:49:01.124836+0000","last_active":"2024-05-15T14:49:01.124776+0000","last_peered":"2024-05-15T14:49:01.124776+0000","last_clean":"2024-05-15T14:49:01.124776+0000","last_became_active":"2024-05-15T14:28:02.883249+0000","last_became_peered":"2024-05-15T14:28:02.883249+0000","last_unstale":"2024-05-15T14:49:01.124776+0000","last_undegraded":"2024-05-15T14:49:01.124776+0000","last_fullsized":"2024-05-15T14:49:01.124776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:01.124687+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:01.124687+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.124687+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:37.809153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416034+0000","last_change":"2024-05-15T14:31:16.593784+0000","last_active":"2024-05-15T14:46:32.416034+0000","last_peered":"2024-05-15T14:46:32.416034+0000","last_clean":"2024-05-15T14:46:32.416034+0000","last_became_active":"2024-05-15T14:31:16.593500+0000","last_became_peered":"2024-05-15T14:31:16.593500+0000","last_unstale":"2024-05-15T14:46:32.416034+0000","last_undegraded":"2024-05-15T14:46:32.416034+0000","last_fullsized":"2024-05-15T14:46:32.416034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:01.704595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"39'14","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427352+0000","last_change":"2024-05-15T14:27:52.844475+0000","last_active":"2024-05-15T14:47:22.427352+0000","last_peered":"2024-05-15T14:47:22.427352+0000","last_clean":"2024-05-15T14:47:22.427352+0000","last_became_active":"2024-05-15T14:27:52.844149+0000","last_became_peered":"2024-05-15T14:27:52.844149+0000","last_unstale":"2024-05-15T14:47:22.427352+0000","last_undegraded":"2024-05-15T14:47:22.427352+0000","last_fullsized":"2024-05-15T14:47:22.427352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:32.523211+0000","last_change":"2024-05-15T14:27:45.305663+0000","last_active":"2024-05-15T14:48:32.523211+0000","last_peered":"2024-05-15T14:48:32.523211+0000","last_clean":"2024-05-15T14:48:32.523211+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:48:32.523211+0000","last_undegraded":"2024-05-15T14:48:32.523211+0000","last_fullsized":"2024-05-15T14:48:32.523211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'16","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.431588+0000","last_change":"2024-05-15T14:27:50.845090+0000","last_active":"2024-05-15T14:47:57.431588+0000","last_peered":"2024-05-15T14:47:57.431588+0000","last_clean":"2024-05-15T14:47:57.431588+0000","last_became_active":"2024-05-15T14:27:50.844771+0000","last_became_peered":"2024-05-15T14:27:50.844771+0000","last_unstale":"2024-05-15T14:47:57.431588+0000","last_undegraded":"2024-05-15T14:47:57.431588+0000","last_fullsized":"2024-05-15T14:47:57.431588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"39'12","reported_seq":723,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.899350+0000","last_change":"2024-05-15T14:27:56.880418+0000","last_active":"2024-05-15T14:48:56.899350+0000","last_peered":"2024-05-15T14:48:56.899350+0000","last_clean":"2024-05-15T14:48:56.899350+0000","last_became_active":"2024-05-15T14:27:56.880109+0000","last_became_peered":"2024-05-15T14:27:56.880109+0000","last_unstale":"2024-05-15T14:48:56.899350+0000","last_undegraded":"2024-05-15T14:48:56.899350+0000","last_fullsized":"2024-05-15T14:48:56.899350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":702,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"39'271","reported_seq":763,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.707634+0000","last_change":"2024-05-15T14:27:58.888770+0000","last_active":"2024-05-15T14:47:52.707634+0000","last_peered":"2024-05-15T14:47:52.707634+0000","last_clean":"2024-05-15T14:47:52.707634+0000","last_became_active":"2024-05-15T14:27:58.888477+0000","last_became_peered":"2024-05-15T14:27:58.888477+0000","last_unstale":"2024-05-15T14:47:52.707634+0000","last_undegraded":"2024-05-15T14:47:52.707634+0000","last_fullsized":"2024-05-15T14:47:52.707634+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:12.868288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":392,"num_write":265,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439104+0000","last_change":"2024-05-15T14:28:00.880873+0000","last_active":"2024-05-15T14:48:52.439104+0000","last_peered":"2024-05-15T14:48:52.439104+0000","last_clean":"2024-05-15T14:48:52.439104+0000","last_became_active":"2024-05-15T14:28:00.880488+0000","last_became_peered":"2024-05-15T14:28:00.880488+0000","last_unstale":"2024-05-15T14:48:52.439104+0000","last_undegraded":"2024-05-15T14:48:52.439104+0000","last_fullsized":"2024-05-15T14:48:52.439104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'21","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:17.537947+0000","last_change":"2024-05-15T14:28:02.894486+0000","last_active":"2024-05-15T14:48:17.537947+0000","last_peered":"2024-05-15T14:48:17.537947+0000","last_clean":"2024-05-15T14:48:17.537947+0000","last_became_active":"2024-05-15T14:28:02.893812+0000","last_became_peered":"2024-05-15T14:28:02.893812+0000","last_unstale":"2024-05-15T14:48:17.537947+0000","last_undegraded":"2024-05-15T14:48:17.537947+0000","last_fullsized":"2024-05-15T14:48:17.537947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":112,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.437052+0000","last_change":"2024-05-15T14:31:16.589892+0000","last_active":"2024-05-15T14:48:37.437052+0000","last_peered":"2024-05-15T14:48:37.437052+0000","last_clean":"2024-05-15T14:48:37.437052+0000","last_became_active":"2024-05-15T14:31:16.589610+0000","last_became_peered":"2024-05-15T14:31:16.589610+0000","last_unstale":"2024-05-15T14:48:37.437052+0000","last_undegraded":"2024-05-15T14:48:37.437052+0000","last_fullsized":"2024-05-15T14:48:37.437052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"39'4","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437630+0000","last_change":"2024-05-15T14:27:52.840002+0000","last_active":"2024-05-15T14:48:42.437630+0000","last_peered":"2024-05-15T14:48:42.437630+0000","last_clean":"2024-05-15T14:48:42.437630+0000","last_became_active":"2024-05-15T14:27:52.839722+0000","last_became_peered":"2024-05-15T14:27:52.839722+0000","last_unstale":"2024-05-15T14:48:42.437630+0000","last_undegraded":"2024-05-15T14:48:42.437630+0000","last_fullsized":"2024-05-15T14:48:42.437630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416067+0000","last_change":"2024-05-15T14:27:44.810023+0000","last_active":"2024-05-15T14:46:32.416067+0000","last_peered":"2024-05-15T14:46:32.416067+0000","last_clean":"2024-05-15T14:46:32.416067+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:46:32.416067+0000","last_undegraded":"2024-05-15T14:46:32.416067+0000","last_fullsized":"2024-05-15T14:46:32.416067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:39:09.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'16","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432113+0000","last_change":"2024-05-15T14:27:50.837385+0000","last_active":"2024-05-15T14:48:42.432113+0000","last_peered":"2024-05-15T14:48:42.432113+0000","last_clean":"2024-05-15T14:48:42.432113+0000","last_became_active":"2024-05-15T14:27:50.836731+0000","last_became_peered":"2024-05-15T14:27:50.836731+0000","last_unstale":"2024-05-15T14:48:42.432113+0000","last_undegraded":"2024-05-15T14:48:42.432113+0000","last_fullsized":"2024-05-15T14:48:42.432113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439121+0000","last_change":"2024-05-15T14:27:56.880397+0000","last_active":"2024-05-15T14:48:52.439121+0000","last_peered":"2024-05-15T14:48:52.439121+0000","last_clean":"2024-05-15T14:48:52.439121+0000","last_became_active":"2024-05-15T14:27:56.880118+0000","last_became_peered":"2024-05-15T14:27:56.880118+0000","last_unstale":"2024-05-15T14:48:52.439121+0000","last_undegraded":"2024-05-15T14:48:52.439121+0000","last_fullsized":"2024-05-15T14:48:52.439121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"39'330","reported_seq":83276,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.652610+0000","last_change":"2024-05-15T14:27:58.882371+0000","last_active":"2024-05-15T14:47:52.652610+0000","last_peered":"2024-05-15T14:47:52.652610+0000","last_clean":"2024-05-15T14:47:52.652610+0000","last_became_active":"2024-05-15T14:27:58.882039+0000","last_became_peered":"2024-05-15T14:27:58.882039+0000","last_unstale":"2024-05-15T14:47:52.652610+0000","last_undegraded":"2024-05-15T14:47:52.652610+0000","last_fullsized":"2024-05-15T14:47:52.652610+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207654,"num_read_kb":557003,"num_write":353,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.407638+0000","last_change":"2024-05-15T14:28:00.887372+0000","last_active":"2024-05-15T14:45:22.407638+0000","last_peered":"2024-05-15T14:45:22.407638+0000","last_clean":"2024-05-15T14:45:22.407638+0000","last_became_active":"2024-05-15T14:28:00.887095+0000","last_became_peered":"2024-05-15T14:28:00.887095+0000","last_unstale":"2024-05-15T14:45:22.407638+0000","last_undegraded":"2024-05-15T14:45:22.407638+0000","last_fullsized":"2024-05-15T14:45:22.407638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:32:30.018180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"39'14","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.259616+0000","last_change":"2024-05-15T14:28:02.892539+0000","last_active":"2024-05-15T14:46:21.259616+0000","last_peered":"2024-05-15T14:46:21.259616+0000","last_clean":"2024-05-15T14:46:21.259616+0000","last_became_active":"2024-05-15T14:28:02.892255+0000","last_became_peered":"2024-05-15T14:28:02.892255+0000","last_unstale":"2024-05-15T14:46:21.259616+0000","last_undegraded":"2024-05-15T14:46:21.259616+0000","last_fullsized":"2024-05-15T14:46:21.259616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:27.053905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:52.404020+0000","last_change":"2024-05-15T14:31:16.593868+0000","last_active":"2024-05-15T14:44:52.404020+0000","last_peered":"2024-05-15T14:44:52.404020+0000","last_clean":"2024-05-15T14:44:52.404020+0000","last_became_active":"2024-05-15T14:31:16.593582+0000","last_became_peered":"2024-05-15T14:31:16.593582+0000","last_unstale":"2024-05-15T14:44:52.404020+0000","last_undegraded":"2024-05-15T14:44:52.404020+0000","last_fullsized":"2024-05-15T14:44:52.404020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:38:46.732341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'44","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437586+0000","last_change":"2024-05-15T14:27:52.851444+0000","last_active":"2024-05-15T14:48:42.437586+0000","last_peered":"2024-05-15T14:48:42.437586+0000","last_clean":"2024-05-15T14:48:42.437586+0000","last_became_active":"2024-05-15T14:27:52.851166+0000","last_became_peered":"2024-05-15T14:27:52.851166+0000","last_unstale":"2024-05-15T14:48:42.437586+0000","last_undegraded":"2024-05-15T14:48:42.437586+0000","last_fullsized":"2024-05-15T14:48:42.437586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":125,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"39'8","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.025231+0000","last_change":"2024-05-15T14:28:37.941507+0000","last_active":"2024-05-15T14:48:26.025231+0000","last_peered":"2024-05-15T14:48:26.025231+0000","last_clean":"2024-05-15T14:48:26.025231+0000","last_became_active":"2024-05-15T14:28:37.941149+0000","last_became_peered":"2024-05-15T14:28:37.941149+0000","last_unstale":"2024-05-15T14:48:26.025231+0000","last_undegraded":"2024-05-15T14:48:26.025231+0000","last_fullsized":"2024-05-15T14:48:26.025231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11,"num_write":32,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.436927+0000","last_change":"2024-05-15T14:27:45.305199+0000","last_active":"2024-05-15T14:48:37.436927+0000","last_peered":"2024-05-15T14:48:37.436927+0000","last_clean":"2024-05-15T14:48:37.436927+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:48:37.436927+0000","last_undegraded":"2024-05-15T14:48:37.436927+0000","last_fullsized":"2024-05-15T14:48:37.436927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438334+0000","last_change":"2024-05-15T14:27:56.881338+0000","last_active":"2024-05-15T14:48:47.438334+0000","last_peered":"2024-05-15T14:48:47.438334+0000","last_clean":"2024-05-15T14:48:47.438334+0000","last_became_active":"2024-05-15T14:27:56.881083+0000","last_became_peered":"2024-05-15T14:27:56.881083+0000","last_unstale":"2024-05-15T14:48:47.438334+0000","last_undegraded":"2024-05-15T14:48:47.438334+0000","last_fullsized":"2024-05-15T14:48:47.438334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"39'483","reported_seq":941,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.048020+0000","last_change":"2024-05-15T14:27:58.884245+0000","last_active":"2024-05-15T14:48:57.048020+0000","last_peered":"2024-05-15T14:48:57.048020+0000","last_clean":"2024-05-15T14:48:57.048020+0000","last_became_active":"2024-05-15T14:27:58.883886+0000","last_became_peered":"2024-05-15T14:27:58.883886+0000","last_unstale":"2024-05-15T14:48:57.048020+0000","last_undegraded":"2024-05-15T14:48:57.048020+0000","last_fullsized":"2024-05-15T14:48:57.048020+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1031,"num_read_kb":1287,"num_write":497,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.420978+0000","last_change":"2024-05-15T14:49:02.421002+0000","last_active":"2024-05-15T14:49:02.420978+0000","last_peered":"2024-05-15T14:49:02.420978+0000","last_clean":"2024-05-15T14:49:02.420978+0000","last_became_active":"2024-05-15T14:28:00.884315+0000","last_became_peered":"2024-05-15T14:28:00.884315+0000","last_unstale":"2024-05-15T14:49:02.420978+0000","last_undegraded":"2024-05-15T14:49:02.420978+0000","last_fullsized":"2024-05-15T14:49:02.420978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:02.420884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:02.420884+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.420884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:35:34.607185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"39'38","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.066817+0000","last_change":"2024-05-15T14:49:02.066854+0000","last_active":"2024-05-15T14:49:02.066817+0000","last_peered":"2024-05-15T14:49:02.066817+0000","last_clean":"2024-05-15T14:49:02.066817+0000","last_became_active":"2024-05-15T14:28:02.889093+0000","last_became_peered":"2024-05-15T14:28:02.889093+0000","last_unstale":"2024-05-15T14:49:02.066817+0000","last_undegraded":"2024-05-15T14:49:02.066817+0000","last_fullsized":"2024-05-15T14:49:02.066817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'38","last_scrub_stamp":"2024-05-15T14:49:02.066732+0000","last_deep_scrub":"39'38","last_deep_scrub_stamp":"2024-05-15T14:49:02.066732+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.066732+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:17:37.278158+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":151,"num_write":63,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:27.515899+0000","last_change":"2024-05-15T14:31:38.627137+0000","last_active":"2024-05-15T14:47:27.515899+0000","last_peered":"2024-05-15T14:47:27.515899+0000","last_clean":"2024-05-15T14:47:27.515899+0000","last_became_active":"2024-05-15T14:31:38.626777+0000","last_became_peered":"2024-05-15T14:31:38.626777+0000","last_unstale":"2024-05-15T14:47:27.515899+0000","last_undegraded":"2024-05-15T14:47:27.515899+0000","last_fullsized":"2024-05-15T14:47:27.515899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'50","reported_seq":142,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437733+0000","last_change":"2024-05-15T14:27:52.846446+0000","last_active":"2024-05-15T14:48:42.437733+0000","last_peered":"2024-05-15T14:48:42.437733+0000","last_clean":"2024-05-15T14:48:42.437733+0000","last_became_active":"2024-05-15T14:27:52.846171+0000","last_became_peered":"2024-05-15T14:27:52.846171+0000","last_unstale":"2024-05-15T14:48:42.437733+0000","last_undegraded":"2024-05-15T14:48:42.437733+0000","last_fullsized":"2024-05-15T14:48:42.437733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":163,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437646+0000","last_change":"2024-05-15T14:27:50.845054+0000","last_active":"2024-05-15T14:48:42.437646+0000","last_peered":"2024-05-15T14:48:42.437646+0000","last_clean":"2024-05-15T14:48:42.437646+0000","last_became_active":"2024-05-15T14:27:50.844741+0000","last_became_peered":"2024-05-15T14:27:50.844741+0000","last_unstale":"2024-05-15T14:48:42.437646+0000","last_undegraded":"2024-05-15T14:48:42.437646+0000","last_fullsized":"2024-05-15T14:48:42.437646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":80,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.519875+0000","last_change":"2024-05-15T14:27:45.305329+0000","last_active":"2024-05-15T14:46:32.519875+0000","last_peered":"2024-05-15T14:46:32.519875+0000","last_clean":"2024-05-15T14:46:32.519875+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:46:32.519875+0000","last_undegraded":"2024-05-15T14:46:32.519875+0000","last_fullsized":"2024-05-15T14:46:32.519875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:38:59.332936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416750+0000","last_change":"2024-05-15T14:27:56.881115+0000","last_active":"2024-05-15T14:46:42.416750+0000","last_peered":"2024-05-15T14:46:42.416750+0000","last_clean":"2024-05-15T14:46:42.416750+0000","last_became_active":"2024-05-15T14:27:56.880842+0000","last_became_peered":"2024-05-15T14:27:56.880842+0000","last_unstale":"2024-05-15T14:46:42.416750+0000","last_undegraded":"2024-05-15T14:46:42.416750+0000","last_fullsized":"2024-05-15T14:46:42.416750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:23.904400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"39'491","reported_seq":504319,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439015+0000","last_change":"2024-05-15T14:27:58.882555+0000","last_active":"2024-05-15T14:48:52.439015+0000","last_peered":"2024-05-15T14:48:52.439015+0000","last_clean":"2024-05-15T14:48:52.439015+0000","last_became_active":"2024-05-15T14:27:58.882284+0000","last_became_peered":"2024-05-15T14:27:58.882284+0000","last_unstale":"2024-05-15T14:48:52.439015+0000","last_undegraded":"2024-05-15T14:48:52.439015+0000","last_fullsized":"2024-05-15T14:48:52.439015+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1259744,"num_read_kb":3777635,"num_write":703,"num_write_kb":2009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"39'927","reported_seq":1372,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.906882+0000","last_change":"2024-05-15T14:28:00.892454+0000","last_active":"2024-05-15T14:48:56.906882+0000","last_peered":"2024-05-15T14:48:56.906882+0000","last_clean":"2024-05-15T14:48:56.906882+0000","last_became_active":"2024-05-15T14:28:00.891484+0000","last_became_peered":"2024-05-15T14:28:00.891484+0000","last_unstale":"2024-05-15T14:48:56.906882+0000","last_undegraded":"2024-05-15T14:48:56.906882+0000","last_fullsized":"2024-05-15T14:48:56.906882+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:42.711145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"39'18","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:17.538025+0000","last_change":"2024-05-15T14:28:02.891735+0000","last_active":"2024-05-15T14:48:17.538025+0000","last_peered":"2024-05-15T14:48:17.538025+0000","last_clean":"2024-05-15T14:48:17.538025+0000","last_became_active":"2024-05-15T14:28:02.891380+0000","last_became_peered":"2024-05-15T14:28:02.891380+0000","last_unstale":"2024-05-15T14:48:17.538025+0000","last_undegraded":"2024-05-15T14:48:17.538025+0000","last_fullsized":"2024-05-15T14:48:17.538025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":35,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.505963+0000","last_change":"2024-05-15T14:31:16.594082+0000","last_active":"2024-05-15T14:44:47.505963+0000","last_peered":"2024-05-15T14:44:47.505963+0000","last_clean":"2024-05-15T14:44:47.505963+0000","last_became_active":"2024-05-15T14:31:16.593811+0000","last_became_peered":"2024-05-15T14:31:16.593811+0000","last_unstale":"2024-05-15T14:44:47.505963+0000","last_undegraded":"2024-05-15T14:44:47.505963+0000","last_fullsized":"2024-05-15T14:44:47.505963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:50:49.314475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"39'18","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.523931+0000","last_change":"2024-05-15T14:28:37.942802+0000","last_active":"2024-05-15T14:48:37.523931+0000","last_peered":"2024-05-15T14:48:37.523931+0000","last_clean":"2024-05-15T14:48:37.523931+0000","last_became_active":"2024-05-15T14:28:37.942459+0000","last_became_peered":"2024-05-15T14:28:37.942459+0000","last_unstale":"2024-05-15T14:48:37.523931+0000","last_undegraded":"2024-05-15T14:48:37.523931+0000","last_fullsized":"2024-05-15T14:48:37.523931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.530974+0000","last_change":"2024-05-15T14:27:50.854562+0000","last_active":"2024-05-15T14:47:22.530974+0000","last_peered":"2024-05-15T14:47:22.530974+0000","last_clean":"2024-05-15T14:47:22.530974+0000","last_became_active":"2024-05-15T14:27:50.854248+0000","last_became_peered":"2024-05-15T14:27:50.854248+0000","last_unstale":"2024-05-15T14:47:22.530974+0000","last_undegraded":"2024-05-15T14:47:22.530974+0000","last_fullsized":"2024-05-15T14:47:22.530974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":50,"num_write_kb":8823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.425853+0000","last_change":"2024-05-15T14:27:44.808690+0000","last_active":"2024-05-15T14:47:12.425853+0000","last_peered":"2024-05-15T14:47:12.425853+0000","last_clean":"2024-05-15T14:47:12.425853+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:47:12.425853+0000","last_undegraded":"2024-05-15T14:47:12.425853+0000","last_fullsized":"2024-05-15T14:47:12.425853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'1","reported_seq":58,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.432701+0000","last_change":"2024-05-15T14:27:56.876363+0000","last_active":"2024-05-15T14:48:47.432701+0000","last_peered":"2024-05-15T14:48:47.432701+0000","last_clean":"2024-05-15T14:48:47.432701+0000","last_became_active":"2024-05-15T14:27:56.875993+0000","last_became_peered":"2024-05-15T14:27:56.875993+0000","last_unstale":"2024-05-15T14:48:47.432701+0000","last_undegraded":"2024-05-15T14:48:47.432701+0000","last_fullsized":"2024-05-15T14:48:47.432701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"39'225","reported_seq":384,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433368+0000","last_change":"2024-05-15T14:27:58.885451+0000","last_active":"2024-05-15T14:48:52.433368+0000","last_peered":"2024-05-15T14:48:52.433368+0000","last_clean":"2024-05-15T14:48:52.433368+0000","last_became_active":"2024-05-15T14:27:58.885090+0000","last_became_peered":"2024-05-15T14:27:58.885090+0000","last_unstale":"2024-05-15T14:48:52.433368+0000","last_undegraded":"2024-05-15T14:48:52.433368+0000","last_fullsized":"2024-05-15T14:48:52.433368+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"39'927","reported_seq":1446,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.059457+0000","last_change":"2024-05-15T14:28:00.887968+0000","last_active":"2024-05-15T14:48:57.059457+0000","last_peered":"2024-05-15T14:48:57.059457+0000","last_clean":"2024-05-15T14:48:57.059457+0000","last_became_active":"2024-05-15T14:28:00.884286+0000","last_became_peered":"2024-05-15T14:28:00.884286+0000","last_unstale":"2024-05-15T14:48:57.059457+0000","last_undegraded":"2024-05-15T14:48:57.059457+0000","last_fullsized":"2024-05-15T14:48:57.059457+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"39'24","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:17.434691+0000","last_change":"2024-05-15T14:28:02.892844+0000","last_active":"2024-05-15T14:48:17.434691+0000","last_peered":"2024-05-15T14:48:17.434691+0000","last_clean":"2024-05-15T14:48:17.434691+0000","last_became_active":"2024-05-15T14:28:02.891822+0000","last_became_peered":"2024-05-15T14:28:02.891822+0000","last_unstale":"2024-05-15T14:48:17.434691+0000","last_undegraded":"2024-05-15T14:48:17.434691+0000","last_fullsized":"2024-05-15T14:48:17.434691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:02.528232+0000","last_change":"2024-05-15T14:31:16.596256+0000","last_active":"2024-05-15T14:47:02.528232+0000","last_peered":"2024-05-15T14:47:02.528232+0000","last_clean":"2024-05-15T14:47:02.528232+0000","last_became_active":"2024-05-15T14:31:16.595913+0000","last_became_peered":"2024-05-15T14:31:16.595913+0000","last_unstale":"2024-05-15T14:47:02.528232+0000","last_undegraded":"2024-05-15T14:47:02.528232+0000","last_fullsized":"2024-05-15T14:47:02.528232+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"39'16","reported_seq":116,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432048+0000","last_change":"2024-05-15T14:27:52.848596+0000","last_active":"2024-05-15T14:48:42.432048+0000","last_peered":"2024-05-15T14:48:42.432048+0000","last_clean":"2024-05-15T14:48:42.432048+0000","last_became_active":"2024-05-15T14:27:52.848087+0000","last_became_peered":"2024-05-15T14:27:52.848087+0000","last_unstale":"2024-05-15T14:48:42.432048+0000","last_undegraded":"2024-05-15T14:48:42.432048+0000","last_fullsized":"2024-05-15T14:48:42.432048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427553+0000","last_change":"2024-05-15T14:27:50.840684+0000","last_active":"2024-05-15T14:47:22.427553+0000","last_peered":"2024-05-15T14:47:22.427553+0000","last_clean":"2024-05-15T14:47:22.427553+0000","last_became_active":"2024-05-15T14:27:50.840365+0000","last_became_peered":"2024-05-15T14:27:50.840365+0000","last_unstale":"2024-05-15T14:47:22.427553+0000","last_undegraded":"2024-05-15T14:47:22.427553+0000","last_fullsized":"2024-05-15T14:47:22.427553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:07.405827+0000","last_change":"2024-05-15T14:27:44.808595+0000","last_active":"2024-05-15T14:45:07.405827+0000","last_peered":"2024-05-15T14:45:07.405827+0000","last_clean":"2024-05-15T14:45:07.405827+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:45:07.405827+0000","last_undegraded":"2024-05-15T14:45:07.405827+0000","last_fullsized":"2024-05-15T14:45:07.405827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:43:26.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"39'12","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.535282+0000","last_change":"2024-05-15T14:27:56.875443+0000","last_active":"2024-05-15T14:47:57.535282+0000","last_peered":"2024-05-15T14:47:57.535282+0000","last_clean":"2024-05-15T14:47:57.535282+0000","last_became_active":"2024-05-15T14:27:56.875166+0000","last_became_peered":"2024-05-15T14:27:56.875166+0000","last_unstale":"2024-05-15T14:47:57.535282+0000","last_undegraded":"2024-05-15T14:47:57.535282+0000","last_fullsized":"2024-05-15T14:47:57.535282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'548","reported_seq":972,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.003990+0000","last_change":"2024-05-15T14:27:58.881816+0000","last_active":"2024-05-15T14:48:57.003990+0000","last_peered":"2024-05-15T14:48:57.003990+0000","last_clean":"2024-05-15T14:48:57.003990+0000","last_became_active":"2024-05-15T14:27:58.881529+0000","last_became_peered":"2024-05-15T14:27:58.881529+0000","last_unstale":"2024-05-15T14:48:57.003990+0000","last_undegraded":"2024-05-15T14:48:57.003990+0000","last_fullsized":"2024-05-15T14:48:57.003990+0000","mapping_epoch":26,"log_start":"39'500","ondisk_log_start":"39'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:44.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":967,"num_read_kb":997,"num_write":702,"num_write_kb":2669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.542351+0000","last_change":"2024-05-15T14:28:00.892129+0000","last_active":"2024-05-15T14:48:52.542351+0000","last_peered":"2024-05-15T14:48:52.542351+0000","last_clean":"2024-05-15T14:48:52.542351+0000","last_became_active":"2024-05-15T14:28:00.890685+0000","last_became_peered":"2024-05-15T14:28:00.890685+0000","last_unstale":"2024-05-15T14:48:52.542351+0000","last_undegraded":"2024-05-15T14:48:52.542351+0000","last_fullsized":"2024-05-15T14:48:52.542351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"39'29","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.787639+0000","last_change":"2024-05-15T14:28:02.893523+0000","last_active":"2024-05-15T14:47:53.787639+0000","last_peered":"2024-05-15T14:47:53.787639+0000","last_clean":"2024-05-15T14:47:53.787639+0000","last_became_active":"2024-05-15T14:28:02.893174+0000","last_became_peered":"2024-05-15T14:28:02.893174+0000","last_unstale":"2024-05-15T14:47:53.787639+0000","last_undegraded":"2024-05-15T14:47:53.787639+0000","last_fullsized":"2024-05-15T14:47:53.787639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:58.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427478+0000","last_change":"2024-05-15T14:31:16.593175+0000","last_active":"2024-05-15T14:47:22.427478+0000","last_peered":"2024-05-15T14:47:22.427478+0000","last_clean":"2024-05-15T14:47:22.427478+0000","last_became_active":"2024-05-15T14:31:16.592898+0000","last_became_peered":"2024-05-15T14:31:16.592898+0000","last_unstale":"2024-05-15T14:47:22.427478+0000","last_undegraded":"2024-05-15T14:47:22.427478+0000","last_fullsized":"2024-05-15T14:47:22.427478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'26","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439153+0000","last_change":"2024-05-15T14:28:02.893742+0000","last_active":"2024-05-15T14:48:52.439153+0000","last_peered":"2024-05-15T14:48:52.439153+0000","last_clean":"2024-05-15T14:48:52.439153+0000","last_became_active":"2024-05-15T14:28:02.892547+0000","last_became_peered":"2024-05-15T14:28:02.892547+0000","last_unstale":"2024-05-15T14:48:52.439153+0000","last_undegraded":"2024-05-15T14:48:52.439153+0000","last_fullsized":"2024-05-15T14:48:52.439153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":37,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"39'44","reported_seq":130,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433398+0000","last_change":"2024-05-15T14:27:52.842978+0000","last_active":"2024-05-15T14:48:52.433398+0000","last_peered":"2024-05-15T14:48:52.433398+0000","last_clean":"2024-05-15T14:48:52.433398+0000","last_became_active":"2024-05-15T14:27:52.842733+0000","last_became_peered":"2024-05-15T14:27:52.842733+0000","last_unstale":"2024-05-15T14:48:52.433398+0000","last_undegraded":"2024-05-15T14:48:52.433398+0000","last_fullsized":"2024-05-15T14:48:52.433398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":143,"num_write":62,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"39'22","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.024866+0000","last_change":"2024-05-15T14:28:37.941321+0000","last_active":"2024-05-15T14:48:26.024866+0000","last_peered":"2024-05-15T14:48:26.024866+0000","last_clean":"2024-05-15T14:48:26.024866+0000","last_became_active":"2024-05-15T14:28:37.940961+0000","last_became_peered":"2024-05-15T14:28:37.940961+0000","last_unstale":"2024-05-15T14:48:26.024866+0000","last_undegraded":"2024-05-15T14:48:26.024866+0000","last_fullsized":"2024-05-15T14:48:26.024866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":33493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'2","reported_seq":1009,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.439864+0000","last_change":"2024-05-15T14:27:56.879335+0000","last_active":"2024-05-15T14:48:57.439864+0000","last_peered":"2024-05-15T14:48:57.439864+0000","last_clean":"2024-05-15T14:48:57.439864+0000","last_became_active":"2024-05-15T14:27:56.879047+0000","last_became_peered":"2024-05-15T14:27:56.879047+0000","last_unstale":"2024-05-15T14:48:57.439864+0000","last_undegraded":"2024-05-15T14:48:57.439864+0000","last_fullsized":"2024-05-15T14:48:57.439864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":959,"num_read_kb":959,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"39'703","reported_seq":1159,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.509538+0000","last_change":"2024-05-15T14:27:58.882036+0000","last_active":"2024-05-15T14:49:01.509538+0000","last_peered":"2024-05-15T14:49:01.509538+0000","last_clean":"2024-05-15T14:49:01.509538+0000","last_became_active":"2024-05-15T14:27:58.881703+0000","last_became_peered":"2024-05-15T14:27:58.881703+0000","last_unstale":"2024-05-15T14:49:01.509538+0000","last_undegraded":"2024-05-15T14:49:01.509538+0000","last_fullsized":"2024-05-15T14:49:01.509538+0000","mapping_epoch":26,"log_start":"39'600","ondisk_log_start":"39'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1572,"num_read_kb":3606,"num_write":909,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.509684+0000","last_change":"2024-05-15T14:28:00.884111+0000","last_active":"2024-05-15T14:49:01.509684+0000","last_peered":"2024-05-15T14:49:01.509684+0000","last_clean":"2024-05-15T14:49:01.509684+0000","last_became_active":"2024-05-15T14:28:00.883811+0000","last_became_peered":"2024-05-15T14:28:00.883811+0000","last_unstale":"2024-05-15T14:49:01.509684+0000","last_undegraded":"2024-05-15T14:49:01.509684+0000","last_fullsized":"2024-05-15T14:49:01.509684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.431675+0000","last_change":"2024-05-15T14:31:16.592460+0000","last_active":"2024-05-15T14:47:57.431675+0000","last_peered":"2024-05-15T14:47:57.431675+0000","last_clean":"2024-05-15T14:47:57.431675+0000","last_became_active":"2024-05-15T14:31:16.592053+0000","last_became_peered":"2024-05-15T14:31:16.592053+0000","last_unstale":"2024-05-15T14:47:57.431675+0000","last_undegraded":"2024-05-15T14:47:57.431675+0000","last_fullsized":"2024-05-15T14:47:57.431675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"39'29","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.536033+0000","last_change":"2024-05-15T14:28:02.894336+0000","last_active":"2024-05-15T14:48:02.536033+0000","last_peered":"2024-05-15T14:48:02.536033+0000","last_clean":"2024-05-15T14:48:02.536033+0000","last_became_active":"2024-05-15T14:28:02.894053+0000","last_became_peered":"2024-05-15T14:28:02.894053+0000","last_unstale":"2024-05-15T14:48:02.536033+0000","last_undegraded":"2024-05-15T14:48:02.536033+0000","last_fullsized":"2024-05-15T14:48:02.536033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"39'12","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439103+0000","last_change":"2024-05-15T14:27:52.849694+0000","last_active":"2024-05-15T14:48:52.439103+0000","last_peered":"2024-05-15T14:48:52.439103+0000","last_clean":"2024-05-15T14:48:52.439103+0000","last_became_active":"2024-05-15T14:27:52.849013+0000","last_became_peered":"2024-05-15T14:27:52.849013+0000","last_unstale":"2024-05-15T14:48:52.439103+0000","last_undegraded":"2024-05-15T14:48:52.439103+0000","last_fullsized":"2024-05-15T14:48:52.439103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"39'12","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.505977+0000","last_change":"2024-05-15T14:27:50.853302+0000","last_active":"2024-05-15T14:44:47.505977+0000","last_peered":"2024-05-15T14:44:47.505977+0000","last_clean":"2024-05-15T14:44:47.505977+0000","last_became_active":"2024-05-15T14:27:50.852755+0000","last_became_peered":"2024-05-15T14:27:50.852755+0000","last_unstale":"2024-05-15T14:44:47.505977+0000","last_undegraded":"2024-05-15T14:44:47.505977+0000","last_fullsized":"2024-05-15T14:44:47.505977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.542873+0000","last_change":"2024-05-15T14:27:56.883749+0000","last_active":"2024-05-15T14:48:57.542873+0000","last_peered":"2024-05-15T14:48:57.542873+0000","last_clean":"2024-05-15T14:48:57.542873+0000","last_became_active":"2024-05-15T14:27:56.883312+0000","last_became_peered":"2024-05-15T14:27:56.883312+0000","last_unstale":"2024-05-15T14:48:57.542873+0000","last_undegraded":"2024-05-15T14:48:57.542873+0000","last_fullsized":"2024-05-15T14:48:57.542873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'158","reported_seq":222584,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:00.115898+0000","last_change":"2024-05-15T14:27:58.884965+0000","last_active":"2024-05-15T14:49:00.115898+0000","last_peered":"2024-05-15T14:49:00.115898+0000","last_clean":"2024-05-15T14:49:00.115898+0000","last_became_active":"2024-05-15T14:27:58.884647+0000","last_became_peered":"2024-05-15T14:27:58.884647+0000","last_unstale":"2024-05-15T14:49:00.115898+0000","last_undegraded":"2024-05-15T14:49:00.115898+0000","last_fullsized":"2024-05-15T14:49:00.115898+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555956,"num_read_kb":2334405,"num_write":176,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.521193+0000","last_change":"2024-05-15T14:28:00.889155+0000","last_active":"2024-05-15T14:46:42.521193+0000","last_peered":"2024-05-15T14:46:42.521193+0000","last_clean":"2024-05-15T14:46:42.521193+0000","last_became_active":"2024-05-15T14:28:00.888834+0000","last_became_peered":"2024-05-15T14:28:00.888834+0000","last_unstale":"2024-05-15T14:46:42.521193+0000","last_undegraded":"2024-05-15T14:46:42.521193+0000","last_fullsized":"2024-05-15T14:46:42.521193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:51.080731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438355+0000","last_change":"2024-05-15T14:31:16.594403+0000","last_active":"2024-05-15T14:48:47.438355+0000","last_peered":"2024-05-15T14:48:47.438355+0000","last_clean":"2024-05-15T14:48:47.438355+0000","last_became_active":"2024-05-15T14:31:16.594114+0000","last_became_peered":"2024-05-15T14:31:16.594114+0000","last_unstale":"2024-05-15T14:48:47.438355+0000","last_undegraded":"2024-05-15T14:48:47.438355+0000","last_fullsized":"2024-05-15T14:48:47.438355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"39'28","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.039996+0000","last_change":"2024-05-15T14:49:01.040056+0000","last_active":"2024-05-15T14:49:01.039996+0000","last_peered":"2024-05-15T14:49:01.039996+0000","last_clean":"2024-05-15T14:49:01.039996+0000","last_became_active":"2024-05-15T14:28:02.890071+0000","last_became_peered":"2024-05-15T14:28:02.890071+0000","last_unstale":"2024-05-15T14:49:01.039996+0000","last_undegraded":"2024-05-15T14:49:01.039996+0000","last_fullsized":"2024-05-15T14:49:01.039996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'28","last_scrub_stamp":"2024-05-15T14:49:01.039894+0000","last_deep_scrub":"39'28","last_deep_scrub_stamp":"2024-05-15T14:49:01.039894+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.039894+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:14:43.778244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":114,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'10","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.542329+0000","last_change":"2024-05-15T14:27:52.852243+0000","last_active":"2024-05-15T14:48:52.542329+0000","last_peered":"2024-05-15T14:48:52.542329+0000","last_clean":"2024-05-15T14:48:52.542329+0000","last_became_active":"2024-05-15T14:27:52.851940+0000","last_became_peered":"2024-05-15T14:27:52.851940+0000","last_unstale":"2024-05-15T14:48:52.542329+0000","last_undegraded":"2024-05-15T14:48:52.542329+0000","last_fullsized":"2024-05-15T14:48:52.542329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"39'4","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:44:47.403389+0000","last_change":"2024-05-15T14:27:50.846653+0000","last_active":"2024-05-15T14:44:47.403389+0000","last_peered":"2024-05-15T14:44:47.403389+0000","last_clean":"2024-05-15T14:44:47.403389+0000","last_became_active":"2024-05-15T14:27:50.846362+0000","last_became_peered":"2024-05-15T14:27:50.846362+0000","last_unstale":"2024-05-15T14:44:47.403389+0000","last_undegraded":"2024-05-15T14:44:47.403389+0000","last_fullsized":"2024-05-15T14:44:47.403389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:53.332381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"39'11","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.592059+0000","last_change":"2024-05-15T14:27:56.878406+0000","last_active":"2024-05-15T14:47:21.592059+0000","last_peered":"2024-05-15T14:47:21.592059+0000","last_clean":"2024-05-15T14:47:21.592059+0000","last_became_active":"2024-05-15T14:27:56.877413+0000","last_became_peered":"2024-05-15T14:27:56.877413+0000","last_unstale":"2024-05-15T14:47:21.592059+0000","last_undegraded":"2024-05-15T14:47:21.592059+0000","last_fullsized":"2024-05-15T14:47:21.592059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:59.085552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"39'249","reported_seq":469,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.509631+0000","last_change":"2024-05-15T14:27:58.881927+0000","last_active":"2024-05-15T14:49:01.509631+0000","last_peered":"2024-05-15T14:49:01.509631+0000","last_clean":"2024-05-15T14:49:01.509631+0000","last_became_active":"2024-05-15T14:27:58.881581+0000","last_became_peered":"2024-05-15T14:27:58.881581+0000","last_unstale":"2024-05-15T14:49:01.509631+0000","last_undegraded":"2024-05-15T14:49:01.509631+0000","last_fullsized":"2024-05-15T14:49:01.509631+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":391,"num_write":224,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416741+0000","last_change":"2024-05-15T14:28:00.888057+0000","last_active":"2024-05-15T14:46:42.416741+0000","last_peered":"2024-05-15T14:46:42.416741+0000","last_clean":"2024-05-15T14:46:42.416741+0000","last_became_active":"2024-05-15T14:28:00.887738+0000","last_became_peered":"2024-05-15T14:28:00.887738+0000","last_unstale":"2024-05-15T14:46:42.416741+0000","last_undegraded":"2024-05-15T14:46:42.416741+0000","last_fullsized":"2024-05-15T14:46:42.416741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:04:59.723993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438376+0000","last_change":"2024-05-15T14:31:16.591389+0000","last_active":"2024-05-15T14:48:47.438376+0000","last_peered":"2024-05-15T14:48:47.438376+0000","last_clean":"2024-05-15T14:48:47.438376+0000","last_became_active":"2024-05-15T14:31:16.590502+0000","last_became_peered":"2024-05-15T14:31:16.590502+0000","last_unstale":"2024-05-15T14:48:47.438376+0000","last_undegraded":"2024-05-15T14:48:47.438376+0000","last_fullsized":"2024-05-15T14:48:47.438376+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'26","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.780086+0000","last_change":"2024-05-15T14:28:02.895306+0000","last_active":"2024-05-15T14:47:53.780086+0000","last_peered":"2024-05-15T14:47:53.780086+0000","last_clean":"2024-05-15T14:47:53.780086+0000","last_became_active":"2024-05-15T14:28:02.894280+0000","last_became_peered":"2024-05-15T14:28:02.894280+0000","last_unstale":"2024-05-15T14:47:53.780086+0000","last_undegraded":"2024-05-15T14:47:53.780086+0000","last_fullsized":"2024-05-15T14:47:53.780086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:43:55.515203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"39'66","reported_seq":159,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.542296+0000","last_change":"2024-05-15T14:27:52.862502+0000","last_active":"2024-05-15T14:48:52.542296+0000","last_peered":"2024-05-15T14:48:52.542296+0000","last_clean":"2024-05-15T14:48:52.542296+0000","last_became_active":"2024-05-15T14:27:52.862259+0000","last_became_peered":"2024-05-15T14:27:52.862259+0000","last_unstale":"2024-05-15T14:48:52.542296+0000","last_undegraded":"2024-05-15T14:48:52.542296+0000","last_fullsized":"2024-05-15T14:48:52.542296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":205,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"39'8","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.426049+0000","last_change":"2024-05-15T14:27:50.844225+0000","last_active":"2024-05-15T14:47:12.426049+0000","last_peered":"2024-05-15T14:47:12.426049+0000","last_clean":"2024-05-15T14:47:12.426049+0000","last_became_active":"2024-05-15T14:27:50.843223+0000","last_became_peered":"2024-05-15T14:27:50.843223+0000","last_unstale":"2024-05-15T14:47:12.426049+0000","last_undegraded":"2024-05-15T14:47:12.426049+0000","last_fullsized":"2024-05-15T14:47:12.426049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"39'9","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.467370+0000","last_change":"2024-05-15T14:27:56.880459+0000","last_active":"2024-05-15T14:47:21.467370+0000","last_peered":"2024-05-15T14:47:21.467370+0000","last_clean":"2024-05-15T14:47:21.467370+0000","last_became_active":"2024-05-15T14:27:56.879589+0000","last_became_peered":"2024-05-15T14:27:56.879589+0000","last_unstale":"2024-05-15T14:47:21.467370+0000","last_undegraded":"2024-05-15T14:47:21.467370+0000","last_fullsized":"2024-05-15T14:47:21.467370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:15.202251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"39'202","reported_seq":399,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.980440+0000","last_change":"2024-05-15T14:27:58.885088+0000","last_active":"2024-05-15T14:48:56.980440+0000","last_peered":"2024-05-15T14:48:56.980440+0000","last_clean":"2024-05-15T14:48:56.980440+0000","last_became_active":"2024-05-15T14:27:58.884831+0000","last_became_peered":"2024-05-15T14:27:58.884831+0000","last_unstale":"2024-05-15T14:48:56.980440+0000","last_undegraded":"2024-05-15T14:48:56.980440+0000","last_fullsized":"2024-05-15T14:48:56.980440+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:36:27.597755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":326,"num_write":178,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:00.116057+0000","last_change":"2024-05-15T14:28:00.887876+0000","last_active":"2024-05-15T14:49:00.116057+0000","last_peered":"2024-05-15T14:49:00.116057+0000","last_clean":"2024-05-15T14:49:00.116057+0000","last_became_active":"2024-05-15T14:28:00.887513+0000","last_became_peered":"2024-05-15T14:28:00.887513+0000","last_unstale":"2024-05-15T14:49:00.116057+0000","last_undegraded":"2024-05-15T14:49:00.116057+0000","last_fullsized":"2024-05-15T14:49:00.116057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.407243+0000","last_change":"2024-05-15T14:31:16.594526+0000","last_active":"2024-05-15T14:45:17.407243+0000","last_peered":"2024-05-15T14:45:17.407243+0000","last_clean":"2024-05-15T14:45:17.407243+0000","last_became_active":"2024-05-15T14:31:16.594193+0000","last_became_peered":"2024-05-15T14:31:16.594193+0000","last_unstale":"2024-05-15T14:45:17.407243+0000","last_undegraded":"2024-05-15T14:45:17.407243+0000","last_fullsized":"2024-05-15T14:45:17.407243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:15:13.565975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"39'20","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814088+0000","last_change":"2024-05-15T14:27:52.847892+0000","last_active":"2024-05-15T14:47:53.814088+0000","last_peered":"2024-05-15T14:47:53.814088+0000","last_clean":"2024-05-15T14:47:53.814088+0000","last_became_active":"2024-05-15T14:27:52.847609+0000","last_became_peered":"2024-05-15T14:27:52.847609+0000","last_unstale":"2024-05-15T14:47:53.814088+0000","last_undegraded":"2024-05-15T14:47:53.814088+0000","last_fullsized":"2024-05-15T14:47:53.814088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:45.470476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":78,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.529332+0000","last_change":"2024-05-15T14:27:50.850851+0000","last_active":"2024-05-15T14:47:12.529332+0000","last_peered":"2024-05-15T14:47:12.529332+0000","last_clean":"2024-05-15T14:47:12.529332+0000","last_became_active":"2024-05-15T14:27:50.850524+0000","last_became_peered":"2024-05-15T14:27:50.850524+0000","last_unstale":"2024-05-15T14:47:12.529332+0000","last_undegraded":"2024-05-15T14:47:12.529332+0000","last_fullsized":"2024-05-15T14:47:12.529332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":18802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"39'11","reported_seq":151,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.900204+0000","last_change":"2024-05-15T14:27:56.882053+0000","last_active":"2024-05-15T14:48:56.900204+0000","last_peered":"2024-05-15T14:48:56.900204+0000","last_clean":"2024-05-15T14:48:56.900204+0000","last_became_active":"2024-05-15T14:27:56.881789+0000","last_became_peered":"2024-05-15T14:27:56.881789+0000","last_unstale":"2024-05-15T14:48:56.900204+0000","last_undegraded":"2024-05-15T14:48:56.900204+0000","last_fullsized":"2024-05-15T14:48:56.900204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":182,"num_write":22,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"39'276","reported_seq":565,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.042417+0000","last_change":"2024-05-15T14:27:58.887437+0000","last_active":"2024-05-15T14:48:57.042417+0000","last_peered":"2024-05-15T14:48:57.042417+0000","last_clean":"2024-05-15T14:48:57.042417+0000","last_became_active":"2024-05-15T14:27:58.887134+0000","last_became_peered":"2024-05-15T14:27:58.887134+0000","last_unstale":"2024-05-15T14:48:57.042417+0000","last_undegraded":"2024-05-15T14:48:57.042417+0000","last_fullsized":"2024-05-15T14:48:57.042417+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":462,"num_write":228,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:32.409142+0000","last_change":"2024-05-15T14:28:00.885482+0000","last_active":"2024-05-15T14:45:32.409142+0000","last_peered":"2024-05-15T14:45:32.409142+0000","last_clean":"2024-05-15T14:45:32.409142+0000","last_became_active":"2024-05-15T14:28:00.885174+0000","last_became_peered":"2024-05-15T14:28:00.885174+0000","last_unstale":"2024-05-15T14:45:32.409142+0000","last_undegraded":"2024-05-15T14:45:32.409142+0000","last_fullsized":"2024-05-15T14:45:32.409142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:25:03.551642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"39'30","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.509821+0000","last_change":"2024-05-15T14:28:02.894975+0000","last_active":"2024-05-15T14:49:01.509821+0000","last_peered":"2024-05-15T14:49:01.509821+0000","last_clean":"2024-05-15T14:49:01.509821+0000","last_became_active":"2024-05-15T14:28:02.894515+0000","last_became_peered":"2024-05-15T14:28:02.894515+0000","last_unstale":"2024-05-15T14:49:01.509821+0000","last_undegraded":"2024-05-15T14:49:01.509821+0000","last_fullsized":"2024-05-15T14:49:01.509821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.510012+0000","last_change":"2024-05-15T14:31:16.589730+0000","last_active":"2024-05-15T14:45:17.510012+0000","last_peered":"2024-05-15T14:45:17.510012+0000","last_clean":"2024-05-15T14:45:17.510012+0000","last_became_active":"2024-05-15T14:31:16.589442+0000","last_became_peered":"2024-05-15T14:31:16.589442+0000","last_unstale":"2024-05-15T14:45:17.510012+0000","last_undegraded":"2024-05-15T14:45:17.510012+0000","last_fullsized":"2024-05-15T14:45:17.510012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:32:21.556315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"39'56","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.432209+0000","last_change":"2024-05-15T14:27:52.845888+0000","last_active":"2024-05-15T14:47:57.432209+0000","last_peered":"2024-05-15T14:47:57.432209+0000","last_clean":"2024-05-15T14:47:57.432209+0000","last_became_active":"2024-05-15T14:27:52.845557+0000","last_became_peered":"2024-05-15T14:27:52.845557+0000","last_unstale":"2024-05-15T14:47:57.432209+0000","last_undegraded":"2024-05-15T14:47:57.432209+0000","last_fullsized":"2024-05-15T14:47:57.432209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":171,"num_write":80,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:17.426501+0000","last_change":"2024-05-15T14:27:50.850506+0000","last_active":"2024-05-15T14:47:17.426501+0000","last_peered":"2024-05-15T14:47:17.426501+0000","last_clean":"2024-05-15T14:47:17.426501+0000","last_became_active":"2024-05-15T14:27:50.850175+0000","last_became_peered":"2024-05-15T14:27:50.850175+0000","last_unstale":"2024-05-15T14:47:17.426501+0000","last_undegraded":"2024-05-15T14:47:17.426501+0000","last_fullsized":"2024-05-15T14:47:17.426501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416792+0000","last_change":"2024-05-15T14:27:56.879893+0000","last_active":"2024-05-15T14:46:42.416792+0000","last_peered":"2024-05-15T14:46:42.416792+0000","last_clean":"2024-05-15T14:46:42.416792+0000","last_became_active":"2024-05-15T14:27:56.879634+0000","last_became_peered":"2024-05-15T14:27:56.879634+0000","last_unstale":"2024-05-15T14:46:42.416792+0000","last_undegraded":"2024-05-15T14:46:42.416792+0000","last_fullsized":"2024-05-15T14:46:42.416792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:06.597029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"39'503","reported_seq":1251,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.982480+0000","last_change":"2024-05-15T14:27:58.887413+0000","last_active":"2024-05-15T14:48:56.982480+0000","last_peered":"2024-05-15T14:48:56.982480+0000","last_clean":"2024-05-15T14:48:56.982480+0000","last_became_active":"2024-05-15T14:27:58.887144+0000","last_became_peered":"2024-05-15T14:27:58.887144+0000","last_unstale":"2024-05-15T14:48:56.982480+0000","last_undegraded":"2024-05-15T14:48:56.982480+0000","last_fullsized":"2024-05-15T14:48:56.982480+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:56.197135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1003,"num_read_kb":910,"num_write":675,"num_write_kb":1754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.432344+0000","last_change":"2024-05-15T14:28:00.891661+0000","last_active":"2024-05-15T14:48:02.432344+0000","last_peered":"2024-05-15T14:48:02.432344+0000","last_clean":"2024-05-15T14:48:02.432344+0000","last_became_active":"2024-05-15T14:28:00.891343+0000","last_became_peered":"2024-05-15T14:28:00.891343+0000","last_unstale":"2024-05-15T14:48:02.432344+0000","last_undegraded":"2024-05-15T14:48:02.432344+0000","last_fullsized":"2024-05-15T14:48:02.432344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"39'31","reported_seq":115,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:42.416704+0000","last_change":"2024-05-15T14:28:02.890221+0000","last_active":"2024-05-15T14:46:42.416704+0000","last_peered":"2024-05-15T14:46:42.416704+0000","last_clean":"2024-05-15T14:46:42.416704+0000","last_became_active":"2024-05-15T14:28:02.889940+0000","last_became_peered":"2024-05-15T14:28:02.889940+0000","last_unstale":"2024-05-15T14:46:42.416704+0000","last_undegraded":"2024-05-15T14:46:42.416704+0000","last_fullsized":"2024-05-15T14:46:42.416704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:43:48.842803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":111,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:37.424030+0000","last_change":"2024-05-15T14:31:16.590555+0000","last_active":"2024-05-15T14:47:37.424030+0000","last_peered":"2024-05-15T14:47:37.424030+0000","last_clean":"2024-05-15T14:47:37.424030+0000","last_became_active":"2024-05-15T14:31:16.590270+0000","last_became_peered":"2024-05-15T14:31:16.590270+0000","last_unstale":"2024-05-15T14:47:37.424030+0000","last_undegraded":"2024-05-15T14:47:37.424030+0000","last_fullsized":"2024-05-15T14:47:37.424030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'14","reported_seq":106,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.814297+0000","last_change":"2024-05-15T14:27:52.861766+0000","last_active":"2024-05-15T14:47:53.814297+0000","last_peered":"2024-05-15T14:47:53.814297+0000","last_clean":"2024-05-15T14:47:53.814297+0000","last_became_active":"2024-05-15T14:27:52.861459+0000","last_became_peered":"2024-05-15T14:27:52.861459+0000","last_unstale":"2024-05-15T14:47:53.814297+0000","last_undegraded":"2024-05-15T14:47:53.814297+0000","last_fullsized":"2024-05-15T14:47:53.814297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.425944+0000","last_change":"2024-05-15T14:27:50.836665+0000","last_active":"2024-05-15T14:47:52.425944+0000","last_peered":"2024-05-15T14:47:52.425944+0000","last_clean":"2024-05-15T14:47:52.425944+0000","last_became_active":"2024-05-15T14:27:50.836343+0000","last_became_peered":"2024-05-15T14:27:50.836343+0000","last_unstale":"2024-05-15T14:47:52.425944+0000","last_undegraded":"2024-05-15T14:47:52.425944+0000","last_fullsized":"2024-05-15T14:47:52.425944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.426606+0000","last_change":"2024-05-15T14:27:56.877775+0000","last_active":"2024-05-15T14:47:57.426606+0000","last_peered":"2024-05-15T14:47:57.426606+0000","last_clean":"2024-05-15T14:47:57.426606+0000","last_became_active":"2024-05-15T14:27:56.876994+0000","last_became_peered":"2024-05-15T14:27:56.876994+0000","last_unstale":"2024-05-15T14:47:57.426606+0000","last_undegraded":"2024-05-15T14:47:57.426606+0000","last_fullsized":"2024-05-15T14:47:57.426606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"39'250","reported_seq":475,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.035681+0000","last_change":"2024-05-15T14:27:58.877101+0000","last_active":"2024-05-15T14:48:57.035681+0000","last_peered":"2024-05-15T14:48:57.035681+0000","last_clean":"2024-05-15T14:48:57.035681+0000","last_became_active":"2024-05-15T14:27:58.876807+0000","last_became_peered":"2024-05-15T14:27:58.876807+0000","last_unstale":"2024-05-15T14:48:57.035681+0000","last_undegraded":"2024-05-15T14:48:57.035681+0000","last_fullsized":"2024-05-15T14:48:57.035681+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":396,"num_write":226,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.432971+0000","last_change":"2024-05-15T14:28:00.891499+0000","last_active":"2024-05-15T14:48:07.432971+0000","last_peered":"2024-05-15T14:48:07.432971+0000","last_clean":"2024-05-15T14:48:07.432971+0000","last_became_active":"2024-05-15T14:28:00.891181+0000","last_became_peered":"2024-05-15T14:28:00.891181+0000","last_unstale":"2024-05-15T14:48:07.432971+0000","last_undegraded":"2024-05-15T14:48:07.432971+0000","last_fullsized":"2024-05-15T14:48:07.432971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"39'31","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.747212+0000","last_change":"2024-05-15T14:28:02.890319+0000","last_active":"2024-05-15T14:47:53.747212+0000","last_peered":"2024-05-15T14:47:53.747212+0000","last_clean":"2024-05-15T14:47:53.747212+0000","last_became_active":"2024-05-15T14:28:02.889976+0000","last_became_peered":"2024-05-15T14:28:02.889976+0000","last_unstale":"2024-05-15T14:47:53.747212+0000","last_undegraded":"2024-05-15T14:47:53.747212+0000","last_fullsized":"2024-05-15T14:47:53.747212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:15:35.796570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:17.509569+0000","last_change":"2024-05-15T14:31:16.592036+0000","last_active":"2024-05-15T14:45:17.509569+0000","last_peered":"2024-05-15T14:45:17.509569+0000","last_clean":"2024-05-15T14:45:17.509569+0000","last_became_active":"2024-05-15T14:31:16.591739+0000","last_became_peered":"2024-05-15T14:31:16.591739+0000","last_unstale":"2024-05-15T14:45:17.509569+0000","last_undegraded":"2024-05-15T14:45:17.509569+0000","last_fullsized":"2024-05-15T14:45:17.509569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:29:51.681101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1c","version":"39'60","reported_seq":159,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.865722+0000","last_change":"2024-05-15T14:27:52.838848+0000","last_active":"2024-05-15T14:47:53.865722+0000","last_peered":"2024-05-15T14:47:53.865722+0000","last_clean":"2024-05-15T14:47:53.865722+0000","last_became_active":"2024-05-15T14:27:52.838558+0000","last_became_peered":"2024-05-15T14:27:52.838558+0000","last_unstale":"2024-05-15T14:47:53.865722+0000","last_undegraded":"2024-05-15T14:47:53.865722+0000","last_fullsized":"2024-05-15T14:47:53.865722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":198,"num_write":84,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"39'14","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026827+0000","last_change":"2024-05-15T14:27:50.834122+0000","last_active":"2024-05-15T14:48:26.026827+0000","last_peered":"2024-05-15T14:48:26.026827+0000","last_clean":"2024-05-15T14:48:26.026827+0000","last_became_active":"2024-05-15T14:27:50.833741+0000","last_became_peered":"2024-05-15T14:27:50.833741+0000","last_unstale":"2024-05-15T14:48:26.026827+0000","last_undegraded":"2024-05-15T14:48:26.026827+0000","last_fullsized":"2024-05-15T14:48:26.026827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20,"num_write":62,"num_write_kb":15860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":277,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.431651+0000","last_change":"2024-05-15T14:27:56.884180+0000","last_active":"2024-05-15T14:47:57.431651+0000","last_peered":"2024-05-15T14:47:57.431651+0000","last_clean":"2024-05-15T14:47:57.431651+0000","last_became_active":"2024-05-15T14:27:56.883663+0000","last_became_peered":"2024-05-15T14:27:56.883663+0000","last_unstale":"2024-05-15T14:47:57.431651+0000","last_undegraded":"2024-05-15T14:47:57.431651+0000","last_fullsized":"2024-05-15T14:47:57.431651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2211,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":456,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"39'289","reported_seq":646,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427832+0000","last_change":"2024-05-15T14:27:58.880803+0000","last_active":"2024-05-15T14:48:07.427832+0000","last_peered":"2024-05-15T14:48:07.427832+0000","last_clean":"2024-05-15T14:48:07.427832+0000","last_became_active":"2024-05-15T14:27:58.880510+0000","last_became_peered":"2024-05-15T14:27:58.880510+0000","last_unstale":"2024-05-15T14:48:07.427832+0000","last_undegraded":"2024-05-15T14:48:07.427832+0000","last_fullsized":"2024-05-15T14:48:07.427832+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":979,"num_read_kb":1295,"num_write":324,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'927","reported_seq":2557,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.905337+0000","last_change":"2024-05-15T14:28:00.885605+0000","last_active":"2024-05-15T14:48:56.905337+0000","last_peered":"2024-05-15T14:48:56.905337+0000","last_clean":"2024-05-15T14:48:56.905337+0000","last_became_active":"2024-05-15T14:28:00.885293+0000","last_became_peered":"2024-05-15T14:28:00.885293+0000","last_unstale":"2024-05-15T14:48:56.905337+0000","last_undegraded":"2024-05-15T14:48:56.905337+0000","last_fullsized":"2024-05-15T14:48:56.905337+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:25.360934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"39'25","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.861587+0000","last_change":"2024-05-15T14:28:02.893269+0000","last_active":"2024-05-15T14:47:53.861587+0000","last_peered":"2024-05-15T14:47:53.861587+0000","last_clean":"2024-05-15T14:47:53.861587+0000","last_became_active":"2024-05-15T14:28:02.892984+0000","last_became_peered":"2024-05-15T14:28:02.892984+0000","last_unstale":"2024-05-15T14:47:53.861587+0000","last_undegraded":"2024-05-15T14:47:53.861587+0000","last_fullsized":"2024-05-15T14:47:53.861587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:44.714715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":37,"num_write":54,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.428448+0000","last_change":"2024-05-15T14:31:16.594309+0000","last_active":"2024-05-15T14:48:12.428448+0000","last_peered":"2024-05-15T14:48:12.428448+0000","last_clean":"2024-05-15T14:48:12.428448+0000","last_became_active":"2024-05-15T14:31:16.594019+0000","last_became_peered":"2024-05-15T14:31:16.594019+0000","last_unstale":"2024-05-15T14:48:12.428448+0000","last_undegraded":"2024-05-15T14:48:12.428448+0000","last_fullsized":"2024-05-15T14:48:12.428448+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"39'52","reported_seq":142,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.327915+0000","last_change":"2024-05-15T14:27:52.854866+0000","last_active":"2024-05-15T14:47:54.327915+0000","last_peered":"2024-05-15T14:47:54.327915+0000","last_clean":"2024-05-15T14:47:54.327915+0000","last_became_active":"2024-05-15T14:27:52.854479+0000","last_became_peered":"2024-05-15T14:27:52.854479+0000","last_unstale":"2024-05-15T14:47:54.327915+0000","last_undegraded":"2024-05-15T14:47:54.327915+0000","last_fullsized":"2024-05-15T14:47:54.327915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":157,"num_write":72,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408007+0000","last_change":"2024-05-15T14:27:50.841154+0000","last_active":"2024-05-15T14:45:22.408007+0000","last_peered":"2024-05-15T14:45:22.408007+0000","last_clean":"2024-05-15T14:45:22.408007+0000","last_became_active":"2024-05-15T14:27:50.840771+0000","last_became_peered":"2024-05-15T14:27:50.840771+0000","last_unstale":"2024-05-15T14:45:22.408007+0000","last_undegraded":"2024-05-15T14:45:22.408007+0000","last_fullsized":"2024-05-15T14:45:22.408007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:18.416733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'25","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.593035+0000","last_change":"2024-05-15T14:27:56.878204+0000","last_active":"2024-05-15T14:47:21.593035+0000","last_peered":"2024-05-15T14:47:21.593035+0000","last_clean":"2024-05-15T14:47:21.593035+0000","last_became_active":"2024-05-15T14:27:56.877367+0000","last_became_peered":"2024-05-15T14:27:56.877367+0000","last_unstale":"2024-05-15T14:47:21.593035+0000","last_undegraded":"2024-05-15T14:47:21.593035+0000","last_fullsized":"2024-05-15T14:47:21.593035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:48.893192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":101,"num_read_kb":87,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"39'411","reported_seq":22983,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.953971+0000","last_change":"2024-05-15T14:27:58.882407+0000","last_active":"2024-05-15T14:48:56.953971+0000","last_peered":"2024-05-15T14:48:56.953971+0000","last_clean":"2024-05-15T14:48:56.953971+0000","last_became_active":"2024-05-15T14:27:58.882139+0000","last_became_peered":"2024-05-15T14:27:58.882139+0000","last_unstale":"2024-05-15T14:48:56.953971+0000","last_undegraded":"2024-05-15T14:48:56.953971+0000","last_fullsized":"2024-05-15T14:48:56.953971+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:49.077081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56371,"num_read_kb":194199,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427364+0000","last_change":"2024-05-15T14:28:00.886162+0000","last_active":"2024-05-15T14:47:22.427364+0000","last_peered":"2024-05-15T14:47:22.427364+0000","last_clean":"2024-05-15T14:47:22.427364+0000","last_became_active":"2024-05-15T14:28:00.885872+0000","last_became_peered":"2024-05-15T14:28:00.885872+0000","last_unstale":"2024-05-15T14:47:22.427364+0000","last_undegraded":"2024-05-15T14:47:22.427364+0000","last_fullsized":"2024-05-15T14:47:22.427364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"39'21","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.251279+0000","last_change":"2024-05-15T14:28:02.896566+0000","last_active":"2024-05-15T14:47:54.251279+0000","last_peered":"2024-05-15T14:47:54.251279+0000","last_clean":"2024-05-15T14:47:54.251279+0000","last_became_active":"2024-05-15T14:28:02.896293+0000","last_became_peered":"2024-05-15T14:28:02.896293+0000","last_unstale":"2024-05-15T14:47:54.251279+0000","last_undegraded":"2024-05-15T14:47:54.251279+0000","last_fullsized":"2024-05-15T14:47:54.251279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:08:31.046554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514146+0000","last_change":"2024-05-15T14:31:16.594407+0000","last_active":"2024-05-15T14:45:47.514146+0000","last_peered":"2024-05-15T14:45:47.514146+0000","last_clean":"2024-05-15T14:45:47.514146+0000","last_became_active":"2024-05-15T14:31:16.594144+0000","last_became_peered":"2024-05-15T14:31:16.594144+0000","last_unstale":"2024-05-15T14:45:47.514146+0000","last_undegraded":"2024-05-15T14:45:47.514146+0000","last_fullsized":"2024-05-15T14:45:47.514146+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:01:05.887839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"39'56","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.295978+0000","last_change":"2024-05-15T14:27:52.854982+0000","last_active":"2024-05-15T14:47:54.295978+0000","last_peered":"2024-05-15T14:47:54.295978+0000","last_clean":"2024-05-15T14:47:54.295978+0000","last_became_active":"2024-05-15T14:27:52.854517+0000","last_became_peered":"2024-05-15T14:27:52.854517+0000","last_unstale":"2024-05-15T14:47:54.295978+0000","last_undegraded":"2024-05-15T14:47:54.295978+0000","last_fullsized":"2024-05-15T14:47:54.295978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":183,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"39'16","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:22.408040+0000","last_change":"2024-05-15T14:27:50.840481+0000","last_active":"2024-05-15T14:45:22.408040+0000","last_peered":"2024-05-15T14:45:22.408040+0000","last_clean":"2024-05-15T14:45:22.408040+0000","last_became_active":"2024-05-15T14:27:50.839960+0000","last_became_peered":"2024-05-15T14:27:50.839960+0000","last_unstale":"2024-05-15T14:45:22.408040+0000","last_undegraded":"2024-05-15T14:45:22.408040+0000","last_fullsized":"2024-05-15T14:45:22.408040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:50.553074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:21.588072+0000","last_change":"2024-05-15T14:27:56.883585+0000","last_active":"2024-05-15T14:47:21.588072+0000","last_peered":"2024-05-15T14:47:21.588072+0000","last_clean":"2024-05-15T14:47:21.588072+0000","last_became_active":"2024-05-15T14:27:56.883267+0000","last_became_peered":"2024-05-15T14:27:56.883267+0000","last_unstale":"2024-05-15T14:47:21.588072+0000","last_undegraded":"2024-05-15T14:47:21.588072+0000","last_fullsized":"2024-05-15T14:47:21.588072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:32:25.424889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"39'219","reported_seq":421,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.959209+0000","last_change":"2024-05-15T14:27:58.882536+0000","last_active":"2024-05-15T14:48:56.959209+0000","last_peered":"2024-05-15T14:48:56.959209+0000","last_clean":"2024-05-15T14:48:56.959209+0000","last_became_active":"2024-05-15T14:27:58.882239+0000","last_became_peered":"2024-05-15T14:27:58.882239+0000","last_unstale":"2024-05-15T14:48:56.959209+0000","last_undegraded":"2024-05-15T14:48:56.959209+0000","last_fullsized":"2024-05-15T14:48:56.959209+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":346,"num_read_kb":338,"num_write":194,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:02.405124+0000","last_change":"2024-05-15T14:28:00.887245+0000","last_active":"2024-05-15T14:45:02.405124+0000","last_peered":"2024-05-15T14:45:02.405124+0000","last_clean":"2024-05-15T14:45:02.405124+0000","last_became_active":"2024-05-15T14:28:00.886898+0000","last_became_peered":"2024-05-15T14:28:00.886898+0000","last_unstale":"2024-05-15T14:45:02.405124+0000","last_undegraded":"2024-05-15T14:45:02.405124+0000","last_fullsized":"2024-05-15T14:45:02.405124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:11.178263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"39'12","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.737349+0000","last_change":"2024-05-15T14:28:02.890898+0000","last_active":"2024-05-15T14:47:53.737349+0000","last_peered":"2024-05-15T14:47:53.737349+0000","last_clean":"2024-05-15T14:47:53.737349+0000","last_became_active":"2024-05-15T14:28:02.890595+0000","last_became_peered":"2024-05-15T14:28:02.890595+0000","last_unstale":"2024-05-15T14:47:53.737349+0000","last_undegraded":"2024-05-15T14:47:53.737349+0000","last_fullsized":"2024-05-15T14:47:53.737349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:42.429595+0000","last_change":"2024-05-15T14:31:16.597622+0000","last_active":"2024-05-15T14:47:42.429595+0000","last_peered":"2024-05-15T14:47:42.429595+0000","last_clean":"2024-05-15T14:47:42.429595+0000","last_became_active":"2024-05-15T14:31:16.597207+0000","last_became_peered":"2024-05-15T14:31:16.597207+0000","last_unstale":"2024-05-15T14:47:42.429595+0000","last_undegraded":"2024-05-15T14:47:42.429595+0000","last_fullsized":"2024-05-15T14:47:42.429595+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"39'94","reported_seq":209,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.296133+0000","last_change":"2024-05-15T14:27:52.852789+0000","last_active":"2024-05-15T14:47:54.296133+0000","last_peered":"2024-05-15T14:47:54.296133+0000","last_clean":"2024-05-15T14:47:54.296133+0000","last_became_active":"2024-05-15T14:27:52.852536+0000","last_became_peered":"2024-05-15T14:27:52.852536+0000","last_unstale":"2024-05-15T14:47:54.296133+0000","last_undegraded":"2024-05-15T14:47:54.296133+0000","last_fullsized":"2024-05-15T14:47:54.296133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":296,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"39'22","reported_seq":106,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.534690+0000","last_change":"2024-05-15T14:27:50.848136+0000","last_active":"2024-05-15T14:47:52.534690+0000","last_peered":"2024-05-15T14:47:52.534690+0000","last_clean":"2024-05-15T14:47:52.534690+0000","last_became_active":"2024-05-15T14:27:50.847850+0000","last_became_peered":"2024-05-15T14:27:50.847850+0000","last_unstale":"2024-05-15T14:47:52.534690+0000","last_undegraded":"2024-05-15T14:47:52.534690+0000","last_fullsized":"2024-05-15T14:47:52.534690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":44,"num_write":110,"num_write_kb":26471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"32'3","reported_seq":1310,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.900852+0000","last_change":"2024-05-15T14:27:56.879855+0000","last_active":"2024-05-15T14:48:56.900852+0000","last_peered":"2024-05-15T14:48:56.900852+0000","last_clean":"2024-05-15T14:48:56.900852+0000","last_became_active":"2024-05-15T14:27:56.879092+0000","last_became_peered":"2024-05-15T14:27:56.879092+0000","last_unstale":"2024-05-15T14:48:56.900852+0000","last_undegraded":"2024-05-15T14:48:56.900852+0000","last_fullsized":"2024-05-15T14:48:56.900852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1596,"num_read_kb":1594,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'233","reported_seq":394,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.029090+0000","last_change":"2024-05-15T14:27:58.883107+0000","last_active":"2024-05-15T14:48:57.029090+0000","last_peered":"2024-05-15T14:48:57.029090+0000","last_clean":"2024-05-15T14:48:57.029090+0000","last_became_active":"2024-05-15T14:27:58.882703+0000","last_became_peered":"2024-05-15T14:27:58.882703+0000","last_unstale":"2024-05-15T14:48:57.029090+0000","last_undegraded":"2024-05-15T14:48:57.029090+0000","last_fullsized":"2024-05-15T14:48:57.029090+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":469,"num_write":437,"num_write_kb":1979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.427172+0000","last_change":"2024-05-15T14:28:00.884804+0000","last_active":"2024-05-15T14:48:02.427172+0000","last_peered":"2024-05-15T14:48:02.427172+0000","last_clean":"2024-05-15T14:48:02.427172+0000","last_became_active":"2024-05-15T14:28:00.884499+0000","last_became_peered":"2024-05-15T14:28:00.884499+0000","last_unstale":"2024-05-15T14:48:02.427172+0000","last_undegraded":"2024-05-15T14:48:02.427172+0000","last_fullsized":"2024-05-15T14:48:02.427172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"39'18","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.258684+0000","last_change":"2024-05-15T14:28:02.896315+0000","last_active":"2024-05-15T14:46:21.258684+0000","last_peered":"2024-05-15T14:46:21.258684+0000","last_clean":"2024-05-15T14:46:21.258684+0000","last_became_active":"2024-05-15T14:28:02.895999+0000","last_became_peered":"2024-05-15T14:28:02.895999+0000","last_unstale":"2024-05-15T14:46:21.258684+0000","last_undegraded":"2024-05-15T14:46:21.258684+0000","last_fullsized":"2024-05-15T14:46:21.258684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:38.432473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:47.514109+0000","last_change":"2024-05-15T14:31:16.593403+0000","last_active":"2024-05-15T14:45:47.514109+0000","last_peered":"2024-05-15T14:45:47.514109+0000","last_clean":"2024-05-15T14:45:47.514109+0000","last_became_active":"2024-05-15T14:31:16.593126+0000","last_became_peered":"2024-05-15T14:31:16.593126+0000","last_unstale":"2024-05-15T14:45:47.514109+0000","last_undegraded":"2024-05-15T14:45:47.514109+0000","last_fullsized":"2024-05-15T14:45:47.514109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:32.457272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.420941+0000","last_change":"2024-05-15T14:27:52.844385+0000","last_active":"2024-05-15T14:47:12.420941+0000","last_peered":"2024-05-15T14:47:12.420941+0000","last_clean":"2024-05-15T14:47:12.420941+0000","last_became_active":"2024-05-15T14:27:52.844112+0000","last_became_peered":"2024-05-15T14:27:52.844112+0000","last_unstale":"2024-05-15T14:47:12.420941+0000","last_undegraded":"2024-05-15T14:47:12.420941+0000","last_fullsized":"2024-05-15T14:47:12.420941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"39'20","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437791+0000","last_change":"2024-05-15T14:27:50.844543+0000","last_active":"2024-05-15T14:48:42.437791+0000","last_peered":"2024-05-15T14:48:42.437791+0000","last_clean":"2024-05-15T14:48:42.437791+0000","last_became_active":"2024-05-15T14:27:50.843701+0000","last_became_peered":"2024-05-15T14:27:50.843701+0000","last_unstale":"2024-05-15T14:48:42.437791+0000","last_undegraded":"2024-05-15T14:48:42.437791+0000","last_fullsized":"2024-05-15T14:48:42.437791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":100,"num_write_kb":23517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.095887+0000","last_change":"2024-05-15T14:49:02.095906+0000","last_active":"2024-05-15T14:49:02.095887+0000","last_peered":"2024-05-15T14:49:02.095887+0000","last_clean":"2024-05-15T14:49:02.095887+0000","last_became_active":"2024-05-15T14:27:56.883534+0000","last_became_peered":"2024-05-15T14:27:56.883534+0000","last_unstale":"2024-05-15T14:49:02.095887+0000","last_undegraded":"2024-05-15T14:49:02.095887+0000","last_fullsized":"2024-05-15T14:49:02.095887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:02.095799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:02.095799+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.095799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:14:42.041400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"39'322","reported_seq":529,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.038398+0000","last_change":"2024-05-15T14:27:58.886044+0000","last_active":"2024-05-15T14:48:57.038398+0000","last_peered":"2024-05-15T14:48:57.038398+0000","last_clean":"2024-05-15T14:48:57.038398+0000","last_became_active":"2024-05-15T14:27:58.885479+0000","last_became_peered":"2024-05-15T14:27:58.885479+0000","last_unstale":"2024-05-15T14:48:57.038398+0000","last_undegraded":"2024-05-15T14:48:57.038398+0000","last_fullsized":"2024-05-15T14:48:57.038398+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":606,"num_write":518,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.432784+0000","last_change":"2024-05-15T14:28:00.885531+0000","last_active":"2024-05-15T14:48:02.432784+0000","last_peered":"2024-05-15T14:48:02.432784+0000","last_clean":"2024-05-15T14:48:02.432784+0000","last_became_active":"2024-05-15T14:28:00.885171+0000","last_became_peered":"2024-05-15T14:28:00.885171+0000","last_unstale":"2024-05-15T14:48:02.432784+0000","last_undegraded":"2024-05-15T14:48:02.432784+0000","last_fullsized":"2024-05-15T14:48:02.432784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'26","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.320417+0000","last_change":"2024-05-15T14:28:02.888549+0000","last_active":"2024-05-15T14:47:54.320417+0000","last_peered":"2024-05-15T14:47:54.320417+0000","last_clean":"2024-05-15T14:47:54.320417+0000","last_became_active":"2024-05-15T14:28:02.888247+0000","last_became_peered":"2024-05-15T14:28:02.888247+0000","last_unstale":"2024-05-15T14:47:54.320417+0000","last_undegraded":"2024-05-15T14:47:54.320417+0000","last_fullsized":"2024-05-15T14:47:54.320417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":30,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"39'16","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427341+0000","last_change":"2024-05-15T14:27:52.844877+0000","last_active":"2024-05-15T14:47:22.427341+0000","last_peered":"2024-05-15T14:47:22.427341+0000","last_clean":"2024-05-15T14:47:22.427341+0000","last_became_active":"2024-05-15T14:27:52.844292+0000","last_became_peered":"2024-05-15T14:27:52.844292+0000","last_unstale":"2024-05-15T14:47:22.427341+0000","last_undegraded":"2024-05-15T14:47:22.427341+0000","last_fullsized":"2024-05-15T14:47:22.427341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"39'20","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.028581+0000","last_change":"2024-05-15T14:27:50.853660+0000","last_active":"2024-05-15T14:48:26.028581+0000","last_peered":"2024-05-15T14:48:26.028581+0000","last_clean":"2024-05-15T14:48:26.028581+0000","last_became_active":"2024-05-15T14:27:50.853042+0000","last_became_peered":"2024-05-15T14:27:50.853042+0000","last_unstale":"2024-05-15T14:48:26.028581+0000","last_undegraded":"2024-05-15T14:48:26.028581+0000","last_fullsized":"2024-05-15T14:48:26.028581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:39:59.963824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":35,"num_write":92,"num_write_kb":30554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"39'20","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.311675+0000","last_change":"2024-05-15T14:27:52.842491+0000","last_active":"2024-05-15T14:47:54.311675+0000","last_peered":"2024-05-15T14:47:54.311675+0000","last_clean":"2024-05-15T14:47:54.311675+0000","last_became_active":"2024-05-15T14:27:52.840716+0000","last_became_peered":"2024-05-15T14:27:52.840716+0000","last_unstale":"2024-05-15T14:47:54.311675+0000","last_undegraded":"2024-05-15T14:47:54.311675+0000","last_fullsized":"2024-05-15T14:47:54.311675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"39'16","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.524461+0000","last_change":"2024-05-15T14:28:38.451032+0000","last_active":"2024-05-15T14:48:42.524461+0000","last_peered":"2024-05-15T14:48:42.524461+0000","last_clean":"2024-05-15T14:48:42.524461+0000","last_became_active":"2024-05-15T14:28:38.450578+0000","last_became_peered":"2024-05-15T14:28:38.450578+0000","last_unstale":"2024-05-15T14:48:42.524461+0000","last_undegraded":"2024-05-15T14:48:42.524461+0000","last_fullsized":"2024-05-15T14:48:42.524461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"39'26","reported_seq":110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:21.385094+0000","last_change":"2024-05-15T14:27:52.841680+0000","last_active":"2024-05-15T14:46:21.385094+0000","last_peered":"2024-05-15T14:46:21.385094+0000","last_clean":"2024-05-15T14:46:21.385094+0000","last_became_active":"2024-05-15T14:27:52.841192+0000","last_became_peered":"2024-05-15T14:27:52.841192+0000","last_unstale":"2024-05-15T14:46:21.385094+0000","last_undegraded":"2024-05-15T14:46:21.385094+0000","last_fullsized":"2024-05-15T14:46:21.385094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:44.857501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":93,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"39'18","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416631+0000","last_change":"2024-05-15T14:28:38.450889+0000","last_active":"2024-05-15T14:46:37.416631+0000","last_peered":"2024-05-15T14:46:37.416631+0000","last_clean":"2024-05-15T14:46:37.416631+0000","last_became_active":"2024-05-15T14:28:38.450592+0000","last_became_peered":"2024-05-15T14:28:38.450592+0000","last_unstale":"2024-05-15T14:46:37.416631+0000","last_undegraded":"2024-05-15T14:46:37.416631+0000","last_fullsized":"2024-05-15T14:46:37.416631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:32.536677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"39'72","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:57.411796+0000","last_change":"2024-05-15T14:28:37.941694+0000","last_active":"2024-05-15T14:45:57.411796+0000","last_peered":"2024-05-15T14:45:57.411796+0000","last_clean":"2024-05-15T14:45:57.411796+0000","last_became_active":"2024-05-15T14:28:37.941389+0000","last_became_peered":"2024-05-15T14:28:37.941389+0000","last_unstale":"2024-05-15T14:45:57.411796+0000","last_undegraded":"2024-05-15T14:45:57.411796+0000","last_fullsized":"2024-05-15T14:45:57.411796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:12.821111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":236,"num_write":102,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438313+0000","last_change":"2024-05-15T14:27:50.849038+0000","last_active":"2024-05-15T14:48:47.438313+0000","last_peered":"2024-05-15T14:48:47.438313+0000","last_clean":"2024-05-15T14:48:47.438313+0000","last_became_active":"2024-05-15T14:27:50.848763+0000","last_became_peered":"2024-05-15T14:27:50.848763+0000","last_unstale":"2024-05-15T14:48:47.438313+0000","last_undegraded":"2024-05-15T14:48:47.438313+0000","last_fullsized":"2024-05-15T14:48:47.438313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":82,"num_write_kb":24675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"39'82","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.541080+0000","last_change":"2024-05-15T14:27:52.853939+0000","last_active":"2024-05-15T14:48:42.541080+0000","last_peered":"2024-05-15T14:48:42.541080+0000","last_clean":"2024-05-15T14:48:42.541080+0000","last_became_active":"2024-05-15T14:27:52.851068+0000","last_became_peered":"2024-05-15T14:27:52.851068+0000","last_unstale":"2024-05-15T14:48:42.541080+0000","last_undegraded":"2024-05-15T14:48:42.541080+0000","last_fullsized":"2024-05-15T14:48:42.541080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":322,"num_read_kb":258,"num_write":116,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"39'10","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.530939+0000","last_change":"2024-05-15T14:27:50.847365+0000","last_active":"2024-05-15T14:47:22.530939+0000","last_peered":"2024-05-15T14:47:22.530939+0000","last_clean":"2024-05-15T14:47:22.530939+0000","last_became_active":"2024-05-15T14:27:50.847042+0000","last_became_peered":"2024-05-15T14:27:50.847042+0000","last_unstale":"2024-05-15T14:47:22.530939+0000","last_undegraded":"2024-05-15T14:47:22.530939+0000","last_fullsized":"2024-05-15T14:47:22.530939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'66","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432085+0000","last_change":"2024-05-15T14:27:52.847215+0000","last_active":"2024-05-15T14:48:42.432085+0000","last_peered":"2024-05-15T14:48:42.432085+0000","last_clean":"2024-05-15T14:48:42.432085+0000","last_became_active":"2024-05-15T14:27:52.846918+0000","last_became_peered":"2024-05-15T14:27:52.846918+0000","last_unstale":"2024-05-15T14:48:42.432085+0000","last_undegraded":"2024-05-15T14:48:42.432085+0000","last_fullsized":"2024-05-15T14:48:42.432085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":226,"num_write":90,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427302+0000","last_change":"2024-05-15T14:27:50.850495+0000","last_active":"2024-05-15T14:47:22.427302+0000","last_peered":"2024-05-15T14:47:22.427302+0000","last_clean":"2024-05-15T14:47:22.427302+0000","last_became_active":"2024-05-15T14:27:50.849910+0000","last_became_peered":"2024-05-15T14:27:50.849910+0000","last_unstale":"2024-05-15T14:47:22.427302+0000","last_undegraded":"2024-05-15T14:47:22.427302+0000","last_fullsized":"2024-05-15T14:47:22.427302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.541016+0000","last_change":"2024-05-15T14:27:52.862477+0000","last_active":"2024-05-15T14:48:42.541016+0000","last_peered":"2024-05-15T14:48:42.541016+0000","last_clean":"2024-05-15T14:48:42.541016+0000","last_became_active":"2024-05-15T14:27:52.862227+0000","last_became_peered":"2024-05-15T14:27:52.862227+0000","last_unstale":"2024-05-15T14:48:42.541016+0000","last_undegraded":"2024-05-15T14:48:42.541016+0000","last_fullsized":"2024-05-15T14:48:42.541016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"39'14","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:12.406550+0000","last_change":"2024-05-15T14:28:37.942575+0000","last_active":"2024-05-15T14:45:12.406550+0000","last_peered":"2024-05-15T14:45:12.406550+0000","last_clean":"2024-05-15T14:45:12.406550+0000","last_became_active":"2024-05-15T14:28:37.942198+0000","last_became_peered":"2024-05-15T14:28:37.942198+0000","last_unstale":"2024-05-15T14:45:12.406550+0000","last_undegraded":"2024-05-15T14:45:12.406550+0000","last_fullsized":"2024-05-15T14:45:12.406550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:26:58.883367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:37.416154+0000","last_change":"2024-05-15T14:27:52.841198+0000","last_active":"2024-05-15T14:46:37.416154+0000","last_peered":"2024-05-15T14:46:37.416154+0000","last_clean":"2024-05-15T14:46:37.416154+0000","last_became_active":"2024-05-15T14:27:52.840941+0000","last_became_peered":"2024-05-15T14:27:52.840941+0000","last_unstale":"2024-05-15T14:46:37.416154+0000","last_undegraded":"2024-05-15T14:46:37.416154+0000","last_fullsized":"2024-05-15T14:46:37.416154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:17.311449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"39'16","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.530987+0000","last_change":"2024-05-15T14:27:50.849503+0000","last_active":"2024-05-15T14:47:22.530987+0000","last_peered":"2024-05-15T14:47:22.530987+0000","last_clean":"2024-05-15T14:47:22.530987+0000","last_became_active":"2024-05-15T14:27:50.847998+0000","last_became_peered":"2024-05-15T14:27:50.847998+0000","last_unstale":"2024-05-15T14:47:22.530987+0000","last_undegraded":"2024-05-15T14:47:22.530987+0000","last_fullsized":"2024-05-15T14:47:22.530987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"39'8","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439167+0000","last_change":"2024-05-15T14:27:52.853614+0000","last_active":"2024-05-15T14:48:52.439167+0000","last_peered":"2024-05-15T14:48:52.439167+0000","last_clean":"2024-05-15T14:48:52.439167+0000","last_became_active":"2024-05-15T14:27:52.852947+0000","last_became_peered":"2024-05-15T14:27:52.852947+0000","last_unstale":"2024-05-15T14:48:52.439167+0000","last_undegraded":"2024-05-15T14:48:52.439167+0000","last_fullsized":"2024-05-15T14:48:52.439167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"39'14","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:27.422621+0000","last_change":"2024-05-15T14:27:50.856154+0000","last_active":"2024-05-15T14:47:27.422621+0000","last_peered":"2024-05-15T14:47:27.422621+0000","last_clean":"2024-05-15T14:47:27.422621+0000","last_became_active":"2024-05-15T14:27:50.855927+0000","last_became_peered":"2024-05-15T14:27:50.855927+0000","last_unstale":"2024-05-15T14:47:27.422621+0000","last_undegraded":"2024-05-15T14:47:27.422621+0000","last_fullsized":"2024-05-15T14:47:27.422621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:35:14.556752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24,"num_write":62,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"39'24","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433451+0000","last_change":"2024-05-15T14:27:52.854135+0000","last_active":"2024-05-15T14:48:52.433451+0000","last_peered":"2024-05-15T14:48:52.433451+0000","last_clean":"2024-05-15T14:48:52.433451+0000","last_became_active":"2024-05-15T14:27:52.853857+0000","last_became_peered":"2024-05-15T14:27:52.853857+0000","last_unstale":"2024-05-15T14:48:52.433451+0000","last_undegraded":"2024-05-15T14:48:52.433451+0000","last_fullsized":"2024-05-15T14:48:52.433451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":91,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"39'18","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.536636+0000","last_change":"2024-05-15T14:27:50.844170+0000","last_active":"2024-05-15T14:48:07.536636+0000","last_peered":"2024-05-15T14:48:07.536636+0000","last_clean":"2024-05-15T14:48:07.536636+0000","last_became_active":"2024-05-15T14:27:50.843874+0000","last_became_peered":"2024-05-15T14:27:50.843874+0000","last_unstale":"2024-05-15T14:48:07.536636+0000","last_undegraded":"2024-05-15T14:48:07.536636+0000","last_fullsized":"2024-05-15T14:48:07.536636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"39'58","reported_seq":137,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.520310+0000","last_change":"2024-05-15T14:27:52.847675+0000","last_active":"2024-05-15T14:48:07.520310+0000","last_peered":"2024-05-15T14:48:07.520310+0000","last_clean":"2024-05-15T14:48:07.520310+0000","last_became_active":"2024-05-15T14:27:52.847362+0000","last_became_peered":"2024-05-15T14:27:52.847362+0000","last_unstale":"2024-05-15T14:48:07.520310+0000","last_undegraded":"2024-05-15T14:48:07.520310+0000","last_fullsized":"2024-05-15T14:48:07.520310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":172,"num_write":84,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.411173+0000","last_change":"2024-05-15T14:27:50.846611+0000","last_active":"2024-05-15T14:45:52.411173+0000","last_peered":"2024-05-15T14:45:52.411173+0000","last_clean":"2024-05-15T14:45:52.411173+0000","last_became_active":"2024-05-15T14:27:50.846291+0000","last_became_peered":"2024-05-15T14:27:50.846291+0000","last_unstale":"2024-05-15T14:45:52.411173+0000","last_undegraded":"2024-05-15T14:45:52.411173+0000","last_fullsized":"2024-05-15T14:45:52.411173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:03:01.126044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":14702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"39'74","reported_seq":193,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427801+0000","last_change":"2024-05-15T14:27:52.848460+0000","last_active":"2024-05-15T14:48:07.427801+0000","last_peered":"2024-05-15T14:48:07.427801+0000","last_clean":"2024-05-15T14:48:07.427801+0000","last_became_active":"2024-05-15T14:27:52.848173+0000","last_became_peered":"2024-05-15T14:27:52.848173+0000","last_unstale":"2024-05-15T14:48:07.427801+0000","last_undegraded":"2024-05-15T14:48:07.427801+0000","last_fullsized":"2024-05-15T14:48:07.427801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":248,"num_write":102,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.433482+0000","last_change":"2024-05-15T14:27:50.847115+0000","last_active":"2024-05-15T14:48:07.433482+0000","last_peered":"2024-05-15T14:48:07.433482+0000","last_clean":"2024-05-15T14:48:07.433482+0000","last_became_active":"2024-05-15T14:27:50.846782+0000","last_became_peered":"2024-05-15T14:27:50.846782+0000","last_unstale":"2024-05-15T14:48:07.433482+0000","last_undegraded":"2024-05-15T14:48:07.433482+0000","last_fullsized":"2024-05-15T14:48:07.433482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"39'30","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.840678+0000","last_change":"2024-05-15T14:27:52.851930+0000","last_active":"2024-05-15T14:47:53.840678+0000","last_peered":"2024-05-15T14:47:53.840678+0000","last_clean":"2024-05-15T14:47:53.840678+0000","last_became_active":"2024-05-15T14:27:52.851642+0000","last_became_peered":"2024-05-15T14:27:52.851642+0000","last_unstale":"2024-05-15T14:47:53.840678+0000","last_undegraded":"2024-05-15T14:47:53.840678+0000","last_fullsized":"2024-05-15T14:47:53.840678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:52.988777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":127,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:45:52.410649+0000","last_change":"2024-05-15T14:27:50.840821+0000","last_active":"2024-05-15T14:45:52.410649+0000","last_peered":"2024-05-15T14:45:52.410649+0000","last_clean":"2024-05-15T14:45:52.410649+0000","last_became_active":"2024-05-15T14:27:50.840467+0000","last_became_peered":"2024-05-15T14:27:50.840467+0000","last_unstale":"2024-05-15T14:45:52.410649+0000","last_undegraded":"2024-05-15T14:45:52.410649+0000","last_fullsized":"2024-05-15T14:45:52.410649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:07:30.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"39'92","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.433452+0000","last_change":"2024-05-15T14:27:52.860211+0000","last_active":"2024-05-15T14:48:07.433452+0000","last_peered":"2024-05-15T14:48:07.433452+0000","last_clean":"2024-05-15T14:48:07.433452+0000","last_became_active":"2024-05-15T14:27:52.859926+0000","last_became_peered":"2024-05-15T14:27:52.859926+0000","last_unstale":"2024-05-15T14:48:07.433452+0000","last_undegraded":"2024-05-15T14:48:07.433452+0000","last_fullsized":"2024-05-15T14:48:07.433452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":270,"num_write":132,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"39'24","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.532445+0000","last_change":"2024-05-15T14:27:50.850215+0000","last_active":"2024-05-15T14:48:07.532445+0000","last_peered":"2024-05-15T14:48:07.532445+0000","last_clean":"2024-05-15T14:48:07.532445+0000","last_became_active":"2024-05-15T14:27:50.849936+0000","last_became_peered":"2024-05-15T14:27:50.849936+0000","last_unstale":"2024-05-15T14:48:07.532445+0000","last_undegraded":"2024-05-15T14:48:07.532445+0000","last_fullsized":"2024-05-15T14:48:07.532445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:05:18.416733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":112,"num_write_kb":36442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"39'62","reported_seq":163,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.536608+0000","last_change":"2024-05-15T14:27:52.857096+0000","last_active":"2024-05-15T14:48:07.536608+0000","last_peered":"2024-05-15T14:48:07.536608+0000","last_clean":"2024-05-15T14:48:07.536608+0000","last_became_active":"2024-05-15T14:27:52.856767+0000","last_became_peered":"2024-05-15T14:27:52.856767+0000","last_unstale":"2024-05-15T14:48:07.536608+0000","last_undegraded":"2024-05-15T14:48:07.536608+0000","last_fullsized":"2024-05-15T14:48:07.536608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":205,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"39'18","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.525619+0000","last_change":"2024-05-15T14:27:50.842853+0000","last_active":"2024-05-15T14:48:52.525619+0000","last_peered":"2024-05-15T14:48:52.525619+0000","last_clean":"2024-05-15T14:48:52.525619+0000","last_became_active":"2024-05-15T14:27:50.842512+0000","last_became_peered":"2024-05-15T14:27:50.842512+0000","last_unstale":"2024-05-15T14:48:52.525619+0000","last_undegraded":"2024-05-15T14:48:52.525619+0000","last_fullsized":"2024-05-15T14:48:52.525619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"39'56","reported_seq":148,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304223+0000","last_change":"2024-05-15T14:27:52.855227+0000","last_active":"2024-05-15T14:47:54.304223+0000","last_peered":"2024-05-15T14:47:54.304223+0000","last_clean":"2024-05-15T14:47:54.304223+0000","last_became_active":"2024-05-15T14:27:52.854841+0000","last_became_peered":"2024-05-15T14:27:52.854841+0000","last_unstale":"2024-05-15T14:47:54.304223+0000","last_undegraded":"2024-05-15T14:47:54.304223+0000","last_fullsized":"2024-05-15T14:47:54.304223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:56:52.562258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":78,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"39'20","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416132+0000","last_change":"2024-05-15T14:27:50.848570+0000","last_active":"2024-05-15T14:46:32.416132+0000","last_peered":"2024-05-15T14:46:32.416132+0000","last_clean":"2024-05-15T14:46:32.416132+0000","last_became_active":"2024-05-15T14:27:50.848291+0000","last_became_peered":"2024-05-15T14:27:50.848291+0000","last_unstale":"2024-05-15T14:46:32.416132+0000","last_undegraded":"2024-05-15T14:46:32.416132+0000","last_fullsized":"2024-05-15T14:46:32.416132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:00.552154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":40,"num_write":100,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:46:32.416004+0000","last_change":"2024-05-15T14:27:50.842699+0000","last_active":"2024-05-15T14:46:32.416004+0000","last_peered":"2024-05-15T14:46:32.416004+0000","last_clean":"2024-05-15T14:46:32.416004+0000","last_became_active":"2024-05-15T14:27:50.842420+0000","last_became_peered":"2024-05-15T14:27:50.842420+0000","last_unstale":"2024-05-15T14:46:32.416004+0000","last_undegraded":"2024-05-15T14:46:32.416004+0000","last_fullsized":"2024-05-15T14:46:32.416004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:43.461292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":90,"num_write_kb":20587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'14","reported_seq":98,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.311670+0000","last_change":"2024-05-15T14:27:52.853871+0000","last_active":"2024-05-15T14:47:54.311670+0000","last_peered":"2024-05-15T14:47:54.311670+0000","last_clean":"2024-05-15T14:47:54.311670+0000","last_became_active":"2024-05-15T14:27:52.853329+0000","last_became_peered":"2024-05-15T14:27:52.853329+0000","last_unstale":"2024-05-15T14:47:54.311670+0000","last_undegraded":"2024-05-15T14:47:54.311670+0000","last_fullsized":"2024-05-15T14:47:54.311670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439076+0000","last_change":"2024-05-15T14:27:50.839786+0000","last_active":"2024-05-15T14:48:52.439076+0000","last_peered":"2024-05-15T14:48:52.439076+0000","last_clean":"2024-05-15T14:48:52.439076+0000","last_became_active":"2024-05-15T14:27:50.839496+0000","last_became_peered":"2024-05-15T14:27:50.839496+0000","last_unstale":"2024-05-15T14:48:52.439076+0000","last_undegraded":"2024-05-15T14:48:52.439076+0000","last_fullsized":"2024-05-15T14:48:52.439076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":17647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"39'70","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.304247+0000","last_change":"2024-05-15T14:27:52.852295+0000","last_active":"2024-05-15T14:47:54.304247+0000","last_peered":"2024-05-15T14:47:54.304247+0000","last_clean":"2024-05-15T14:47:54.304247+0000","last_became_active":"2024-05-15T14:27:52.851973+0000","last_became_peered":"2024-05-15T14:27:52.851973+0000","last_unstale":"2024-05-15T14:47:54.304247+0000","last_undegraded":"2024-05-15T14:47:54.304247+0000","last_fullsized":"2024-05-15T14:47:54.304247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:54.802943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":234,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3423,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1381,"num_read_kb":1449,"num_write":1045,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":6846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":835,"ondisk_log_size":835,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11724,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":2162820,"num_read_kb":7062227,"num_write":12291,"num_write_kb":15784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1854,"ondisk_log_size":1854,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":14929,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5671,"num_read_kb":6915,"num_write":192,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":29858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9598,"num_read_kb":7988,"num_write":3212,"num_write_kb":1308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2246,"ondisk_log_size":2246,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2611,"num_read_kb":1724,"num_write":4445,"num_write_kb":1235021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575106,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1118208,"data_stored":815108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575107,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":487424,"data_stored":221551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575106,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44180,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327660,"statfs":{"total":96636764160,"available":96591523840,"internally_reserved":0,"allocated":536576,"data_stored":225223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575107,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":227462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575107,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":532480,"data_stored":222205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575107,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":491520,"data_stored":224011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575107,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":222247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575108,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1118208,"data_stored":816897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":68,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:49:03.744 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.744 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.744 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.744 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.745 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.745 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.745 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.745 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.745 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.745 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.746 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.746 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.746 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.746 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.746 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.746 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.747 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.747 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.747 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.747 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.748 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.748 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.748 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.748 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.748 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.748 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.749 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.749 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.749 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.749 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.749 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.749 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.749 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.750 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.750 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.750 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.750 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.750 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.751 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.751 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.751 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.751 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.751 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.751 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.752 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.752 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.752 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.752 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.752 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.752 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.752 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.753 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.753 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.753 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.753 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.753 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.753 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.754 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.754 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.754 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.754 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.754 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.754 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.755 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.755 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.755 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.755 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.756 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.756 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.756 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.756 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.756 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.757 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.757 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.757 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.757 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.757 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.757 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.758 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.758 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.758 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.758 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.758 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.758 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.759 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.759 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.759 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.759 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.759 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.759 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.760 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.760 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.760 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.760 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.760 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.760 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.761 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.761 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.761 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.761 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.761 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.761 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.761 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.762 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.762 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.762 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.762 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.762 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.762 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.763 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.763 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.763 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-15T14:27:42.789461+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.763 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.763 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.763 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.764 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.764 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.764 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.764 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.764 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.764 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.764 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.765 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.765 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.765 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.765 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.765 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.765 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.766 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.766 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.766 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.766 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.766 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.767 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.767 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.767 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.767 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.767 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.768 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.768 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.768 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.768 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.768 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.768 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.769 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.769 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.769 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.769 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.769 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.769 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.770 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.770 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.770 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.770 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.770 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.770 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.771 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.771 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.771 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.771 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.771 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.771 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.772 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.772 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.772 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.772 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.772 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.772 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.772 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.773 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.773 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.773 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.773 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.773 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.773 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.774 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.774 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.774 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.774 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.774 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.774 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.775 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.775 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.775 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.775 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.776 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.776 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.776 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.776 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.776 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.776 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.777 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.777 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.777 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.777 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.777 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.777 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.778 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.778 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.778 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.778 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.778 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.778 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.779 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.779 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.779 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.779 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.779 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.779 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.780 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.780 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.780 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.780 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.780 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.780 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.780 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.781 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.781 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.781 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.781 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.781 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.781 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.782 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.782 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.782 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.782 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.782 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.782 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.783 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.783 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.783 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.783 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.783 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.783 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.784 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.784 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.784 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.784 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.784 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.784 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.784 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.785 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.785 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.785 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.785 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.785 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.785 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.786 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.786 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.786 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.786 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.786 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.786 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.787 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.787 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.787 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.787 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.787 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.787 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.788 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.788 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.788 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.788 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.788 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.788 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.788 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.789 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.789 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.789 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.789 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.789 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.789 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.790 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.790 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.790 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.790 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.790 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.790 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.791 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.791 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.791 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.791 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.791 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.791 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.792 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.792 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.792 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.792 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.792 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:03.792 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T14:49:23.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:49:24.138 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:49:24.145 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:49:24.147 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":682,"stamp":"2024-05-15T14:49:22.778471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620444,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":2182158,"num_read_kb":7080366,"num_write":21294,"num_write_kb":1254163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25484,"num_omap_keys":66,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6312,"ondisk_log_size":6312,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297608,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":292339,"kb_avail":754677112,"statfs":{"total":773094113280,"available":772789362688,"internally_reserved":0,"allocated":5316608,"data_stored":2974704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":299355697},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25128,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003848"},"pg_stats":[{"pgid":"3.3f","version":"39'26","reported_seq":112,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.536960+0000","last_change":"2024-05-15T14:27:50.850244+0000","last_active":"2024-05-15T14:48:42.536960+0000","last_peered":"2024-05-15T14:48:42.536960+0000","last_clean":"2024-05-15T14:48:42.536960+0000","last_became_active":"2024-05-15T14:27:50.849951+0000","last_became_peered":"2024-05-15T14:27:50.849951+0000","last_unstale":"2024-05-15T14:48:42.536960+0000","last_undegraded":"2024-05-15T14:48:42.536960+0000","last_fullsized":"2024-05-15T14:48:42.536960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'2","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.065623+0000","last_change":"2024-05-15T14:49:16.065651+0000","last_active":"2024-05-15T14:49:16.065623+0000","last_peered":"2024-05-15T14:49:16.065623+0000","last_clean":"2024-05-15T14:49:16.065623+0000","last_became_active":"2024-05-15T14:27:52.843836+0000","last_became_peered":"2024-05-15T14:27:52.843836+0000","last_unstale":"2024-05-15T14:49:16.065623+0000","last_undegraded":"2024-05-15T14:49:16.065623+0000","last_fullsized":"2024-05-15T14:49:16.065623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:16.065521+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:16.065521+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.065521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:34:56.257057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"39'10","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.005891+0000","last_change":"2024-05-15T14:49:20.005922+0000","last_active":"2024-05-15T14:49:20.005891+0000","last_peered":"2024-05-15T14:49:20.005891+0000","last_clean":"2024-05-15T14:49:20.005891+0000","last_became_active":"2024-05-15T14:27:50.837321+0000","last_became_peered":"2024-05-15T14:27:50.837321+0000","last_unstale":"2024-05-15T14:49:20.005891+0000","last_undegraded":"2024-05-15T14:49:20.005891+0000","last_fullsized":"2024-05-15T14:49:20.005891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:20.005776+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:20.005776+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.005776+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:43.743219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":50,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"39'10","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.835870+0000","last_change":"2024-05-15T14:49:15.835898+0000","last_active":"2024-05-15T14:49:15.835870+0000","last_peered":"2024-05-15T14:49:15.835870+0000","last_clean":"2024-05-15T14:49:15.835870+0000","last_became_active":"2024-05-15T14:27:52.840977+0000","last_became_peered":"2024-05-15T14:27:52.840977+0000","last_unstale":"2024-05-15T14:49:15.835870+0000","last_undegraded":"2024-05-15T14:49:15.835870+0000","last_fullsized":"2024-05-15T14:49:15.835870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:15.835781+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:15.835781+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.835781+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:02:18.086441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"39'8","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437757+0000","last_change":"2024-05-15T14:27:50.846251+0000","last_active":"2024-05-15T14:48:42.437757+0000","last_peered":"2024-05-15T14:48:42.437757+0000","last_clean":"2024-05-15T14:48:42.437757+0000","last_became_active":"2024-05-15T14:27:50.844989+0000","last_became_peered":"2024-05-15T14:27:50.844989+0000","last_unstale":"2024-05-15T14:48:42.437757+0000","last_undegraded":"2024-05-15T14:48:42.437757+0000","last_fullsized":"2024-05-15T14:48:42.437757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'24","reported_seq":133,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.243441+0000","last_change":"2024-05-15T14:49:17.243471+0000","last_active":"2024-05-15T14:49:17.243441+0000","last_peered":"2024-05-15T14:49:17.243441+0000","last_clean":"2024-05-15T14:49:17.243441+0000","last_became_active":"2024-05-15T14:27:52.850449+0000","last_became_peered":"2024-05-15T14:27:52.850449+0000","last_unstale":"2024-05-15T14:49:17.243441+0000","last_undegraded":"2024-05-15T14:49:17.243441+0000","last_fullsized":"2024-05-15T14:49:17.243441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:17.243328+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:17.243328+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.243328+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:31.226320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":101,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"39'22","reported_seq":104,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.025856+0000","last_change":"2024-05-15T14:27:50.852104+0000","last_active":"2024-05-15T14:48:26.025856+0000","last_peered":"2024-05-15T14:48:26.025856+0000","last_clean":"2024-05-15T14:48:26.025856+0000","last_became_active":"2024-05-15T14:27:50.851846+0000","last_became_peered":"2024-05-15T14:27:50.851846+0000","last_unstale":"2024-05-15T14:48:26.025856+0000","last_undegraded":"2024-05-15T14:48:26.025856+0000","last_fullsized":"2024-05-15T14:48:26.025856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":27630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"39'4","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.149849+0000","last_change":"2024-05-15T14:49:16.149877+0000","last_active":"2024-05-15T14:49:16.149849+0000","last_peered":"2024-05-15T14:49:16.149849+0000","last_clean":"2024-05-15T14:49:16.149849+0000","last_became_active":"2024-05-15T14:27:52.854481+0000","last_became_peered":"2024-05-15T14:27:52.854481+0000","last_unstale":"2024-05-15T14:49:16.149849+0000","last_undegraded":"2024-05-15T14:49:16.149849+0000","last_fullsized":"2024-05-15T14:49:16.149849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:16.149743+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:16.149743+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.149743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:32.252193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"39'8","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.737453+0000","last_change":"2024-05-15T14:49:19.737479+0000","last_active":"2024-05-15T14:49:19.737453+0000","last_peered":"2024-05-15T14:49:19.737453+0000","last_clean":"2024-05-15T14:49:19.737453+0000","last_became_active":"2024-05-15T14:27:50.851756+0000","last_became_peered":"2024-05-15T14:27:50.851756+0000","last_unstale":"2024-05-15T14:49:19.737453+0000","last_undegraded":"2024-05-15T14:49:19.737453+0000","last_fullsized":"2024-05-15T14:49:19.737453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:19.737363+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:19.737363+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.737363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:00.148124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14,"num_write":40,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"39'8","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.144271+0000","last_change":"2024-05-15T14:49:12.144299+0000","last_active":"2024-05-15T14:49:12.144271+0000","last_peered":"2024-05-15T14:49:12.144271+0000","last_clean":"2024-05-15T14:49:12.144271+0000","last_became_active":"2024-05-15T14:27:52.844904+0000","last_became_peered":"2024-05-15T14:27:52.844904+0000","last_unstale":"2024-05-15T14:49:12.144271+0000","last_undegraded":"2024-05-15T14:49:12.144271+0000","last_fullsized":"2024-05-15T14:49:12.144271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:12.144177+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:12.144177+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.144177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:07.442839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"39'8","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026519+0000","last_change":"2024-05-15T14:27:50.847389+0000","last_active":"2024-05-15T14:48:26.026519+0000","last_peered":"2024-05-15T14:48:26.026519+0000","last_clean":"2024-05-15T14:48:26.026519+0000","last_became_active":"2024-05-15T14:27:50.847121+0000","last_became_peered":"2024-05-15T14:27:50.847121+0000","last_unstale":"2024-05-15T14:48:26.026519+0000","last_undegraded":"2024-05-15T14:48:26.026519+0000","last_fullsized":"2024-05-15T14:48:26.026519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":24,"num_write_kb":14074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'100","reported_seq":217,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.162647+0000","last_change":"2024-05-15T14:49:19.162673+0000","last_active":"2024-05-15T14:49:19.162647+0000","last_peered":"2024-05-15T14:49:19.162647+0000","last_clean":"2024-05-15T14:49:19.162647+0000","last_became_active":"2024-05-15T14:27:52.848482+0000","last_became_peered":"2024-05-15T14:27:52.848482+0000","last_unstale":"2024-05-15T14:49:19.162647+0000","last_undegraded":"2024-05-15T14:49:19.162647+0000","last_fullsized":"2024-05-15T14:49:19.162647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'100","last_scrub_stamp":"2024-05-15T14:49:19.162557+0000","last_deep_scrub":"39'100","last_deep_scrub_stamp":"2024-05-15T14:49:19.162557+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.162557+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:42.092463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":302,"num_write":142,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.530131+0000","last_change":"2024-05-15T14:27:50.852930+0000","last_active":"2024-05-15T14:47:52.530131+0000","last_peered":"2024-05-15T14:47:52.530131+0000","last_clean":"2024-05-15T14:47:52.530131+0000","last_became_active":"2024-05-15T14:27:50.852659+0000","last_became_peered":"2024-05-15T14:27:50.852659+0000","last_unstale":"2024-05-15T14:47:52.530131+0000","last_undegraded":"2024-05-15T14:47:52.530131+0000","last_fullsized":"2024-05-15T14:47:52.530131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"39'10","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.057201+0000","last_change":"2024-05-15T14:49:21.057226+0000","last_active":"2024-05-15T14:49:21.057201+0000","last_peered":"2024-05-15T14:49:21.057201+0000","last_clean":"2024-05-15T14:49:21.057201+0000","last_became_active":"2024-05-15T14:27:52.839017+0000","last_became_peered":"2024-05-15T14:27:52.839017+0000","last_unstale":"2024-05-15T14:49:21.057201+0000","last_undegraded":"2024-05-15T14:49:21.057201+0000","last_fullsized":"2024-05-15T14:49:21.057201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:21.057108+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:21.057108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.057108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:45.288861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.279937+0000","last_change":"2024-05-15T14:27:50.854894+0000","last_active":"2024-05-15T14:47:54.279937+0000","last_peered":"2024-05-15T14:47:54.279937+0000","last_clean":"2024-05-15T14:47:54.279937+0000","last_became_active":"2024-05-15T14:27:50.854408+0000","last_became_peered":"2024-05-15T14:27:50.854408+0000","last_unstale":"2024-05-15T14:47:54.279937+0000","last_undegraded":"2024-05-15T14:47:54.279937+0000","last_fullsized":"2024-05-15T14:47:54.279937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25,"num_write":70,"num_write_kb":17643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"39'10","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.314704+0000","last_change":"2024-05-15T14:49:11.314730+0000","last_active":"2024-05-15T14:49:11.314704+0000","last_peered":"2024-05-15T14:49:11.314704+0000","last_clean":"2024-05-15T14:49:11.314704+0000","last_became_active":"2024-05-15T14:27:52.853688+0000","last_became_peered":"2024-05-15T14:27:52.853688+0000","last_unstale":"2024-05-15T14:49:11.314704+0000","last_undegraded":"2024-05-15T14:49:11.314704+0000","last_fullsized":"2024-05-15T14:49:11.314704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:11.314615+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:11.314615+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.314615+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:22:41.936884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"39'4","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.263543+0000","last_change":"2024-05-15T14:49:15.263569+0000","last_active":"2024-05-15T14:49:15.263543+0000","last_peered":"2024-05-15T14:49:15.263543+0000","last_clean":"2024-05-15T14:49:15.263543+0000","last_became_active":"2024-05-15T14:27:52.850532+0000","last_became_peered":"2024-05-15T14:27:52.850532+0000","last_unstale":"2024-05-15T14:49:15.263543+0000","last_undegraded":"2024-05-15T14:49:15.263543+0000","last_fullsized":"2024-05-15T14:49:15.263543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:15.263455+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:15.263455+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.263455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:13:18.960113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.270663+0000","last_change":"2024-05-15T14:27:50.852471+0000","last_active":"2024-05-15T14:47:54.270663+0000","last_peered":"2024-05-15T14:47:54.270663+0000","last_clean":"2024-05-15T14:47:54.270663+0000","last_became_active":"2024-05-15T14:27:50.852229+0000","last_became_peered":"2024-05-15T14:27:50.852229+0000","last_unstale":"2024-05-15T14:47:54.270663+0000","last_undegraded":"2024-05-15T14:47:54.270663+0000","last_fullsized":"2024-05-15T14:47:54.270663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"39'34","reported_seq":138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.885289+0000","last_change":"2024-05-15T14:49:14.885338+0000","last_active":"2024-05-15T14:49:14.885289+0000","last_peered":"2024-05-15T14:49:14.885289+0000","last_clean":"2024-05-15T14:49:14.885289+0000","last_became_active":"2024-05-15T14:27:52.858331+0000","last_became_peered":"2024-05-15T14:27:52.858331+0000","last_unstale":"2024-05-15T14:49:14.885289+0000","last_undegraded":"2024-05-15T14:49:14.885289+0000","last_fullsized":"2024-05-15T14:49:14.885289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'34","last_scrub_stamp":"2024-05-15T14:49:14.885193+0000","last_deep_scrub":"39'34","last_deep_scrub_stamp":"2024-05-15T14:49:14.885193+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.885193+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:35.445212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":123,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.136682+0000","last_change":"2024-05-15T14:49:18.136706+0000","last_active":"2024-05-15T14:49:18.136682+0000","last_peered":"2024-05-15T14:49:18.136682+0000","last_clean":"2024-05-15T14:49:18.136682+0000","last_became_active":"2024-05-15T14:27:50.849526+0000","last_became_peered":"2024-05-15T14:27:50.849526+0000","last_unstale":"2024-05-15T14:49:18.136682+0000","last_undegraded":"2024-05-15T14:49:18.136682+0000","last_fullsized":"2024-05-15T14:49:18.136682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:18.136598+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:18.136598+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.136598+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:44.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"39'6","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.096856+0000","last_change":"2024-05-15T14:49:19.096881+0000","last_active":"2024-05-15T14:49:19.096856+0000","last_peered":"2024-05-15T14:49:19.096856+0000","last_clean":"2024-05-15T14:49:19.096856+0000","last_became_active":"2024-05-15T14:27:52.838137+0000","last_became_peered":"2024-05-15T14:27:52.838137+0000","last_unstale":"2024-05-15T14:49:19.096856+0000","last_undegraded":"2024-05-15T14:49:19.096856+0000","last_fullsized":"2024-05-15T14:49:19.096856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:19.096756+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:19.096756+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.096756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:17.238088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"39'14","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.099204+0000","last_change":"2024-05-15T14:49:17.099231+0000","last_active":"2024-05-15T14:49:17.099204+0000","last_peered":"2024-05-15T14:49:17.099204+0000","last_clean":"2024-05-15T14:49:17.099204+0000","last_became_active":"2024-05-15T14:27:50.842240+0000","last_became_peered":"2024-05-15T14:27:50.842240+0000","last_unstale":"2024-05-15T14:49:17.099204+0000","last_undegraded":"2024-05-15T14:49:17.099204+0000","last_fullsized":"2024-05-15T14:49:17.099204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:17.099108+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:17.099108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.099108+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:37.045139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":70,"num_write_kb":11769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"39'44","reported_seq":122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.344951+0000","last_change":"2024-05-15T14:49:12.344978+0000","last_active":"2024-05-15T14:49:12.344951+0000","last_peered":"2024-05-15T14:49:12.344951+0000","last_clean":"2024-05-15T14:49:12.344951+0000","last_became_active":"2024-05-15T14:27:52.854742+0000","last_became_peered":"2024-05-15T14:27:52.854742+0000","last_unstale":"2024-05-15T14:49:12.344951+0000","last_undegraded":"2024-05-15T14:49:12.344951+0000","last_fullsized":"2024-05-15T14:49:12.344951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'44","last_scrub_stamp":"2024-05-15T14:49:12.344854+0000","last_deep_scrub":"39'44","last_deep_scrub_stamp":"2024-05-15T14:49:12.344854+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.344854+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.742018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":128,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.420991+0000","last_change":"2024-05-15T14:27:50.840673+0000","last_active":"2024-05-15T14:47:12.420991+0000","last_peered":"2024-05-15T14:47:12.420991+0000","last_clean":"2024-05-15T14:47:12.420991+0000","last_became_active":"2024-05-15T14:27:50.840405+0000","last_became_peered":"2024-05-15T14:27:50.840405+0000","last_unstale":"2024-05-15T14:47:12.420991+0000","last_undegraded":"2024-05-15T14:47:12.420991+0000","last_fullsized":"2024-05-15T14:47:12.420991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'52","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.335819+0000","last_change":"2024-05-15T14:49:10.335892+0000","last_active":"2024-05-15T14:49:10.335819+0000","last_peered":"2024-05-15T14:49:10.335819+0000","last_clean":"2024-05-15T14:49:10.335819+0000","last_became_active":"2024-05-15T14:27:52.850696+0000","last_became_peered":"2024-05-15T14:27:52.850696+0000","last_unstale":"2024-05-15T14:49:10.335819+0000","last_undegraded":"2024-05-15T14:49:10.335819+0000","last_fullsized":"2024-05-15T14:49:10.335819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'52","last_scrub_stamp":"2024-05-15T14:49:10.335711+0000","last_deep_scrub":"39'52","last_deep_scrub_stamp":"2024-05-15T14:49:10.335711+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.335711+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:40:00.831370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":72,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.264671+0000","last_change":"2024-05-15T14:27:50.849634+0000","last_active":"2024-05-15T14:47:54.264671+0000","last_peered":"2024-05-15T14:47:54.264671+0000","last_clean":"2024-05-15T14:47:54.264671+0000","last_became_active":"2024-05-15T14:27:50.848542+0000","last_became_peered":"2024-05-15T14:27:50.848542+0000","last_unstale":"2024-05-15T14:47:54.264671+0000","last_undegraded":"2024-05-15T14:47:54.264671+0000","last_fullsized":"2024-05-15T14:47:54.264671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":70,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"39'28","reported_seq":125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.311063+0000","last_change":"2024-05-15T14:49:12.311088+0000","last_active":"2024-05-15T14:49:12.311063+0000","last_peered":"2024-05-15T14:49:12.311063+0000","last_clean":"2024-05-15T14:49:12.311063+0000","last_became_active":"2024-05-15T14:27:52.861166+0000","last_became_peered":"2024-05-15T14:27:52.861166+0000","last_unstale":"2024-05-15T14:49:12.311063+0000","last_undegraded":"2024-05-15T14:49:12.311063+0000","last_fullsized":"2024-05-15T14:49:12.311063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'28","last_scrub_stamp":"2024-05-15T14:49:12.310979+0000","last_deep_scrub":"39'28","last_deep_scrub_stamp":"2024-05-15T14:49:12.310979+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.310979+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:05.453171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":102,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.439875+0000","last_change":"2024-05-15T14:27:50.837948+0000","last_active":"2024-05-15T14:48:57.439875+0000","last_peered":"2024-05-15T14:48:57.439875+0000","last_clean":"2024-05-15T14:48:57.439875+0000","last_became_active":"2024-05-15T14:27:50.837594+0000","last_became_peered":"2024-05-15T14:27:50.837594+0000","last_unstale":"2024-05-15T14:48:57.439875+0000","last_undegraded":"2024-05-15T14:48:57.439875+0000","last_fullsized":"2024-05-15T14:48:57.439875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.537224+0000","last_change":"2024-05-15T14:31:16.589931+0000","last_active":"2024-05-15T14:48:12.537224+0000","last_peered":"2024-05-15T14:48:12.537224+0000","last_clean":"2024-05-15T14:48:12.537224+0000","last_became_active":"2024-05-15T14:31:16.589649+0000","last_became_peered":"2024-05-15T14:31:16.589649+0000","last_unstale":"2024-05-15T14:48:12.537224+0000","last_undegraded":"2024-05-15T14:48:12.537224+0000","last_fullsized":"2024-05-15T14:48:12.537224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"39'24","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.843062+0000","last_change":"2024-05-15T14:28:02.891667+0000","last_active":"2024-05-15T14:47:53.843062+0000","last_peered":"2024-05-15T14:47:53.843062+0000","last_clean":"2024-05-15T14:47:53.843062+0000","last_became_active":"2024-05-15T14:28:02.891340+0000","last_became_peered":"2024-05-15T14:28:02.891340+0000","last_unstale":"2024-05-15T14:47:53.843062+0000","last_undegraded":"2024-05-15T14:47:53.843062+0000","last_fullsized":"2024-05-15T14:47:53.843062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":38,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"39'78","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.542401+0000","last_change":"2024-05-15T14:27:52.863225+0000","last_active":"2024-05-15T14:48:52.542401+0000","last_peered":"2024-05-15T14:48:52.542401+0000","last_clean":"2024-05-15T14:48:52.542401+0000","last_became_active":"2024-05-15T14:27:52.862960+0000","last_became_peered":"2024-05-15T14:27:52.862960+0000","last_unstale":"2024-05-15T14:48:52.542401+0000","last_undegraded":"2024-05-15T14:48:52.542401+0000","last_fullsized":"2024-05-15T14:48:52.542401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":231,"num_write":112,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"39'4","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.538196+0000","last_change":"2024-05-15T14:27:50.849295+0000","last_active":"2024-05-15T14:48:52.538196+0000","last_peered":"2024-05-15T14:48:52.538196+0000","last_clean":"2024-05-15T14:48:52.538196+0000","last_became_active":"2024-05-15T14:27:50.849039+0000","last_became_peered":"2024-05-15T14:27:50.849039+0000","last_unstale":"2024-05-15T14:48:52.538196+0000","last_undegraded":"2024-05-15T14:48:52.538196+0000","last_fullsized":"2024-05-15T14:48:52.538196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.094960+0000","last_change":"2024-05-15T14:49:22.094982+0000","last_active":"2024-05-15T14:49:22.094960+0000","last_peered":"2024-05-15T14:49:22.094960+0000","last_clean":"2024-05-15T14:49:22.094960+0000","last_became_active":"2024-05-15T14:27:56.876559+0000","last_became_peered":"2024-05-15T14:27:56.876559+0000","last_unstale":"2024-05-15T14:49:22.094960+0000","last_undegraded":"2024-05-15T14:49:22.094960+0000","last_fullsized":"2024-05-15T14:49:22.094960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.094867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.094867+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.094867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:00.671723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"39'273","reported_seq":561,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.163219+0000","last_change":"2024-05-15T14:49:14.163273+0000","last_active":"2024-05-15T14:49:14.163219+0000","last_peered":"2024-05-15T14:49:14.163219+0000","last_clean":"2024-05-15T14:49:14.163219+0000","last_became_active":"2024-05-15T14:27:58.883983+0000","last_became_peered":"2024-05-15T14:27:58.883983+0000","last_unstale":"2024-05-15T14:49:14.163219+0000","last_undegraded":"2024-05-15T14:49:14.163219+0000","last_fullsized":"2024-05-15T14:49:14.163219+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'273","last_scrub_stamp":"2024-05-15T14:49:14.163129+0000","last_deep_scrub":"39'273","last_deep_scrub_stamp":"2024-05-15T14:49:14.163129+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.163129+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:48.003222+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":459,"num_read_kb":564,"num_write":244,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.906676+0000","last_change":"2024-05-15T14:49:07.906703+0000","last_active":"2024-05-15T14:49:07.906676+0000","last_peered":"2024-05-15T14:49:07.906676+0000","last_clean":"2024-05-15T14:49:07.906676+0000","last_became_active":"2024-05-15T14:28:00.887947+0000","last_became_peered":"2024-05-15T14:28:00.887947+0000","last_unstale":"2024-05-15T14:49:07.906676+0000","last_undegraded":"2024-05-15T14:49:07.906676+0000","last_fullsized":"2024-05-15T14:49:07.906676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.906558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.906558+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.906558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:01.335889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.427820+0000","last_change":"2024-05-15T14:31:16.588732+0000","last_active":"2024-05-15T14:48:12.427820+0000","last_peered":"2024-05-15T14:48:12.427820+0000","last_clean":"2024-05-15T14:48:12.427820+0000","last_became_active":"2024-05-15T14:31:16.588437+0000","last_became_peered":"2024-05-15T14:31:16.588437+0000","last_unstale":"2024-05-15T14:48:12.427820+0000","last_undegraded":"2024-05-15T14:48:12.427820+0000","last_fullsized":"2024-05-15T14:48:12.427820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"39'110","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.919624+0000","last_change":"2024-05-15T14:49:04.919691+0000","last_active":"2024-05-15T14:49:04.919624+0000","last_peered":"2024-05-15T14:49:04.919624+0000","last_clean":"2024-05-15T14:49:04.919624+0000","last_became_active":"2024-05-15T14:28:02.890477+0000","last_became_peered":"2024-05-15T14:28:02.890477+0000","last_unstale":"2024-05-15T14:49:04.919624+0000","last_undegraded":"2024-05-15T14:49:04.919624+0000","last_fullsized":"2024-05-15T14:49:04.919624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'110","last_scrub_stamp":"2024-05-15T14:49:04.919526+0000","last_deep_scrub":"39'110","last_deep_scrub_stamp":"2024-05-15T14:49:04.919526+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.919526+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:33.953046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":241,"num_write":191,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"39'4","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.072073+0000","last_change":"2024-05-15T14:49:17.072115+0000","last_active":"2024-05-15T14:49:17.072073+0000","last_peered":"2024-05-15T14:49:17.072073+0000","last_clean":"2024-05-15T14:49:17.072073+0000","last_became_active":"2024-05-15T14:27:52.840847+0000","last_became_peered":"2024-05-15T14:27:52.840847+0000","last_unstale":"2024-05-15T14:49:17.072073+0000","last_undegraded":"2024-05-15T14:49:17.072073+0000","last_fullsized":"2024-05-15T14:49:17.072073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:17.071956+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:17.071956+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.071956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:47:57.482717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439056+0000","last_change":"2024-05-15T14:27:50.846344+0000","last_active":"2024-05-15T14:48:52.439056+0000","last_peered":"2024-05-15T14:48:52.439056+0000","last_clean":"2024-05-15T14:48:52.439056+0000","last_became_active":"2024-05-15T14:27:50.845923+0000","last_became_peered":"2024-05-15T14:27:50.845923+0000","last_unstale":"2024-05-15T14:48:52.439056+0000","last_undegraded":"2024-05-15T14:48:52.439056+0000","last_fullsized":"2024-05-15T14:48:52.439056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32,"num_write":82,"num_write_kb":27622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.542905+0000","last_change":"2024-05-15T14:27:56.876632+0000","last_active":"2024-05-15T14:48:57.542905+0000","last_peered":"2024-05-15T14:48:57.542905+0000","last_clean":"2024-05-15T14:48:57.542905+0000","last_became_active":"2024-05-15T14:27:56.876325+0000","last_became_peered":"2024-05-15T14:27:56.876325+0000","last_unstale":"2024-05-15T14:48:57.542905+0000","last_undegraded":"2024-05-15T14:48:57.542905+0000","last_fullsized":"2024-05-15T14:48:57.542905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"39'146","reported_seq":268,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.354381+0000","last_change":"2024-05-15T14:49:07.354466+0000","last_active":"2024-05-15T14:49:07.354381+0000","last_peered":"2024-05-15T14:49:07.354381+0000","last_clean":"2024-05-15T14:49:07.354381+0000","last_became_active":"2024-05-15T14:27:58.883792+0000","last_became_peered":"2024-05-15T14:27:58.883792+0000","last_unstale":"2024-05-15T14:49:07.354381+0000","last_undegraded":"2024-05-15T14:49:07.354381+0000","last_fullsized":"2024-05-15T14:49:07.354381+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'146","last_scrub_stamp":"2024-05-15T14:49:07.354281+0000","last_deep_scrub":"39'146","last_deep_scrub_stamp":"2024-05-15T14:49:07.354281+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.354281+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:34.204559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":205,"num_write":143,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":356,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.422341+0000","last_change":"2024-05-15T14:28:00.886183+0000","last_active":"2024-05-15T14:47:22.422341+0000","last_peered":"2024-05-15T14:47:22.422341+0000","last_clean":"2024-05-15T14:47:22.422341+0000","last_became_active":"2024-05-15T14:28:00.885933+0000","last_became_peered":"2024-05-15T14:28:00.885933+0000","last_unstale":"2024-05-15T14:47:22.422341+0000","last_undegraded":"2024-05-15T14:47:22.422341+0000","last_fullsized":"2024-05-15T14:47:22.422341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.541759+0000","last_change":"2024-05-15T14:31:16.594655+0000","last_active":"2024-05-15T14:48:47.541759+0000","last_peered":"2024-05-15T14:48:47.541759+0000","last_clean":"2024-05-15T14:48:47.541759+0000","last_became_active":"2024-05-15T14:31:16.594357+0000","last_became_peered":"2024-05-15T14:31:16.594357+0000","last_unstale":"2024-05-15T14:48:47.541759+0000","last_undegraded":"2024-05-15T14:48:47.541759+0000","last_fullsized":"2024-05-15T14:48:47.541759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"39'17","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.157550+0000","last_change":"2024-05-15T14:49:13.157580+0000","last_active":"2024-05-15T14:49:13.157550+0000","last_peered":"2024-05-15T14:49:13.157550+0000","last_clean":"2024-05-15T14:49:13.157550+0000","last_became_active":"2024-05-15T14:28:02.892764+0000","last_became_peered":"2024-05-15T14:28:02.892764+0000","last_unstale":"2024-05-15T14:49:13.157550+0000","last_undegraded":"2024-05-15T14:49:13.157550+0000","last_fullsized":"2024-05-15T14:49:13.157550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'17","last_scrub_stamp":"2024-05-15T14:49:13.157460+0000","last_deep_scrub":"39'17","last_deep_scrub_stamp":"2024-05-15T14:49:13.157460+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.157460+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:36.087366+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"39'26","reported_seq":133,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.207755+0000","last_change":"2024-05-15T14:49:22.207780+0000","last_active":"2024-05-15T14:49:22.207755+0000","last_peered":"2024-05-15T14:49:22.207755+0000","last_clean":"2024-05-15T14:49:22.207755+0000","last_became_active":"2024-05-15T14:27:52.852883+0000","last_became_peered":"2024-05-15T14:27:52.852883+0000","last_unstale":"2024-05-15T14:49:22.207755+0000","last_undegraded":"2024-05-15T14:49:22.207755+0000","last_fullsized":"2024-05-15T14:49:22.207755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:22.207662+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:22.207662+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.207662+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:55.309176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.538151+0000","last_change":"2024-05-15T14:27:50.848690+0000","last_active":"2024-05-15T14:48:52.538151+0000","last_peered":"2024-05-15T14:48:52.538151+0000","last_clean":"2024-05-15T14:48:52.538151+0000","last_became_active":"2024-05-15T14:27:50.848412+0000","last_became_peered":"2024-05-15T14:27:50.848412+0000","last_unstale":"2024-05-15T14:48:52.538151+0000","last_undegraded":"2024-05-15T14:48:52.538151+0000","last_fullsized":"2024-05-15T14:48:52.538151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"39'14","reported_seq":696,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.901760+0000","last_change":"2024-05-15T14:27:56.877306+0000","last_active":"2024-05-15T14:48:56.901760+0000","last_peered":"2024-05-15T14:48:56.901760+0000","last_clean":"2024-05-15T14:48:56.901760+0000","last_became_active":"2024-05-15T14:27:56.877039+0000","last_became_peered":"2024-05-15T14:27:56.877039+0000","last_unstale":"2024-05-15T14:48:56.901760+0000","last_undegraded":"2024-05-15T14:48:56.901760+0000","last_fullsized":"2024-05-15T14:48:56.901760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":635,"num_read_kb":635,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"39'249","reported_seq":420,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.388027+0000","last_change":"2024-05-15T14:49:14.388079+0000","last_active":"2024-05-15T14:49:14.388027+0000","last_peered":"2024-05-15T14:49:14.388027+0000","last_clean":"2024-05-15T14:49:14.388027+0000","last_became_active":"2024-05-15T14:27:58.887969+0000","last_became_peered":"2024-05-15T14:27:58.887969+0000","last_unstale":"2024-05-15T14:49:14.388027+0000","last_undegraded":"2024-05-15T14:49:14.388027+0000","last_fullsized":"2024-05-15T14:49:14.388027+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'249","last_scrub_stamp":"2024-05-15T14:49:14.387915+0000","last_deep_scrub":"39'249","last_deep_scrub_stamp":"2024-05-15T14:49:14.387915+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.387915+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:38:24.882431+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":351,"num_read_kb":343,"num_write":242,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'927","reported_seq":1442,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.918271+0000","last_change":"2024-05-15T14:49:03.918299+0000","last_active":"2024-05-15T14:49:03.918271+0000","last_peered":"2024-05-15T14:49:03.918271+0000","last_clean":"2024-05-15T14:49:03.918271+0000","last_became_active":"2024-05-15T14:28:00.892864+0000","last_became_peered":"2024-05-15T14:28:00.892864+0000","last_unstale":"2024-05-15T14:49:03.918271+0000","last_undegraded":"2024-05-15T14:49:03.918271+0000","last_fullsized":"2024-05-15T14:49:03.918271+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:03.918163+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:03.918163+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.918163+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:03.560609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.541728+0000","last_change":"2024-05-15T14:31:16.584361+0000","last_active":"2024-05-15T14:48:47.541728+0000","last_peered":"2024-05-15T14:48:47.541728+0000","last_clean":"2024-05-15T14:48:47.541728+0000","last_became_active":"2024-05-15T14:31:16.583997+0000","last_became_peered":"2024-05-15T14:31:16.583997+0000","last_unstale":"2024-05-15T14:48:47.541728+0000","last_undegraded":"2024-05-15T14:48:47.541728+0000","last_fullsized":"2024-05-15T14:48:47.541728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"39'29","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.427225+0000","last_change":"2024-05-15T14:28:02.887587+0000","last_active":"2024-05-15T14:48:02.427225+0000","last_peered":"2024-05-15T14:48:02.427225+0000","last_clean":"2024-05-15T14:48:02.427225+0000","last_became_active":"2024-05-15T14:28:02.887257+0000","last_became_peered":"2024-05-15T14:28:02.887257+0000","last_unstale":"2024-05-15T14:48:02.427225+0000","last_undegraded":"2024-05-15T14:48:02.427225+0000","last_fullsized":"2024-05-15T14:48:02.427225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":53,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"39'24","reported_seq":109,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.529452+0000","last_change":"2024-05-15T14:27:52.852418+0000","last_active":"2024-05-15T14:47:12.529452+0000","last_peered":"2024-05-15T14:47:12.529452+0000","last_clean":"2024-05-15T14:47:12.529452+0000","last_became_active":"2024-05-15T14:27:52.851979+0000","last_became_peered":"2024-05-15T14:27:52.851979+0000","last_unstale":"2024-05-15T14:47:12.529452+0000","last_undegraded":"2024-05-15T14:47:12.529452+0000","last_fullsized":"2024-05-15T14:47:12.529452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":90,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"39'6","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.054924+0000","last_change":"2024-05-15T14:49:16.054952+0000","last_active":"2024-05-15T14:49:16.054924+0000","last_peered":"2024-05-15T14:49:16.054924+0000","last_clean":"2024-05-15T14:49:16.054924+0000","last_became_active":"2024-05-15T14:27:50.840772+0000","last_became_peered":"2024-05-15T14:27:50.840772+0000","last_unstale":"2024-05-15T14:49:16.054924+0000","last_undegraded":"2024-05-15T14:49:16.054924+0000","last_fullsized":"2024-05-15T14:49:16.054924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:16.054831+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:16.054831+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.054831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:32.603698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":30,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:17.421516+0000","last_change":"2024-05-15T14:27:56.878098+0000","last_active":"2024-05-15T14:47:17.421516+0000","last_peered":"2024-05-15T14:47:17.421516+0000","last_clean":"2024-05-15T14:47:17.421516+0000","last_became_active":"2024-05-15T14:27:56.877825+0000","last_became_peered":"2024-05-15T14:27:56.877825+0000","last_unstale":"2024-05-15T14:47:17.421516+0000","last_undegraded":"2024-05-15T14:47:17.421516+0000","last_fullsized":"2024-05-15T14:47:17.421516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"39'280","reported_seq":23297,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.882423+0000","last_change":"2024-05-15T14:49:09.882459+0000","last_active":"2024-05-15T14:49:09.882423+0000","last_peered":"2024-05-15T14:49:09.882423+0000","last_clean":"2024-05-15T14:49:09.882423+0000","last_became_active":"2024-05-15T14:27:58.887424+0000","last_became_peered":"2024-05-15T14:27:58.887424+0000","last_unstale":"2024-05-15T14:49:09.882423+0000","last_undegraded":"2024-05-15T14:49:09.882423+0000","last_fullsized":"2024-05-15T14:49:09.882423+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'280","last_scrub_stamp":"2024-05-15T14:49:09.882332+0000","last_deep_scrub":"39'280","last_deep_scrub_stamp":"2024-05-15T14:49:09.882332+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.882332+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:27.843470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57546,"num_read_kb":170986,"num_write":274,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'927","reported_seq":2608,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.662712+0000","last_change":"2024-05-15T14:49:06.662741+0000","last_active":"2024-05-15T14:49:06.662712+0000","last_peered":"2024-05-15T14:49:06.662712+0000","last_clean":"2024-05-15T14:49:06.662712+0000","last_became_active":"2024-05-15T14:28:00.887493+0000","last_became_peered":"2024-05-15T14:28:00.887493+0000","last_unstale":"2024-05-15T14:49:06.662712+0000","last_undegraded":"2024-05-15T14:49:06.662712+0000","last_fullsized":"2024-05-15T14:49:06.662712+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:06.662621+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:06.662621+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.662621+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:14.729989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.432811+0000","last_change":"2024-05-15T14:31:16.592231+0000","last_active":"2024-05-15T14:48:02.432811+0000","last_peered":"2024-05-15T14:48:02.432811+0000","last_clean":"2024-05-15T14:48:02.432811+0000","last_became_active":"2024-05-15T14:31:16.591945+0000","last_became_peered":"2024-05-15T14:31:16.591945+0000","last_unstale":"2024-05-15T14:48:02.432811+0000","last_undegraded":"2024-05-15T14:48:02.432811+0000","last_fullsized":"2024-05-15T14:48:02.432811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"39'16","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.074714+0000","last_change":"2024-05-15T14:49:14.074781+0000","last_active":"2024-05-15T14:49:14.074714+0000","last_peered":"2024-05-15T14:49:14.074714+0000","last_clean":"2024-05-15T14:49:14.074714+0000","last_became_active":"2024-05-15T14:27:52.842056+0000","last_became_peered":"2024-05-15T14:27:52.842056+0000","last_unstale":"2024-05-15T14:49:14.074714+0000","last_undegraded":"2024-05-15T14:49:14.074714+0000","last_fullsized":"2024-05-15T14:49:14.074714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:14.074605+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:14.074605+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.074605+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:37.454474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.532479+0000","last_change":"2024-05-15T14:27:50.850292+0000","last_active":"2024-05-15T14:48:07.532479+0000","last_peered":"2024-05-15T14:48:07.532479+0000","last_clean":"2024-05-15T14:48:07.532479+0000","last_became_active":"2024-05-15T14:27:50.849981+0000","last_became_peered":"2024-05-15T14:27:50.849981+0000","last_unstale":"2024-05-15T14:48:07.532479+0000","last_undegraded":"2024-05-15T14:48:07.532479+0000","last_fullsized":"2024-05-15T14:48:07.532479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"39'2","reported_seq":138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.696191+0000","last_change":"2024-05-15T14:49:20.696222+0000","last_active":"2024-05-15T14:49:20.696191+0000","last_peered":"2024-05-15T14:49:20.696191+0000","last_clean":"2024-05-15T14:49:20.696191+0000","last_became_active":"2024-05-15T14:27:56.878269+0000","last_became_peered":"2024-05-15T14:27:56.878269+0000","last_unstale":"2024-05-15T14:49:20.696191+0000","last_undegraded":"2024-05-15T14:49:20.696191+0000","last_fullsized":"2024-05-15T14:49:20.696191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:20.696101+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:20.696101+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.696101+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:01.913190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":160,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"39'436","reported_seq":756,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.984682+0000","last_change":"2024-05-15T14:49:10.984753+0000","last_active":"2024-05-15T14:49:10.984682+0000","last_peered":"2024-05-15T14:49:10.984682+0000","last_clean":"2024-05-15T14:49:10.984682+0000","last_became_active":"2024-05-15T14:27:58.883546+0000","last_became_peered":"2024-05-15T14:27:58.883546+0000","last_unstale":"2024-05-15T14:49:10.984682+0000","last_undegraded":"2024-05-15T14:49:10.984682+0000","last_fullsized":"2024-05-15T14:49:10.984682+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'436","last_scrub_stamp":"2024-05-15T14:49:10.984585+0000","last_deep_scrub":"39'436","last_deep_scrub_stamp":"2024-05-15T14:49:10.984585+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.984585+0000","objects_scrubbed":10,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:04.126776+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":668,"num_read_kb":656,"num_write":402,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:17.434467+0000","last_change":"2024-05-15T14:28:00.892179+0000","last_active":"2024-05-15T14:48:17.434467+0000","last_peered":"2024-05-15T14:48:17.434467+0000","last_clean":"2024-05-15T14:48:17.434467+0000","last_became_active":"2024-05-15T14:28:00.891863+0000","last_became_peered":"2024-05-15T14:28:00.891863+0000","last_unstale":"2024-05-15T14:48:17.434467+0000","last_undegraded":"2024-05-15T14:48:17.434467+0000","last_fullsized":"2024-05-15T14:48:17.434467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"39'26","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.857505+0000","last_change":"2024-05-15T14:49:02.857570+0000","last_active":"2024-05-15T14:49:02.857505+0000","last_peered":"2024-05-15T14:49:02.857505+0000","last_clean":"2024-05-15T14:49:02.857505+0000","last_became_active":"2024-05-15T14:28:02.890450+0000","last_became_peered":"2024-05-15T14:28:02.890450+0000","last_unstale":"2024-05-15T14:49:02.857505+0000","last_undegraded":"2024-05-15T14:49:02.857505+0000","last_fullsized":"2024-05-15T14:49:02.857505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:02.857396+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:02.857396+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.857396+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:42.403406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.431631+0000","last_change":"2024-05-15T14:31:16.596637+0000","last_active":"2024-05-15T14:47:57.431631+0000","last_peered":"2024-05-15T14:47:57.431631+0000","last_clean":"2024-05-15T14:47:57.431631+0000","last_became_active":"2024-05-15T14:31:16.596344+0000","last_became_peered":"2024-05-15T14:31:16.596344+0000","last_unstale":"2024-05-15T14:47:57.431631+0000","last_undegraded":"2024-05-15T14:47:57.431631+0000","last_fullsized":"2024-05-15T14:47:57.431631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'6","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.270170+0000","last_change":"2024-05-15T14:49:14.270195+0000","last_active":"2024-05-15T14:49:14.270170+0000","last_peered":"2024-05-15T14:49:14.270170+0000","last_clean":"2024-05-15T14:49:14.270170+0000","last_became_active":"2024-05-15T14:27:52.861131+0000","last_became_peered":"2024-05-15T14:27:52.861131+0000","last_unstale":"2024-05-15T14:49:14.270170+0000","last_undegraded":"2024-05-15T14:49:14.270170+0000","last_fullsized":"2024-05-15T14:49:14.270170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:14.270082+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:14.270082+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.270082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:38.007525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.532463+0000","last_change":"2024-05-15T14:27:50.848143+0000","last_active":"2024-05-15T14:48:07.532463+0000","last_peered":"2024-05-15T14:48:07.532463+0000","last_clean":"2024-05-15T14:48:07.532463+0000","last_became_active":"2024-05-15T14:27:50.847875+0000","last_became_peered":"2024-05-15T14:27:50.847875+0000","last_unstale":"2024-05-15T14:48:07.532463+0000","last_undegraded":"2024-05-15T14:48:07.532463+0000","last_fullsized":"2024-05-15T14:48:07.532463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":11761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"39'2","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.405650+0000","last_change":"2024-05-15T14:49:01.405677+0000","last_active":"2024-05-15T14:49:01.405650+0000","last_peered":"2024-05-15T14:49:01.405650+0000","last_clean":"2024-05-15T14:49:01.405650+0000","last_became_active":"2024-05-15T14:27:56.881088+0000","last_became_peered":"2024-05-15T14:27:56.881088+0000","last_unstale":"2024-05-15T14:49:01.405650+0000","last_undegraded":"2024-05-15T14:49:01.405650+0000","last_fullsized":"2024-05-15T14:49:01.405650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:01.405573+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:01.405573+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.405573+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:12:23.625819+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"39'629","reported_seq":1024,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.696175+0000","last_change":"2024-05-15T14:49:11.696218+0000","last_active":"2024-05-15T14:49:11.696175+0000","last_peered":"2024-05-15T14:49:11.696175+0000","last_clean":"2024-05-15T14:49:11.696175+0000","last_became_active":"2024-05-15T14:27:58.882302+0000","last_became_peered":"2024-05-15T14:27:58.882302+0000","last_unstale":"2024-05-15T14:49:11.696175+0000","last_undegraded":"2024-05-15T14:49:11.696175+0000","last_fullsized":"2024-05-15T14:49:11.696175+0000","mapping_epoch":26,"log_start":"39'598","ondisk_log_start":"39'598","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'629","last_scrub_stamp":"2024-05-15T14:49:11.696077+0000","last_deep_scrub":"39'629","last_deep_scrub_stamp":"2024-05-15T14:49:11.696077+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.696077+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":598,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:39:54.520996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1288,"num_read_kb":3202,"num_write":806,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.705639+0000","last_change":"2024-05-15T14:49:07.705697+0000","last_active":"2024-05-15T14:49:07.705639+0000","last_peered":"2024-05-15T14:49:07.705639+0000","last_clean":"2024-05-15T14:49:07.705639+0000","last_became_active":"2024-05-15T14:28:00.887335+0000","last_became_peered":"2024-05-15T14:28:00.887335+0000","last_unstale":"2024-05-15T14:49:07.705639+0000","last_undegraded":"2024-05-15T14:49:07.705639+0000","last_fullsized":"2024-05-15T14:49:07.705639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.705526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.705526+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.705526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:23.807975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"39'15","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.433377+0000","last_change":"2024-05-15T14:28:02.889484+0000","last_active":"2024-05-15T14:48:57.433377+0000","last_peered":"2024-05-15T14:48:57.433377+0000","last_clean":"2024-05-15T14:48:57.433377+0000","last_became_active":"2024-05-15T14:28:02.889193+0000","last_became_peered":"2024-05-15T14:28:02.889193+0000","last_unstale":"2024-05-15T14:48:57.433377+0000","last_undegraded":"2024-05-15T14:48:57.433377+0000","last_fullsized":"2024-05-15T14:48:57.433377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.431614+0000","last_change":"2024-05-15T14:31:16.591065+0000","last_active":"2024-05-15T14:48:37.431614+0000","last_peered":"2024-05-15T14:48:37.431614+0000","last_clean":"2024-05-15T14:48:37.431614+0000","last_became_active":"2024-05-15T14:31:16.590510+0000","last_became_peered":"2024-05-15T14:31:16.590510+0000","last_unstale":"2024-05-15T14:48:37.431614+0000","last_undegraded":"2024-05-15T14:48:37.431614+0000","last_fullsized":"2024-05-15T14:48:37.431614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"39'64","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.096834+0000","last_change":"2024-05-15T14:49:06.096871+0000","last_active":"2024-05-15T14:49:06.096834+0000","last_peered":"2024-05-15T14:49:06.096834+0000","last_clean":"2024-05-15T14:49:06.096834+0000","last_became_active":"2024-05-15T14:27:52.861183+0000","last_became_peered":"2024-05-15T14:27:52.861183+0000","last_unstale":"2024-05-15T14:49:06.096834+0000","last_undegraded":"2024-05-15T14:49:06.096834+0000","last_fullsized":"2024-05-15T14:49:06.096834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'64","last_scrub_stamp":"2024-05-15T14:49:06.096747+0000","last_deep_scrub":"39'64","last_deep_scrub_stamp":"2024-05-15T14:49:06.096747+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.096747+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:53:33.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":194,"num_write":90,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"39'4","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.700206+0000","last_change":"2024-05-15T14:49:21.700263+0000","last_active":"2024-05-15T14:49:21.700206+0000","last_peered":"2024-05-15T14:49:21.700206+0000","last_clean":"2024-05-15T14:49:21.700206+0000","last_became_active":"2024-05-15T14:27:50.852376+0000","last_became_peered":"2024-05-15T14:27:50.852376+0000","last_unstale":"2024-05-15T14:49:21.700206+0000","last_undegraded":"2024-05-15T14:49:21.700206+0000","last_fullsized":"2024-05-15T14:49:21.700206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:21.700108+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:21.700108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.700108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:19.841440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.442355+0000","last_change":"2024-05-15T14:49:02.442381+0000","last_active":"2024-05-15T14:49:02.442355+0000","last_peered":"2024-05-15T14:49:02.442355+0000","last_clean":"2024-05-15T14:49:02.442355+0000","last_became_active":"2024-05-15T14:27:56.881701+0000","last_became_peered":"2024-05-15T14:27:56.881701+0000","last_unstale":"2024-05-15T14:49:02.442355+0000","last_undegraded":"2024-05-15T14:49:02.442355+0000","last_fullsized":"2024-05-15T14:49:02.442355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:02.442283+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:02.442283+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.442283+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:35:32.123039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"39'434","reported_seq":798,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.025693+0000","last_change":"2024-05-15T14:27:58.886060+0000","last_active":"2024-05-15T14:48:57.025693+0000","last_peered":"2024-05-15T14:48:57.025693+0000","last_clean":"2024-05-15T14:48:57.025693+0000","last_became_active":"2024-05-15T14:27:58.885487+0000","last_became_peered":"2024-05-15T14:27:58.885487+0000","last_unstale":"2024-05-15T14:48:57.025693+0000","last_undegraded":"2024-05-15T14:48:57.025693+0000","last_fullsized":"2024-05-15T14:48:57.025693+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":878,"num_read_kb":1340,"num_write":447,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"39'927","reported_seq":1556,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.091875+0000","last_change":"2024-05-15T14:49:03.091914+0000","last_active":"2024-05-15T14:49:03.091875+0000","last_peered":"2024-05-15T14:49:03.091875+0000","last_clean":"2024-05-15T14:49:03.091875+0000","last_became_active":"2024-05-15T14:28:00.892897+0000","last_became_peered":"2024-05-15T14:28:00.892897+0000","last_unstale":"2024-05-15T14:49:03.091875+0000","last_undegraded":"2024-05-15T14:49:03.091875+0000","last_fullsized":"2024-05-15T14:49:03.091875+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:03.091775+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:03.091775+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.091775+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:21:11.950686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"39'14","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.754565+0000","last_change":"2024-05-15T14:28:02.894508+0000","last_active":"2024-05-15T14:47:53.754565+0000","last_peered":"2024-05-15T14:47:53.754565+0000","last_clean":"2024-05-15T14:47:53.754565+0000","last_became_active":"2024-05-15T14:28:02.894071+0000","last_became_peered":"2024-05-15T14:28:02.894071+0000","last_unstale":"2024-05-15T14:47:53.754565+0000","last_undegraded":"2024-05-15T14:47:53.754565+0000","last_fullsized":"2024-05-15T14:47:53.754565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.431587+0000","last_change":"2024-05-15T14:31:16.591474+0000","last_active":"2024-05-15T14:48:37.431587+0000","last_peered":"2024-05-15T14:48:37.431587+0000","last_clean":"2024-05-15T14:48:37.431587+0000","last_became_active":"2024-05-15T14:31:16.591166+0000","last_became_peered":"2024-05-15T14:31:16.591166+0000","last_unstale":"2024-05-15T14:48:37.431587+0000","last_undegraded":"2024-05-15T14:48:37.431587+0000","last_fullsized":"2024-05-15T14:48:37.431587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'114","reported_seq":215,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.173130+0000","last_change":"2024-05-15T14:49:17.173165+0000","last_active":"2024-05-15T14:49:17.173130+0000","last_peered":"2024-05-15T14:49:17.173130+0000","last_clean":"2024-05-15T14:49:17.173130+0000","last_became_active":"2024-05-15T14:27:52.859814+0000","last_became_peered":"2024-05-15T14:27:52.859814+0000","last_unstale":"2024-05-15T14:49:17.173130+0000","last_undegraded":"2024-05-15T14:49:17.173130+0000","last_fullsized":"2024-05-15T14:49:17.173130+0000","mapping_epoch":20,"log_start":"39'100","ondisk_log_start":"39'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'114","last_scrub_stamp":"2024-05-15T14:49:17.173033+0000","last_deep_scrub":"39'114","last_deep_scrub_stamp":"2024-05-15T14:49:17.173033+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.173033+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:41.404786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":332,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"39'12","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427813+0000","last_change":"2024-05-15T14:27:50.849872+0000","last_active":"2024-05-15T14:48:07.427813+0000","last_peered":"2024-05-15T14:48:07.427813+0000","last_clean":"2024-05-15T14:48:07.427813+0000","last_became_active":"2024-05-15T14:27:50.849548+0000","last_became_peered":"2024-05-15T14:27:50.849548+0000","last_unstale":"2024-05-15T14:48:07.427813+0000","last_undegraded":"2024-05-15T14:48:07.427813+0000","last_fullsized":"2024-05-15T14:48:07.427813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"39'7","reported_seq":657,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.339106+0000","last_change":"2024-05-15T14:49:13.339142+0000","last_active":"2024-05-15T14:49:13.339106+0000","last_peered":"2024-05-15T14:49:13.339106+0000","last_clean":"2024-05-15T14:49:13.339106+0000","last_became_active":"2024-05-15T14:27:56.871644+0000","last_became_peered":"2024-05-15T14:27:56.871644+0000","last_unstale":"2024-05-15T14:49:13.339106+0000","last_undegraded":"2024-05-15T14:49:13.339106+0000","last_fullsized":"2024-05-15T14:49:13.339106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'7","last_scrub_stamp":"2024-05-15T14:49:13.339007+0000","last_deep_scrub":"39'7","last_deep_scrub_stamp":"2024-05-15T14:49:13.339007+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.339007+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:00.220785+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":148,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'281","reported_seq":575,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.032547+0000","last_change":"2024-05-15T14:27:58.881240+0000","last_active":"2024-05-15T14:48:57.032547+0000","last_peered":"2024-05-15T14:48:57.032547+0000","last_clean":"2024-05-15T14:48:57.032547+0000","last_became_active":"2024-05-15T14:27:58.880926+0000","last_became_peered":"2024-05-15T14:27:58.880926+0000","last_unstale":"2024-05-15T14:48:57.032547+0000","last_undegraded":"2024-05-15T14:48:57.032547+0000","last_fullsized":"2024-05-15T14:48:57.032547+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":467,"num_write":232,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.429639+0000","last_change":"2024-05-15T14:49:16.429665+0000","last_active":"2024-05-15T14:49:16.429639+0000","last_peered":"2024-05-15T14:49:16.429639+0000","last_clean":"2024-05-15T14:49:16.429639+0000","last_became_active":"2024-05-15T14:28:00.886359+0000","last_became_peered":"2024-05-15T14:28:00.886359+0000","last_unstale":"2024-05-15T14:49:16.429639+0000","last_undegraded":"2024-05-15T14:49:16.429639+0000","last_fullsized":"2024-05-15T14:49:16.429639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:16.429548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:16.429548+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.429548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:12:59.179260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"39'29","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.335124+0000","last_change":"2024-05-15T14:28:02.892567+0000","last_active":"2024-05-15T14:47:54.335124+0000","last_peered":"2024-05-15T14:47:54.335124+0000","last_clean":"2024-05-15T14:47:54.335124+0000","last_became_active":"2024-05-15T14:28:02.892287+0000","last_became_peered":"2024-05-15T14:28:02.892287+0000","last_unstale":"2024-05-15T14:47:54.335124+0000","last_undegraded":"2024-05-15T14:47:54.335124+0000","last_fullsized":"2024-05-15T14:47:54.335124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.535310+0000","last_change":"2024-05-15T14:31:16.590519+0000","last_active":"2024-05-15T14:47:57.535310+0000","last_peered":"2024-05-15T14:47:57.535310+0000","last_clean":"2024-05-15T14:47:57.535310+0000","last_became_active":"2024-05-15T14:31:16.590227+0000","last_became_peered":"2024-05-15T14:31:16.590227+0000","last_unstale":"2024-05-15T14:47:57.535310+0000","last_undegraded":"2024-05-15T14:47:57.535310+0000","last_fullsized":"2024-05-15T14:47:57.535310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.285333+0000","last_change":"2024-05-15T14:49:13.285358+0000","last_active":"2024-05-15T14:49:13.285333+0000","last_peered":"2024-05-15T14:49:13.285333+0000","last_clean":"2024-05-15T14:49:13.285333+0000","last_became_active":"2024-05-15T14:27:52.851589+0000","last_became_peered":"2024-05-15T14:27:52.851589+0000","last_unstale":"2024-05-15T14:49:13.285333+0000","last_undegraded":"2024-05-15T14:49:13.285333+0000","last_fullsized":"2024-05-15T14:49:13.285333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-05-15T14:49:13.285211+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-05-15T14:49:13.285211+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.285211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:33.845230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"39'14","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.027357+0000","last_change":"2024-05-15T14:27:50.850680+0000","last_active":"2024-05-15T14:48:26.027357+0000","last_peered":"2024-05-15T14:48:26.027357+0000","last_clean":"2024-05-15T14:48:26.027357+0000","last_became_active":"2024-05-15T14:27:50.850389+0000","last_became_peered":"2024-05-15T14:27:50.850389+0000","last_unstale":"2024-05-15T14:48:26.027357+0000","last_undegraded":"2024-05-15T14:48:26.027357+0000","last_fullsized":"2024-05-15T14:48:26.027357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":19,"num_write":54,"num_write_kb":19955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"39'2","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.375023+0000","last_change":"2024-05-15T14:49:05.375068+0000","last_active":"2024-05-15T14:49:05.375023+0000","last_peered":"2024-05-15T14:49:05.375023+0000","last_clean":"2024-05-15T14:49:05.375023+0000","last_became_active":"2024-05-15T14:27:56.876626+0000","last_became_peered":"2024-05-15T14:27:56.876626+0000","last_unstale":"2024-05-15T14:49:05.375023+0000","last_undegraded":"2024-05-15T14:49:05.375023+0000","last_fullsized":"2024-05-15T14:49:05.375023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:05.374887+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:05.374887+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.374887+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:18:12.646630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"39'370","reported_seq":605,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.358051+0000","last_change":"2024-05-15T14:49:05.358132+0000","last_active":"2024-05-15T14:49:05.358051+0000","last_peered":"2024-05-15T14:49:05.358051+0000","last_clean":"2024-05-15T14:49:05.358051+0000","last_became_active":"2024-05-15T14:27:58.885156+0000","last_became_peered":"2024-05-15T14:27:58.885156+0000","last_unstale":"2024-05-15T14:49:05.358051+0000","last_undegraded":"2024-05-15T14:49:05.358051+0000","last_fullsized":"2024-05-15T14:49:05.358051+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'370","last_scrub_stamp":"2024-05-15T14:49:05.357940+0000","last_deep_scrub":"39'370","last_deep_scrub_stamp":"2024-05-15T14:49:05.357940+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.357940+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:31.785729+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":666,"num_write":563,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.155853+0000","last_change":"2024-05-15T14:49:08.155879+0000","last_active":"2024-05-15T14:49:08.155853+0000","last_peered":"2024-05-15T14:49:08.155853+0000","last_clean":"2024-05-15T14:49:08.155853+0000","last_became_active":"2024-05-15T14:28:00.885582+0000","last_became_peered":"2024-05-15T14:28:00.885582+0000","last_unstale":"2024-05-15T14:49:08.155853+0000","last_undegraded":"2024-05-15T14:49:08.155853+0000","last_fullsized":"2024-05-15T14:49:08.155853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:08.155739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:08.155739+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.155739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:28.715758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"39'25","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.644153+0000","last_change":"2024-05-15T14:49:01.644201+0000","last_active":"2024-05-15T14:49:01.644153+0000","last_peered":"2024-05-15T14:49:01.644153+0000","last_clean":"2024-05-15T14:49:01.644153+0000","last_became_active":"2024-05-15T14:28:02.891419+0000","last_became_peered":"2024-05-15T14:28:02.891419+0000","last_unstale":"2024-05-15T14:49:01.644153+0000","last_undegraded":"2024-05-15T14:49:01.644153+0000","last_fullsized":"2024-05-15T14:49:01.644153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:01.644062+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:01.644062+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.644062+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:25.023932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:00.579873+0000","last_change":"2024-05-15T14:31:16.594272+0000","last_active":"2024-05-15T14:49:00.579873+0000","last_peered":"2024-05-15T14:49:00.579873+0000","last_clean":"2024-05-15T14:49:00.579873+0000","last_became_active":"2024-05-15T14:31:16.593942+0000","last_became_peered":"2024-05-15T14:31:16.593942+0000","last_unstale":"2024-05-15T14:49:00.579873+0000","last_undegraded":"2024-05-15T14:49:00.579873+0000","last_fullsized":"2024-05-15T14:49:00.579873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'62","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.353713+0000","last_change":"2024-05-15T14:49:11.353752+0000","last_active":"2024-05-15T14:49:11.353713+0000","last_peered":"2024-05-15T14:49:11.353713+0000","last_clean":"2024-05-15T14:49:11.353713+0000","last_became_active":"2024-05-15T14:27:52.853828+0000","last_became_peered":"2024-05-15T14:27:52.853828+0000","last_unstale":"2024-05-15T14:49:11.353713+0000","last_undegraded":"2024-05-15T14:49:11.353713+0000","last_fullsized":"2024-05-15T14:49:11.353713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'62","last_scrub_stamp":"2024-05-15T14:49:11.353622+0000","last_deep_scrub":"39'62","last_deep_scrub_stamp":"2024-05-15T14:49:11.353622+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.353622+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:09.197152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":210,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"39'10","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.123233+0000","last_change":"2024-05-15T14:49:14.123271+0000","last_active":"2024-05-15T14:49:14.123233+0000","last_peered":"2024-05-15T14:49:14.123233+0000","last_clean":"2024-05-15T14:49:14.123233+0000","last_became_active":"2024-05-15T14:27:50.838561+0000","last_became_peered":"2024-05-15T14:27:50.838561+0000","last_unstale":"2024-05-15T14:49:14.123233+0000","last_undegraded":"2024-05-15T14:49:14.123233+0000","last_fullsized":"2024-05-15T14:49:14.123233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:14.123131+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:14.123131+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.123131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:55.813793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.101861+0000","last_change":"2024-05-15T14:49:06.101896+0000","last_active":"2024-05-15T14:49:06.101861+0000","last_peered":"2024-05-15T14:49:06.101861+0000","last_clean":"2024-05-15T14:49:06.101861+0000","last_became_active":"2024-05-15T14:27:56.884903+0000","last_became_peered":"2024-05-15T14:27:56.884903+0000","last_unstale":"2024-05-15T14:49:06.101861+0000","last_undegraded":"2024-05-15T14:49:06.101861+0000","last_fullsized":"2024-05-15T14:49:06.101861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.101757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.101757+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.101757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:12:19.458737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"39'350","reported_seq":622,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.403780+0000","last_change":"2024-05-15T14:49:04.403823+0000","last_active":"2024-05-15T14:49:04.403780+0000","last_peered":"2024-05-15T14:49:04.403780+0000","last_clean":"2024-05-15T14:49:04.403780+0000","last_became_active":"2024-05-15T14:27:58.876221+0000","last_became_peered":"2024-05-15T14:27:58.876221+0000","last_unstale":"2024-05-15T14:49:04.403780+0000","last_undegraded":"2024-05-15T14:49:04.403780+0000","last_fullsized":"2024-05-15T14:49:04.403780+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'350","last_scrub_stamp":"2024-05-15T14:49:04.403697+0000","last_deep_scrub":"39'350","last_deep_scrub_stamp":"2024-05-15T14:49:04.403697+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.403697+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:59:21.647975+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":528,"num_write":320,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'927","reported_seq":1409,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.391534+0000","last_change":"2024-05-15T14:49:15.391565+0000","last_active":"2024-05-15T14:49:15.391534+0000","last_peered":"2024-05-15T14:49:15.391534+0000","last_clean":"2024-05-15T14:49:15.391534+0000","last_became_active":"2024-05-15T14:28:00.884042+0000","last_became_peered":"2024-05-15T14:28:00.884042+0000","last_unstale":"2024-05-15T14:49:15.391534+0000","last_undegraded":"2024-05-15T14:49:15.391534+0000","last_fullsized":"2024-05-15T14:49:15.391534+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:15.391447+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:15.391447+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.391447+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:52:07.864522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"39'23","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439050+0000","last_change":"2024-05-15T14:28:02.888922+0000","last_active":"2024-05-15T14:48:52.439050+0000","last_peered":"2024-05-15T14:48:52.439050+0000","last_clean":"2024-05-15T14:48:52.439050+0000","last_became_active":"2024-05-15T14:28:02.888602+0000","last_became_peered":"2024-05-15T14:28:02.888602+0000","last_unstale":"2024-05-15T14:48:52.439050+0000","last_undegraded":"2024-05-15T14:48:52.439050+0000","last_fullsized":"2024-05-15T14:48:52.439050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.530991+0000","last_change":"2024-05-15T14:31:16.591991+0000","last_active":"2024-05-15T14:47:57.530991+0000","last_peered":"2024-05-15T14:47:57.530991+0000","last_clean":"2024-05-15T14:47:57.530991+0000","last_became_active":"2024-05-15T14:31:16.591677+0000","last_became_peered":"2024-05-15T14:31:16.591677+0000","last_unstale":"2024-05-15T14:47:57.530991+0000","last_undegraded":"2024-05-15T14:47:57.530991+0000","last_fullsized":"2024-05-15T14:47:57.530991+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'72","reported_seq":200,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427845+0000","last_change":"2024-05-15T14:27:52.844483+0000","last_active":"2024-05-15T14:48:07.427845+0000","last_peered":"2024-05-15T14:48:07.427845+0000","last_clean":"2024-05-15T14:48:07.427845+0000","last_became_active":"2024-05-15T14:27:52.844221+0000","last_became_peered":"2024-05-15T14:27:52.844221+0000","last_unstale":"2024-05-15T14:48:07.427845+0000","last_undegraded":"2024-05-15T14:48:07.427845+0000","last_fullsized":"2024-05-15T14:48:07.427845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":255,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.027273+0000","last_change":"2024-05-15T14:27:50.849342+0000","last_active":"2024-05-15T14:48:26.027273+0000","last_peered":"2024-05-15T14:48:26.027273+0000","last_clean":"2024-05-15T14:48:26.027273+0000","last_became_active":"2024-05-15T14:27:50.846927+0000","last_became_peered":"2024-05-15T14:27:50.846927+0000","last_unstale":"2024-05-15T14:48:26.027273+0000","last_undegraded":"2024-05-15T14:48:26.027273+0000","last_fullsized":"2024-05-15T14:48:26.027273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":82,"num_write_kb":24687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'6","reported_seq":804,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.902409+0000","last_change":"2024-05-15T14:27:56.882327+0000","last_active":"2024-05-15T14:48:56.902409+0000","last_peered":"2024-05-15T14:48:56.902409+0000","last_clean":"2024-05-15T14:48:56.902409+0000","last_became_active":"2024-05-15T14:27:56.882055+0000","last_became_peered":"2024-05-15T14:27:56.882055+0000","last_unstale":"2024-05-15T14:48:56.902409+0000","last_undegraded":"2024-05-15T14:48:56.902409+0000","last_fullsized":"2024-05-15T14:48:56.902409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1075,"num_read_kb":1818,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"39'236","reported_seq":398,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.677996+0000","last_change":"2024-05-15T14:49:17.678035+0000","last_active":"2024-05-15T14:49:17.677996+0000","last_peered":"2024-05-15T14:49:17.677996+0000","last_clean":"2024-05-15T14:49:17.677996+0000","last_became_active":"2024-05-15T14:27:58.878514+0000","last_became_peered":"2024-05-15T14:27:58.878514+0000","last_unstale":"2024-05-15T14:49:17.677996+0000","last_undegraded":"2024-05-15T14:49:17.677996+0000","last_fullsized":"2024-05-15T14:49:17.677996+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'236","last_scrub_stamp":"2024-05-15T14:49:17.677899+0000","last_deep_scrub":"39'236","last_deep_scrub_stamp":"2024-05-15T14:49:17.677899+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.677899+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:19.987437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":332,"num_write":230,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'927","reported_seq":1433,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.058363+0000","last_change":"2024-05-15T14:28:00.891775+0000","last_active":"2024-05-15T14:48:57.058363+0000","last_peered":"2024-05-15T14:48:57.058363+0000","last_clean":"2024-05-15T14:48:57.058363+0000","last_became_active":"2024-05-15T14:28:00.891535+0000","last_became_peered":"2024-05-15T14:28:00.891535+0000","last_unstale":"2024-05-15T14:48:57.058363+0000","last_undegraded":"2024-05-15T14:48:57.058363+0000","last_fullsized":"2024-05-15T14:48:57.058363+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:59.869572+0000","last_clean_scrub_stamp":"2024-05-15T14:27:59.869572+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"39'19","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433349+0000","last_change":"2024-05-15T14:28:02.889970+0000","last_active":"2024-05-15T14:48:52.433349+0000","last_peered":"2024-05-15T14:48:52.433349+0000","last_clean":"2024-05-15T14:48:52.433349+0000","last_became_active":"2024-05-15T14:28:02.889039+0000","last_became_peered":"2024-05-15T14:28:02.889039+0000","last_unstale":"2024-05-15T14:48:52.433349+0000","last_undegraded":"2024-05-15T14:48:52.433349+0000","last_fullsized":"2024-05-15T14:48:52.433349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.535332+0000","last_change":"2024-05-15T14:31:16.593519+0000","last_active":"2024-05-15T14:47:57.535332+0000","last_peered":"2024-05-15T14:47:57.535332+0000","last_clean":"2024-05-15T14:47:57.535332+0000","last_became_active":"2024-05-15T14:31:16.593216+0000","last_became_peered":"2024-05-15T14:31:16.593216+0000","last_unstale":"2024-05-15T14:47:57.535332+0000","last_undegraded":"2024-05-15T14:47:57.535332+0000","last_fullsized":"2024-05-15T14:47:57.535332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'24","reported_seq":127,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.074672+0000","last_change":"2024-05-15T14:49:05.074702+0000","last_active":"2024-05-15T14:49:05.074672+0000","last_peered":"2024-05-15T14:49:05.074672+0000","last_clean":"2024-05-15T14:49:05.074672+0000","last_became_active":"2024-05-15T14:27:52.854963+0000","last_became_peered":"2024-05-15T14:27:52.854963+0000","last_unstale":"2024-05-15T14:49:05.074672+0000","last_undegraded":"2024-05-15T14:49:05.074672+0000","last_fullsized":"2024-05-15T14:49:05.074672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:05.074578+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:05.074578+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.074578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:32:21.114015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.530848+0000","last_change":"2024-05-15T14:27:50.847492+0000","last_active":"2024-05-15T14:47:22.530848+0000","last_peered":"2024-05-15T14:47:22.530848+0000","last_clean":"2024-05-15T14:47:22.530848+0000","last_became_active":"2024-05-15T14:27:50.847163+0000","last_became_peered":"2024-05-15T14:27:50.847163+0000","last_unstale":"2024-05-15T14:47:22.530848+0000","last_undegraded":"2024-05-15T14:47:22.530848+0000","last_fullsized":"2024-05-15T14:47:22.530848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.263987+0000","last_change":"2024-05-15T14:49:22.264039+0000","last_active":"2024-05-15T14:49:22.263987+0000","last_peered":"2024-05-15T14:49:22.263987+0000","last_clean":"2024-05-15T14:49:22.263987+0000","last_became_active":"2024-05-15T14:27:56.879526+0000","last_became_peered":"2024-05-15T14:27:56.879526+0000","last_unstale":"2024-05-15T14:49:22.263987+0000","last_undegraded":"2024-05-15T14:49:22.263987+0000","last_fullsized":"2024-05-15T14:49:22.263987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.263889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.263889+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.263889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:36.466384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"39'416","reported_seq":710,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.057957+0000","last_change":"2024-05-15T14:49:13.058004+0000","last_active":"2024-05-15T14:49:13.057957+0000","last_peered":"2024-05-15T14:49:13.057957+0000","last_clean":"2024-05-15T14:49:13.057957+0000","last_became_active":"2024-05-15T14:27:58.882886+0000","last_became_peered":"2024-05-15T14:27:58.882886+0000","last_unstale":"2024-05-15T14:49:13.057957+0000","last_undegraded":"2024-05-15T14:49:13.057957+0000","last_fullsized":"2024-05-15T14:49:13.057957+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'416","last_scrub_stamp":"2024-05-15T14:49:13.057869+0000","last_deep_scrub":"39'416","last_deep_scrub_stamp":"2024-05-15T14:49:13.057869+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.057869+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:36.795312+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":660,"num_read_kb":650,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20716,"num_omap_keys":50,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.111476+0000","last_change":"2024-05-15T14:49:09.111501+0000","last_active":"2024-05-15T14:49:09.111476+0000","last_peered":"2024-05-15T14:49:09.111476+0000","last_clean":"2024-05-15T14:49:09.111476+0000","last_became_active":"2024-05-15T14:28:00.885434+0000","last_became_peered":"2024-05-15T14:28:00.885434+0000","last_unstale":"2024-05-15T14:49:09.111476+0000","last_undegraded":"2024-05-15T14:49:09.111476+0000","last_fullsized":"2024-05-15T14:49:09.111476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:09.111389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:09.111389+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.111389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:45:41.785247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"39'18","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.439122+0000","last_change":"2024-05-15T14:28:02.890234+0000","last_active":"2024-05-15T14:48:52.439122+0000","last_peered":"2024-05-15T14:48:52.439122+0000","last_clean":"2024-05-15T14:48:52.439122+0000","last_became_active":"2024-05-15T14:28:02.889918+0000","last_became_peered":"2024-05-15T14:28:02.889918+0000","last_unstale":"2024-05-15T14:48:52.439122+0000","last_undegraded":"2024-05-15T14:48:52.439122+0000","last_fullsized":"2024-05-15T14:48:52.439122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.540394+0000","last_change":"2024-05-15T14:31:16.594123+0000","last_active":"2024-05-15T14:48:37.540394+0000","last_peered":"2024-05-15T14:48:37.540394+0000","last_clean":"2024-05-15T14:48:37.540394+0000","last_became_active":"2024-05-15T14:31:16.593813+0000","last_became_peered":"2024-05-15T14:31:16.593813+0000","last_unstale":"2024-05-15T14:48:37.540394+0000","last_undegraded":"2024-05-15T14:48:37.540394+0000","last_fullsized":"2024-05-15T14:48:37.540394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'64","reported_seq":193,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.154976+0000","last_change":"2024-05-15T14:49:10.155001+0000","last_active":"2024-05-15T14:49:10.154976+0000","last_peered":"2024-05-15T14:49:10.154976+0000","last_clean":"2024-05-15T14:49:10.154976+0000","last_became_active":"2024-05-15T14:27:52.846508+0000","last_became_peered":"2024-05-15T14:27:52.846508+0000","last_unstale":"2024-05-15T14:49:10.154976+0000","last_undegraded":"2024-05-15T14:49:10.154976+0000","last_fullsized":"2024-05-15T14:49:10.154976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'64","last_scrub_stamp":"2024-05-15T14:49:10.154883+0000","last_deep_scrub":"39'64","last_deep_scrub_stamp":"2024-05-15T14:49:10.154883+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.154883+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:47:28.394116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":231,"num_write":88,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:47.529554+0000","last_change":"2024-05-15T14:27:43.806336+0000","last_active":"2024-05-15T14:47:47.529554+0000","last_peered":"2024-05-15T14:47:47.529554+0000","last_clean":"2024-05-15T14:47:47.529554+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:47:47.529554+0000","last_undegraded":"2024-05-15T14:47:47.529554+0000","last_fullsized":"2024-05-15T14:47:47.529554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:42.789461+0000","last_clean_scrub_stamp":"2024-05-15T14:27:42.789461+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.431542+0000","last_change":"2024-05-15T14:27:44.808919+0000","last_active":"2024-05-15T14:48:37.431542+0000","last_peered":"2024-05-15T14:48:37.431542+0000","last_clean":"2024-05-15T14:48:37.431542+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:48:37.431542+0000","last_undegraded":"2024-05-15T14:48:37.431542+0000","last_fullsized":"2024-05-15T14:48:37.431542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"39'26","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.541056+0000","last_change":"2024-05-15T14:27:50.850434+0000","last_active":"2024-05-15T14:48:42.541056+0000","last_peered":"2024-05-15T14:48:42.541056+0000","last_clean":"2024-05-15T14:48:42.541056+0000","last_became_active":"2024-05-15T14:27:50.849731+0000","last_became_peered":"2024-05-15T14:27:50.849731+0000","last_unstale":"2024-05-15T14:48:42.541056+0000","last_undegraded":"2024-05-15T14:48:42.541056+0000","last_fullsized":"2024-05-15T14:48:42.541056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":50,"num_write":130,"num_write_kb":35292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.537615+0000","last_change":"2024-05-15T14:27:56.878884+0000","last_active":"2024-05-15T14:48:47.537615+0000","last_peered":"2024-05-15T14:48:47.537615+0000","last_clean":"2024-05-15T14:48:47.537615+0000","last_became_active":"2024-05-15T14:27:56.878611+0000","last_became_peered":"2024-05-15T14:27:56.878611+0000","last_unstale":"2024-05-15T14:48:47.537615+0000","last_undegraded":"2024-05-15T14:48:47.537615+0000","last_fullsized":"2024-05-15T14:48:47.537615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"39'354","reported_seq":3198,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.975522+0000","last_change":"2024-05-15T14:49:09.975561+0000","last_active":"2024-05-15T14:49:09.975522+0000","last_peered":"2024-05-15T14:49:09.975522+0000","last_clean":"2024-05-15T14:49:09.975522+0000","last_became_active":"2024-05-15T14:27:58.884237+0000","last_became_peered":"2024-05-15T14:27:58.884237+0000","last_unstale":"2024-05-15T14:49:09.975522+0000","last_undegraded":"2024-05-15T14:49:09.975522+0000","last_fullsized":"2024-05-15T14:49:09.975522+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'354","last_scrub_stamp":"2024-05-15T14:49:09.975429+0000","last_deep_scrub":"39'354","last_deep_scrub_stamp":"2024-05-15T14:49:09.975429+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.975429+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:07.818959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":8049,"num_read_kb":5529,"num_write":261,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2876,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.100813+0000","last_change":"2024-05-15T14:49:06.100873+0000","last_active":"2024-05-15T14:49:06.100813+0000","last_peered":"2024-05-15T14:49:06.100813+0000","last_clean":"2024-05-15T14:49:06.100813+0000","last_became_active":"2024-05-15T14:28:00.886539+0000","last_became_peered":"2024-05-15T14:28:00.886539+0000","last_unstale":"2024-05-15T14:49:06.100813+0000","last_undegraded":"2024-05-15T14:49:06.100813+0000","last_fullsized":"2024-05-15T14:49:06.100813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.100716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.100716+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.100716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:03.944246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"39'21","reported_seq":62,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:53.837923+0000","last_change":"2024-05-15T14:28:02.892380+0000","last_active":"2024-05-15T14:47:53.837923+0000","last_peered":"2024-05-15T14:47:53.837923+0000","last_clean":"2024-05-15T14:47:53.837923+0000","last_became_active":"2024-05-15T14:28:02.892076+0000","last_became_peered":"2024-05-15T14:28:02.892076+0000","last_unstale":"2024-05-15T14:47:53.837923+0000","last_undegraded":"2024-05-15T14:47:53.837923+0000","last_fullsized":"2024-05-15T14:47:53.837923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.b","version":"39'3","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:00.116287+0000","last_change":"2024-05-15T14:31:16.592642+0000","last_active":"2024-05-15T14:49:00.116287+0000","last_peered":"2024-05-15T14:49:00.116287+0000","last_clean":"2024-05-15T14:49:00.116287+0000","last_became_active":"2024-05-15T14:31:16.592325+0000","last_became_peered":"2024-05-15T14:31:16.592325+0000","last_unstale":"2024-05-15T14:49:00.116287+0000","last_undegraded":"2024-05-15T14:49:00.116287+0000","last_fullsized":"2024-05-15T14:49:00.116287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'26","reported_seq":140,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.181479+0000","last_change":"2024-05-15T14:49:15.181514+0000","last_active":"2024-05-15T14:49:15.181479+0000","last_peered":"2024-05-15T14:49:15.181479+0000","last_clean":"2024-05-15T14:49:15.181479+0000","last_became_active":"2024-05-15T14:27:52.858631+0000","last_became_peered":"2024-05-15T14:27:52.858631+0000","last_unstale":"2024-05-15T14:49:15.181479+0000","last_undegraded":"2024-05-15T14:49:15.181479+0000","last_fullsized":"2024-05-15T14:49:15.181479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.181369+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.181369+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.181369+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:23.248736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:47.529524+0000","last_change":"2024-05-15T14:27:44.810189+0000","last_active":"2024-05-15T14:47:47.529524+0000","last_peered":"2024-05-15T14:47:47.529524+0000","last_clean":"2024-05-15T14:47:47.529524+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:47:47.529524+0000","last_undegraded":"2024-05-15T14:47:47.529524+0000","last_fullsized":"2024-05-15T14:47:47.529524+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'9","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437689+0000","last_change":"2024-05-15T14:27:50.833876+0000","last_active":"2024-05-15T14:48:42.437689+0000","last_peered":"2024-05-15T14:48:42.437689+0000","last_clean":"2024-05-15T14:48:42.437689+0000","last_became_active":"2024-05-15T14:27:50.833509+0000","last_became_peered":"2024-05-15T14:27:50.833509+0000","last_unstale":"2024-05-15T14:48:42.437689+0000","last_undegraded":"2024-05-15T14:48:42.437689+0000","last_fullsized":"2024-05-15T14:48:42.437689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":37,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.092768+0000","last_change":"2024-05-15T14:49:20.092794+0000","last_active":"2024-05-15T14:49:20.092768+0000","last_peered":"2024-05-15T14:49:20.092768+0000","last_clean":"2024-05-15T14:49:20.092768+0000","last_became_active":"2024-05-15T14:27:56.876526+0000","last_became_peered":"2024-05-15T14:27:56.876526+0000","last_unstale":"2024-05-15T14:49:20.092768+0000","last_undegraded":"2024-05-15T14:49:20.092768+0000","last_fullsized":"2024-05-15T14:49:20.092768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:20.092624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:20.092624+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.092624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:36.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"39'1105","reported_seq":2239,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.104318+0000","last_change":"2024-05-15T14:49:10.104373+0000","last_active":"2024-05-15T14:49:10.104318+0000","last_peered":"2024-05-15T14:49:10.104318+0000","last_clean":"2024-05-15T14:49:10.104318+0000","last_became_active":"2024-05-15T14:27:58.887083+0000","last_became_peered":"2024-05-15T14:27:58.887083+0000","last_unstale":"2024-05-15T14:49:10.104318+0000","last_undegraded":"2024-05-15T14:49:10.104318+0000","last_fullsized":"2024-05-15T14:49:10.104318+0000","mapping_epoch":26,"log_start":"39'1000","ondisk_log_start":"39'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1105","last_scrub_stamp":"2024-05-15T14:49:10.104218+0000","last_deep_scrub":"39'1105","last_deep_scrub_stamp":"2024-05-15T14:49:10.104218+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.104218+0000","objects_scrubbed":11,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:30.050249+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1728,"num_read_kb":1712,"num_write":408,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.957705+0000","last_change":"2024-05-15T14:49:04.957756+0000","last_active":"2024-05-15T14:49:04.957705+0000","last_peered":"2024-05-15T14:49:04.957705+0000","last_clean":"2024-05-15T14:49:04.957705+0000","last_became_active":"2024-05-15T14:28:00.890321+0000","last_became_peered":"2024-05-15T14:28:00.890321+0000","last_unstale":"2024-05-15T14:49:04.957705+0000","last_undegraded":"2024-05-15T14:49:04.957705+0000","last_fullsized":"2024-05-15T14:49:04.957705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.957607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.957607+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.957607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:35.222322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"39'20","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.124776+0000","last_change":"2024-05-15T14:49:01.124836+0000","last_active":"2024-05-15T14:49:01.124776+0000","last_peered":"2024-05-15T14:49:01.124776+0000","last_clean":"2024-05-15T14:49:01.124776+0000","last_became_active":"2024-05-15T14:28:02.883249+0000","last_became_peered":"2024-05-15T14:28:02.883249+0000","last_unstale":"2024-05-15T14:49:01.124776+0000","last_undegraded":"2024-05-15T14:49:01.124776+0000","last_fullsized":"2024-05-15T14:49:01.124776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:01.124687+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:01.124687+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.124687+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:37.809153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432061+0000","last_change":"2024-05-15T14:31:16.593784+0000","last_active":"2024-05-15T14:48:42.432061+0000","last_peered":"2024-05-15T14:48:42.432061+0000","last_clean":"2024-05-15T14:48:42.432061+0000","last_became_active":"2024-05-15T14:31:16.593500+0000","last_became_peered":"2024-05-15T14:31:16.593500+0000","last_unstale":"2024-05-15T14:48:42.432061+0000","last_undegraded":"2024-05-15T14:48:42.432061+0000","last_fullsized":"2024-05-15T14:48:42.432061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"39'14","reported_seq":98,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.041315+0000","last_change":"2024-05-15T14:49:13.041346+0000","last_active":"2024-05-15T14:49:13.041315+0000","last_peered":"2024-05-15T14:49:13.041315+0000","last_clean":"2024-05-15T14:49:13.041315+0000","last_became_active":"2024-05-15T14:27:52.844149+0000","last_became_peered":"2024-05-15T14:27:52.844149+0000","last_unstale":"2024-05-15T14:49:13.041315+0000","last_undegraded":"2024-05-15T14:49:13.041315+0000","last_fullsized":"2024-05-15T14:49:13.041315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:13.041221+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:13.041221+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.041221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:39.891498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.377083+0000","last_change":"2024-05-15T14:49:06.377115+0000","last_active":"2024-05-15T14:49:06.377083+0000","last_peered":"2024-05-15T14:49:06.377083+0000","last_clean":"2024-05-15T14:49:06.377083+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:49:06.377083+0000","last_undegraded":"2024-05-15T14:49:06.377083+0000","last_fullsized":"2024-05-15T14:49:06.377083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.376986+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.376986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:08.760321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'16","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.431588+0000","last_change":"2024-05-15T14:27:50.845090+0000","last_active":"2024-05-15T14:47:57.431588+0000","last_peered":"2024-05-15T14:47:57.431588+0000","last_clean":"2024-05-15T14:47:57.431588+0000","last_became_active":"2024-05-15T14:27:50.844771+0000","last_became_peered":"2024-05-15T14:27:50.844771+0000","last_unstale":"2024-05-15T14:47:57.431588+0000","last_undegraded":"2024-05-15T14:47:57.431588+0000","last_fullsized":"2024-05-15T14:47:57.431588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"39'15","reported_seq":734,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.399091+0000","last_change":"2024-05-15T14:49:03.399123+0000","last_active":"2024-05-15T14:49:03.399091+0000","last_peered":"2024-05-15T14:49:03.399091+0000","last_clean":"2024-05-15T14:49:03.399091+0000","last_became_active":"2024-05-15T14:27:56.880109+0000","last_became_peered":"2024-05-15T14:27:56.880109+0000","last_unstale":"2024-05-15T14:49:03.399091+0000","last_undegraded":"2024-05-15T14:49:03.399091+0000","last_fullsized":"2024-05-15T14:49:03.399091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2024-05-15T14:49:03.399009+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2024-05-15T14:49:03.399009+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.399009+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:30:51.827026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":702,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"39'279","reported_seq":780,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.913793+0000","last_change":"2024-05-15T14:49:08.913863+0000","last_active":"2024-05-15T14:49:08.913793+0000","last_peered":"2024-05-15T14:49:08.913793+0000","last_clean":"2024-05-15T14:49:08.913793+0000","last_became_active":"2024-05-15T14:27:58.888477+0000","last_became_peered":"2024-05-15T14:27:58.888477+0000","last_unstale":"2024-05-15T14:49:08.913793+0000","last_undegraded":"2024-05-15T14:49:08.913793+0000","last_fullsized":"2024-05-15T14:49:08.913793+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'279","last_scrub_stamp":"2024-05-15T14:49:08.913654+0000","last_deep_scrub":"39'279","last_deep_scrub_stamp":"2024-05-15T14:49:08.913654+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.913654+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:35.763932+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":392,"num_write":265,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.161705+0000","last_change":"2024-05-15T14:49:11.161731+0000","last_active":"2024-05-15T14:49:11.161705+0000","last_peered":"2024-05-15T14:49:11.161705+0000","last_clean":"2024-05-15T14:49:11.161705+0000","last_became_active":"2024-05-15T14:28:00.880488+0000","last_became_peered":"2024-05-15T14:28:00.880488+0000","last_unstale":"2024-05-15T14:49:11.161705+0000","last_undegraded":"2024-05-15T14:49:11.161705+0000","last_fullsized":"2024-05-15T14:49:11.161705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:11.161591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:11.161591+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.161591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:31.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'21","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.651522+0000","last_change":"2024-05-15T14:49:12.651546+0000","last_active":"2024-05-15T14:49:12.651522+0000","last_peered":"2024-05-15T14:49:12.651522+0000","last_clean":"2024-05-15T14:49:12.651522+0000","last_became_active":"2024-05-15T14:28:02.893812+0000","last_became_peered":"2024-05-15T14:28:02.893812+0000","last_unstale":"2024-05-15T14:49:12.651522+0000","last_undegraded":"2024-05-15T14:49:12.651522+0000","last_fullsized":"2024-05-15T14:49:12.651522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'21","last_scrub_stamp":"2024-05-15T14:49:12.651430+0000","last_deep_scrub":"39'21","last_deep_scrub_stamp":"2024-05-15T14:49:12.651430+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.651430+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:16.036367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":112,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.437052+0000","last_change":"2024-05-15T14:31:16.589892+0000","last_active":"2024-05-15T14:48:37.437052+0000","last_peered":"2024-05-15T14:48:37.437052+0000","last_clean":"2024-05-15T14:48:37.437052+0000","last_became_active":"2024-05-15T14:31:16.589610+0000","last_became_peered":"2024-05-15T14:31:16.589610+0000","last_unstale":"2024-05-15T14:48:37.437052+0000","last_undegraded":"2024-05-15T14:48:37.437052+0000","last_fullsized":"2024-05-15T14:48:37.437052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"39'4","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.055419+0000","last_change":"2024-05-15T14:49:17.055450+0000","last_active":"2024-05-15T14:49:17.055419+0000","last_peered":"2024-05-15T14:49:17.055419+0000","last_clean":"2024-05-15T14:49:17.055419+0000","last_became_active":"2024-05-15T14:27:52.839722+0000","last_became_peered":"2024-05-15T14:27:52.839722+0000","last_unstale":"2024-05-15T14:49:17.055419+0000","last_undegraded":"2024-05-15T14:49:17.055419+0000","last_fullsized":"2024-05-15T14:49:17.055419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:17.055311+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:17.055311+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.055311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:14.898841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.431519+0000","last_change":"2024-05-15T14:27:44.810023+0000","last_active":"2024-05-15T14:48:37.431519+0000","last_peered":"2024-05-15T14:48:37.431519+0000","last_clean":"2024-05-15T14:48:37.431519+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:48:37.431519+0000","last_undegraded":"2024-05-15T14:48:37.431519+0000","last_fullsized":"2024-05-15T14:48:37.431519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'16","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432113+0000","last_change":"2024-05-15T14:27:50.837385+0000","last_active":"2024-05-15T14:48:42.432113+0000","last_peered":"2024-05-15T14:48:42.432113+0000","last_clean":"2024-05-15T14:48:42.432113+0000","last_became_active":"2024-05-15T14:27:50.836731+0000","last_became_peered":"2024-05-15T14:27:50.836731+0000","last_unstale":"2024-05-15T14:48:42.432113+0000","last_undegraded":"2024-05-15T14:48:42.432113+0000","last_fullsized":"2024-05-15T14:48:42.432113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.169731+0000","last_change":"2024-05-15T14:49:21.169756+0000","last_active":"2024-05-15T14:49:21.169731+0000","last_peered":"2024-05-15T14:49:21.169731+0000","last_clean":"2024-05-15T14:49:21.169731+0000","last_became_active":"2024-05-15T14:27:56.880118+0000","last_became_peered":"2024-05-15T14:27:56.880118+0000","last_unstale":"2024-05-15T14:49:21.169731+0000","last_undegraded":"2024-05-15T14:49:21.169731+0000","last_fullsized":"2024-05-15T14:49:21.169731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.169636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.169636+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.169636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:24.554573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"39'336","reported_seq":83290,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.635215+0000","last_change":"2024-05-15T14:49:13.635265+0000","last_active":"2024-05-15T14:49:13.635215+0000","last_peered":"2024-05-15T14:49:13.635215+0000","last_clean":"2024-05-15T14:49:13.635215+0000","last_became_active":"2024-05-15T14:27:58.882039+0000","last_became_peered":"2024-05-15T14:27:58.882039+0000","last_unstale":"2024-05-15T14:49:13.635215+0000","last_undegraded":"2024-05-15T14:49:13.635215+0000","last_fullsized":"2024-05-15T14:49:13.635215+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'336","last_scrub_stamp":"2024-05-15T14:49:13.635123+0000","last_deep_scrub":"39'336","last_deep_scrub_stamp":"2024-05-15T14:49:13.635123+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.635123+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:46.736637+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207654,"num_read_kb":557003,"num_write":353,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.107730+0000","last_change":"2024-05-15T14:49:21.107779+0000","last_active":"2024-05-15T14:49:21.107730+0000","last_peered":"2024-05-15T14:49:21.107730+0000","last_clean":"2024-05-15T14:49:21.107730+0000","last_became_active":"2024-05-15T14:28:00.887095+0000","last_became_peered":"2024-05-15T14:28:00.887095+0000","last_unstale":"2024-05-15T14:49:21.107730+0000","last_undegraded":"2024-05-15T14:49:21.107730+0000","last_fullsized":"2024-05-15T14:49:21.107730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.107618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.107618+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.107618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:39.068756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"39'15","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.884260+0000","last_change":"2024-05-15T14:49:03.884290+0000","last_active":"2024-05-15T14:49:03.884260+0000","last_peered":"2024-05-15T14:49:03.884260+0000","last_clean":"2024-05-15T14:49:03.884260+0000","last_became_active":"2024-05-15T14:28:02.892255+0000","last_became_peered":"2024-05-15T14:28:02.892255+0000","last_unstale":"2024-05-15T14:49:03.884260+0000","last_undegraded":"2024-05-15T14:49:03.884260+0000","last_fullsized":"2024-05-15T14:49:03.884260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2024-05-15T14:49:03.884167+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2024-05-15T14:49:03.884167+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.884167+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:57:22.423172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.446109+0000","last_change":"2024-05-15T14:31:16.593868+0000","last_active":"2024-05-15T14:49:02.446109+0000","last_peered":"2024-05-15T14:49:02.446109+0000","last_clean":"2024-05-15T14:49:02.446109+0000","last_became_active":"2024-05-15T14:31:16.593582+0000","last_became_peered":"2024-05-15T14:31:16.593582+0000","last_unstale":"2024-05-15T14:49:02.446109+0000","last_undegraded":"2024-05-15T14:49:02.446109+0000","last_fullsized":"2024-05-15T14:49:02.446109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'44","reported_seq":122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.067907+0000","last_change":"2024-05-15T14:49:07.067938+0000","last_active":"2024-05-15T14:49:07.067907+0000","last_peered":"2024-05-15T14:49:07.067907+0000","last_clean":"2024-05-15T14:49:07.067907+0000","last_became_active":"2024-05-15T14:27:52.851166+0000","last_became_peered":"2024-05-15T14:27:52.851166+0000","last_unstale":"2024-05-15T14:49:07.067907+0000","last_undegraded":"2024-05-15T14:49:07.067907+0000","last_fullsized":"2024-05-15T14:49:07.067907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'44","last_scrub_stamp":"2024-05-15T14:49:07.067797+0000","last_deep_scrub":"39'44","last_deep_scrub_stamp":"2024-05-15T14:49:07.067797+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.067797+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:04.265322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":125,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"39'8","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.432881+0000","last_change":"2024-05-15T14:49:18.432913+0000","last_active":"2024-05-15T14:49:18.432881+0000","last_peered":"2024-05-15T14:49:18.432881+0000","last_clean":"2024-05-15T14:49:18.432881+0000","last_became_active":"2024-05-15T14:28:37.941149+0000","last_became_peered":"2024-05-15T14:28:37.941149+0000","last_unstale":"2024-05-15T14:49:18.432881+0000","last_undegraded":"2024-05-15T14:49:18.432881+0000","last_fullsized":"2024-05-15T14:49:18.432881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:18.432781+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:18.432781+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.432781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:47:36.672014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11,"num_write":32,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.039657+0000","last_change":"2024-05-15T14:49:19.039683+0000","last_active":"2024-05-15T14:49:19.039657+0000","last_peered":"2024-05-15T14:49:19.039657+0000","last_clean":"2024-05-15T14:49:19.039657+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:49:19.039657+0000","last_undegraded":"2024-05-15T14:49:19.039657+0000","last_fullsized":"2024-05-15T14:49:19.039657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:19.039556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:19.039556+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.039556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:39.599575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438334+0000","last_change":"2024-05-15T14:27:56.881338+0000","last_active":"2024-05-15T14:48:47.438334+0000","last_peered":"2024-05-15T14:48:47.438334+0000","last_clean":"2024-05-15T14:48:47.438334+0000","last_became_active":"2024-05-15T14:27:56.881083+0000","last_became_peered":"2024-05-15T14:27:56.881083+0000","last_unstale":"2024-05-15T14:48:47.438334+0000","last_undegraded":"2024-05-15T14:48:47.438334+0000","last_fullsized":"2024-05-15T14:48:47.438334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"39'483","reported_seq":941,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.048020+0000","last_change":"2024-05-15T14:27:58.884245+0000","last_active":"2024-05-15T14:48:57.048020+0000","last_peered":"2024-05-15T14:48:57.048020+0000","last_clean":"2024-05-15T14:48:57.048020+0000","last_became_active":"2024-05-15T14:27:58.883886+0000","last_became_peered":"2024-05-15T14:27:58.883886+0000","last_unstale":"2024-05-15T14:48:57.048020+0000","last_undegraded":"2024-05-15T14:48:57.048020+0000","last_fullsized":"2024-05-15T14:48:57.048020+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1031,"num_read_kb":1287,"num_write":497,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.420978+0000","last_change":"2024-05-15T14:49:02.421002+0000","last_active":"2024-05-15T14:49:02.420978+0000","last_peered":"2024-05-15T14:49:02.420978+0000","last_clean":"2024-05-15T14:49:02.420978+0000","last_became_active":"2024-05-15T14:28:00.884315+0000","last_became_peered":"2024-05-15T14:28:00.884315+0000","last_unstale":"2024-05-15T14:49:02.420978+0000","last_undegraded":"2024-05-15T14:49:02.420978+0000","last_fullsized":"2024-05-15T14:49:02.420978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:02.420884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:02.420884+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.420884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:35:34.607185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"39'38","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.066817+0000","last_change":"2024-05-15T14:49:02.066854+0000","last_active":"2024-05-15T14:49:02.066817+0000","last_peered":"2024-05-15T14:49:02.066817+0000","last_clean":"2024-05-15T14:49:02.066817+0000","last_became_active":"2024-05-15T14:28:02.889093+0000","last_became_peered":"2024-05-15T14:28:02.889093+0000","last_unstale":"2024-05-15T14:49:02.066817+0000","last_undegraded":"2024-05-15T14:49:02.066817+0000","last_fullsized":"2024-05-15T14:49:02.066817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'38","last_scrub_stamp":"2024-05-15T14:49:02.066732+0000","last_deep_scrub":"39'38","last_deep_scrub_stamp":"2024-05-15T14:49:02.066732+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.066732+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:17:37.278158+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":151,"num_write":63,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.538154+0000","last_change":"2024-05-15T14:49:21.538178+0000","last_active":"2024-05-15T14:49:21.538154+0000","last_peered":"2024-05-15T14:49:21.538154+0000","last_clean":"2024-05-15T14:49:21.538154+0000","last_became_active":"2024-05-15T14:31:38.626777+0000","last_became_peered":"2024-05-15T14:31:38.626777+0000","last_unstale":"2024-05-15T14:49:21.538154+0000","last_undegraded":"2024-05-15T14:49:21.538154+0000","last_fullsized":"2024-05-15T14:49:21.538154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.538058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.538058+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.538058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:32:37.577496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'50","reported_seq":142,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437733+0000","last_change":"2024-05-15T14:27:52.846446+0000","last_active":"2024-05-15T14:48:42.437733+0000","last_peered":"2024-05-15T14:48:42.437733+0000","last_clean":"2024-05-15T14:48:42.437733+0000","last_became_active":"2024-05-15T14:27:52.846171+0000","last_became_peered":"2024-05-15T14:27:52.846171+0000","last_unstale":"2024-05-15T14:48:42.437733+0000","last_undegraded":"2024-05-15T14:48:42.437733+0000","last_fullsized":"2024-05-15T14:48:42.437733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":163,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.994668+0000","last_change":"2024-05-15T14:49:21.994695+0000","last_active":"2024-05-15T14:49:21.994668+0000","last_peered":"2024-05-15T14:49:21.994668+0000","last_clean":"2024-05-15T14:49:21.994668+0000","last_became_active":"2024-05-15T14:27:50.844741+0000","last_became_peered":"2024-05-15T14:27:50.844741+0000","last_unstale":"2024-05-15T14:49:21.994668+0000","last_undegraded":"2024-05-15T14:49:21.994668+0000","last_fullsized":"2024-05-15T14:49:21.994668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:21.994566+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:21.994566+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.994566+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:42.240091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":80,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.536347+0000","last_change":"2024-05-15T14:27:45.305329+0000","last_active":"2024-05-15T14:48:37.536347+0000","last_peered":"2024-05-15T14:48:37.536347+0000","last_clean":"2024-05-15T14:48:37.536347+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:48:37.536347+0000","last_undegraded":"2024-05-15T14:48:37.536347+0000","last_fullsized":"2024-05-15T14:48:37.536347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:43.793466+0000","last_clean_scrub_stamp":"2024-05-15T14:27:43.793466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.142539+0000","last_change":"2024-05-15T14:49:05.142566+0000","last_active":"2024-05-15T14:49:05.142539+0000","last_peered":"2024-05-15T14:49:05.142539+0000","last_clean":"2024-05-15T14:49:05.142539+0000","last_became_active":"2024-05-15T14:27:56.880842+0000","last_became_peered":"2024-05-15T14:27:56.880842+0000","last_unstale":"2024-05-15T14:49:05.142539+0000","last_undegraded":"2024-05-15T14:49:05.142539+0000","last_fullsized":"2024-05-15T14:49:05.142539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:05.142451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:05.142451+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.142451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:52.024230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"39'499","reported_seq":504335,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.043159+0000","last_change":"2024-05-15T14:49:08.043210+0000","last_active":"2024-05-15T14:49:08.043159+0000","last_peered":"2024-05-15T14:49:08.043159+0000","last_clean":"2024-05-15T14:49:08.043159+0000","last_became_active":"2024-05-15T14:27:58.882284+0000","last_became_peered":"2024-05-15T14:27:58.882284+0000","last_unstale":"2024-05-15T14:49:08.043159+0000","last_undegraded":"2024-05-15T14:49:08.043159+0000","last_fullsized":"2024-05-15T14:49:08.043159+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'499","last_scrub_stamp":"2024-05-15T14:49:08.043071+0000","last_deep_scrub":"39'499","last_deep_scrub_stamp":"2024-05-15T14:49:08.043071+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.043071+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:35:40.229372+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1259744,"num_read_kb":3777635,"num_write":703,"num_write_kb":2009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"39'927","reported_seq":1381,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.919023+0000","last_change":"2024-05-15T14:49:06.919050+0000","last_active":"2024-05-15T14:49:06.919023+0000","last_peered":"2024-05-15T14:49:06.919023+0000","last_clean":"2024-05-15T14:49:06.919023+0000","last_became_active":"2024-05-15T14:28:00.891484+0000","last_became_peered":"2024-05-15T14:28:00.891484+0000","last_unstale":"2024-05-15T14:49:06.919023+0000","last_undegraded":"2024-05-15T14:49:06.919023+0000","last_fullsized":"2024-05-15T14:49:06.919023+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:06.918936+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:06.918936+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.918936+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:24.880073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"39'19","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.637621+0000","last_change":"2024-05-15T14:49:04.637650+0000","last_active":"2024-05-15T14:49:04.637621+0000","last_peered":"2024-05-15T14:49:04.637621+0000","last_clean":"2024-05-15T14:49:04.637621+0000","last_became_active":"2024-05-15T14:28:02.891380+0000","last_became_peered":"2024-05-15T14:28:02.891380+0000","last_unstale":"2024-05-15T14:49:04.637621+0000","last_undegraded":"2024-05-15T14:49:04.637621+0000","last_fullsized":"2024-05-15T14:49:04.637621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'19","last_scrub_stamp":"2024-05-15T14:49:04.637527+0000","last_deep_scrub":"39'19","last_deep_scrub_stamp":"2024-05-15T14:49:04.637527+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.637527+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:27.567433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":35,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.375203+0000","last_change":"2024-05-15T14:31:16.594082+0000","last_active":"2024-05-15T14:49:03.375203+0000","last_peered":"2024-05-15T14:49:03.375203+0000","last_clean":"2024-05-15T14:49:03.375203+0000","last_became_active":"2024-05-15T14:31:16.593811+0000","last_became_peered":"2024-05-15T14:31:16.593811+0000","last_unstale":"2024-05-15T14:49:03.375203+0000","last_undegraded":"2024-05-15T14:49:03.375203+0000","last_fullsized":"2024-05-15T14:49:03.375203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"39'18","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.480417+0000","last_change":"2024-05-15T14:49:19.480444+0000","last_active":"2024-05-15T14:49:19.480417+0000","last_peered":"2024-05-15T14:49:19.480417+0000","last_clean":"2024-05-15T14:49:19.480417+0000","last_became_active":"2024-05-15T14:28:37.942459+0000","last_became_peered":"2024-05-15T14:28:37.942459+0000","last_unstale":"2024-05-15T14:49:19.480417+0000","last_undegraded":"2024-05-15T14:49:19.480417+0000","last_fullsized":"2024-05-15T14:49:19.480417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:19.480325+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:19.480325+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.480325+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:55:42.780117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"39'10","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.530974+0000","last_change":"2024-05-15T14:27:50.854562+0000","last_active":"2024-05-15T14:47:22.530974+0000","last_peered":"2024-05-15T14:47:22.530974+0000","last_clean":"2024-05-15T14:47:22.530974+0000","last_became_active":"2024-05-15T14:27:50.854248+0000","last_became_peered":"2024-05-15T14:27:50.854248+0000","last_unstale":"2024-05-15T14:47:22.530974+0000","last_undegraded":"2024-05-15T14:47:22.530974+0000","last_fullsized":"2024-05-15T14:47:22.530974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":50,"num_write_kb":8823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.070481+0000","last_change":"2024-05-15T14:49:18.070481+0000","last_active":"2024-05-15T14:49:18.070481+0000","last_peered":"2024-05-15T14:49:18.070481+0000","last_clean":"2024-05-15T14:49:18.070481+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:49:18.070481+0000","last_undegraded":"2024-05-15T14:49:18.070481+0000","last_fullsized":"2024-05-15T14:49:18.070481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:18.070336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:18.070336+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.070336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:11.212528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'2","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.264379+0000","last_change":"2024-05-15T14:49:16.264411+0000","last_active":"2024-05-15T14:49:16.264379+0000","last_peered":"2024-05-15T14:49:16.264379+0000","last_clean":"2024-05-15T14:49:16.264379+0000","last_became_active":"2024-05-15T14:27:56.875993+0000","last_became_peered":"2024-05-15T14:27:56.875993+0000","last_unstale":"2024-05-15T14:49:16.264379+0000","last_undegraded":"2024-05-15T14:49:16.264379+0000","last_fullsized":"2024-05-15T14:49:16.264379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:16.264296+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:16.264296+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.264296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:36.509821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"39'231","reported_seq":398,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.406389+0000","last_change":"2024-05-15T14:49:04.406424+0000","last_active":"2024-05-15T14:49:04.406389+0000","last_peered":"2024-05-15T14:49:04.406389+0000","last_clean":"2024-05-15T14:49:04.406389+0000","last_became_active":"2024-05-15T14:27:58.885090+0000","last_became_peered":"2024-05-15T14:27:58.885090+0000","last_unstale":"2024-05-15T14:49:04.406389+0000","last_undegraded":"2024-05-15T14:49:04.406389+0000","last_fullsized":"2024-05-15T14:49:04.406389+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'231","last_scrub_stamp":"2024-05-15T14:49:04.406300+0000","last_deep_scrub":"39'231","last_deep_scrub_stamp":"2024-05-15T14:49:04.406300+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.406300+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:24.352331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"39'927","reported_seq":1454,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.655551+0000","last_change":"2024-05-15T14:49:05.655578+0000","last_active":"2024-05-15T14:49:05.655551+0000","last_peered":"2024-05-15T14:49:05.655551+0000","last_clean":"2024-05-15T14:49:05.655551+0000","last_became_active":"2024-05-15T14:28:00.884286+0000","last_became_peered":"2024-05-15T14:28:00.884286+0000","last_unstale":"2024-05-15T14:49:05.655551+0000","last_undegraded":"2024-05-15T14:49:05.655551+0000","last_fullsized":"2024-05-15T14:49:05.655551+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:05.655463+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:05.655463+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.655463+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:39.495556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"39'25","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.065980+0000","last_change":"2024-05-15T14:49:05.066012+0000","last_active":"2024-05-15T14:49:05.065980+0000","last_peered":"2024-05-15T14:49:05.065980+0000","last_clean":"2024-05-15T14:49:05.065980+0000","last_became_active":"2024-05-15T14:28:02.891822+0000","last_became_peered":"2024-05-15T14:28:02.891822+0000","last_unstale":"2024-05-15T14:49:05.065980+0000","last_undegraded":"2024-05-15T14:49:05.065980+0000","last_fullsized":"2024-05-15T14:49:05.065980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:05.065867+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:05.065867+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.065867+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:26.544217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.509853+0000","last_change":"2024-05-15T14:31:16.596256+0000","last_active":"2024-05-15T14:49:01.509853+0000","last_peered":"2024-05-15T14:49:01.509853+0000","last_clean":"2024-05-15T14:49:01.509853+0000","last_became_active":"2024-05-15T14:31:16.595913+0000","last_became_peered":"2024-05-15T14:31:16.595913+0000","last_unstale":"2024-05-15T14:49:01.509853+0000","last_undegraded":"2024-05-15T14:49:01.509853+0000","last_fullsized":"2024-05-15T14:49:01.509853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"39'16","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.233902+0000","last_change":"2024-05-15T14:49:21.233931+0000","last_active":"2024-05-15T14:49:21.233902+0000","last_peered":"2024-05-15T14:49:21.233902+0000","last_clean":"2024-05-15T14:49:21.233902+0000","last_became_active":"2024-05-15T14:27:52.848087+0000","last_became_peered":"2024-05-15T14:27:52.848087+0000","last_unstale":"2024-05-15T14:49:21.233902+0000","last_undegraded":"2024-05-15T14:49:21.233902+0000","last_fullsized":"2024-05-15T14:49:21.233902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:21.233814+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:21.233814+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.233814+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:29.301182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427553+0000","last_change":"2024-05-15T14:27:50.840684+0000","last_active":"2024-05-15T14:47:22.427553+0000","last_peered":"2024-05-15T14:47:22.427553+0000","last_clean":"2024-05-15T14:47:22.427553+0000","last_became_active":"2024-05-15T14:27:50.840365+0000","last_became_peered":"2024-05-15T14:27:50.840365+0000","last_unstale":"2024-05-15T14:47:22.427553+0000","last_undegraded":"2024-05-15T14:47:22.427553+0000","last_fullsized":"2024-05-15T14:47:22.427553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.107205+0000","last_change":"2024-05-15T14:49:13.107230+0000","last_active":"2024-05-15T14:49:13.107205+0000","last_peered":"2024-05-15T14:49:13.107205+0000","last_clean":"2024-05-15T14:49:13.107205+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:49:13.107205+0000","last_undegraded":"2024-05-15T14:49:13.107205+0000","last_fullsized":"2024-05-15T14:49:13.107205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:13.107116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:13.107116+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.107116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:12:26.464097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"39'12","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.535282+0000","last_change":"2024-05-15T14:27:56.875443+0000","last_active":"2024-05-15T14:47:57.535282+0000","last_peered":"2024-05-15T14:47:57.535282+0000","last_clean":"2024-05-15T14:47:57.535282+0000","last_became_active":"2024-05-15T14:27:56.875166+0000","last_became_peered":"2024-05-15T14:27:56.875166+0000","last_unstale":"2024-05-15T14:47:57.535282+0000","last_undegraded":"2024-05-15T14:47:57.535282+0000","last_fullsized":"2024-05-15T14:47:57.535282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'548","reported_seq":973,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.004921+0000","last_change":"2024-05-15T14:27:58.881816+0000","last_active":"2024-05-15T14:48:57.004921+0000","last_peered":"2024-05-15T14:48:57.004921+0000","last_clean":"2024-05-15T14:48:57.004921+0000","last_became_active":"2024-05-15T14:27:58.881529+0000","last_became_peered":"2024-05-15T14:27:58.881529+0000","last_unstale":"2024-05-15T14:48:57.004921+0000","last_undegraded":"2024-05-15T14:48:57.004921+0000","last_fullsized":"2024-05-15T14:48:57.004921+0000","mapping_epoch":26,"log_start":"39'500","ondisk_log_start":"39'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":967,"num_read_kb":997,"num_write":702,"num_write_kb":2669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.611305+0000","last_change":"2024-05-15T14:49:03.611323+0000","last_active":"2024-05-15T14:49:03.611305+0000","last_peered":"2024-05-15T14:49:03.611305+0000","last_clean":"2024-05-15T14:49:03.611305+0000","last_became_active":"2024-05-15T14:28:00.890685+0000","last_became_peered":"2024-05-15T14:28:00.890685+0000","last_unstale":"2024-05-15T14:49:03.611305+0000","last_undegraded":"2024-05-15T14:49:03.611305+0000","last_fullsized":"2024-05-15T14:49:03.611305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:03.611229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:03.611229+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.611229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:17.594221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"39'29","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.911194+0000","last_change":"2024-05-15T14:49:07.911254+0000","last_active":"2024-05-15T14:49:07.911194+0000","last_peered":"2024-05-15T14:49:07.911194+0000","last_clean":"2024-05-15T14:49:07.911194+0000","last_became_active":"2024-05-15T14:28:02.893174+0000","last_became_peered":"2024-05-15T14:28:02.893174+0000","last_unstale":"2024-05-15T14:49:07.911194+0000","last_undegraded":"2024-05-15T14:49:07.911194+0000","last_fullsized":"2024-05-15T14:49:07.911194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'29","last_scrub_stamp":"2024-05-15T14:49:07.911100+0000","last_deep_scrub":"39'29","last_deep_scrub_stamp":"2024-05-15T14:49:07.911100+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.911100+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:49.443849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:00.116294+0000","last_change":"2024-05-15T14:31:16.593175+0000","last_active":"2024-05-15T14:49:00.116294+0000","last_peered":"2024-05-15T14:49:00.116294+0000","last_clean":"2024-05-15T14:49:00.116294+0000","last_became_active":"2024-05-15T14:31:16.592898+0000","last_became_peered":"2024-05-15T14:31:16.592898+0000","last_unstale":"2024-05-15T14:49:00.116294+0000","last_undegraded":"2024-05-15T14:49:00.116294+0000","last_fullsized":"2024-05-15T14:49:00.116294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'27","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.138164+0000","last_change":"2024-05-15T14:49:09.138193+0000","last_active":"2024-05-15T14:49:09.138164+0000","last_peered":"2024-05-15T14:49:09.138164+0000","last_clean":"2024-05-15T14:49:09.138164+0000","last_became_active":"2024-05-15T14:28:02.892547+0000","last_became_peered":"2024-05-15T14:28:02.892547+0000","last_unstale":"2024-05-15T14:49:09.138164+0000","last_undegraded":"2024-05-15T14:49:09.138164+0000","last_fullsized":"2024-05-15T14:49:09.138164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'27","last_scrub_stamp":"2024-05-15T14:49:09.138074+0000","last_deep_scrub":"39'27","last_deep_scrub_stamp":"2024-05-15T14:49:09.138074+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.138074+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:32.875517+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":37,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"39'44","reported_seq":130,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433398+0000","last_change":"2024-05-15T14:27:52.842978+0000","last_active":"2024-05-15T14:48:52.433398+0000","last_peered":"2024-05-15T14:48:52.433398+0000","last_clean":"2024-05-15T14:48:52.433398+0000","last_became_active":"2024-05-15T14:27:52.842733+0000","last_became_peered":"2024-05-15T14:27:52.842733+0000","last_unstale":"2024-05-15T14:48:52.433398+0000","last_undegraded":"2024-05-15T14:48:52.433398+0000","last_fullsized":"2024-05-15T14:48:52.433398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":143,"num_write":62,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"39'22","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.383223+0000","last_change":"2024-05-15T14:49:17.383276+0000","last_active":"2024-05-15T14:49:17.383223+0000","last_peered":"2024-05-15T14:49:17.383223+0000","last_clean":"2024-05-15T14:49:17.383223+0000","last_became_active":"2024-05-15T14:28:37.940961+0000","last_became_peered":"2024-05-15T14:28:37.940961+0000","last_unstale":"2024-05-15T14:49:17.383223+0000","last_undegraded":"2024-05-15T14:49:17.383223+0000","last_fullsized":"2024-05-15T14:49:17.383223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:17.383122+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:17.383122+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.383122+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:45:50.056980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":33493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"39'3","reported_seq":1018,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.065682+0000","last_change":"2024-05-15T14:49:03.065708+0000","last_active":"2024-05-15T14:49:03.065682+0000","last_peered":"2024-05-15T14:49:03.065682+0000","last_clean":"2024-05-15T14:49:03.065682+0000","last_became_active":"2024-05-15T14:27:56.879047+0000","last_became_peered":"2024-05-15T14:27:56.879047+0000","last_unstale":"2024-05-15T14:49:03.065682+0000","last_undegraded":"2024-05-15T14:49:03.065682+0000","last_fullsized":"2024-05-15T14:49:03.065682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-05-15T14:49:03.065616+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-05-15T14:49:03.065616+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.065616+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:21:36.534785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":959,"num_read_kb":959,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"39'708","reported_seq":1172,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.657931+0000","last_change":"2024-05-15T14:49:14.657970+0000","last_active":"2024-05-15T14:49:14.657931+0000","last_peered":"2024-05-15T14:49:14.657931+0000","last_clean":"2024-05-15T14:49:14.657931+0000","last_became_active":"2024-05-15T14:27:58.881703+0000","last_became_peered":"2024-05-15T14:27:58.881703+0000","last_unstale":"2024-05-15T14:49:14.657931+0000","last_undegraded":"2024-05-15T14:49:14.657931+0000","last_fullsized":"2024-05-15T14:49:14.657931+0000","mapping_epoch":26,"log_start":"39'600","ondisk_log_start":"39'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'708","last_scrub_stamp":"2024-05-15T14:49:14.657842+0000","last_deep_scrub":"39'708","last_deep_scrub_stamp":"2024-05-15T14:49:14.657842+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.657842+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:54:11.139225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1572,"num_read_kb":3606,"num_write":909,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.681406+0000","last_change":"2024-05-15T14:49:09.681429+0000","last_active":"2024-05-15T14:49:09.681406+0000","last_peered":"2024-05-15T14:49:09.681406+0000","last_clean":"2024-05-15T14:49:09.681406+0000","last_became_active":"2024-05-15T14:28:00.883811+0000","last_became_peered":"2024-05-15T14:28:00.883811+0000","last_unstale":"2024-05-15T14:49:09.681406+0000","last_undegraded":"2024-05-15T14:49:09.681406+0000","last_fullsized":"2024-05-15T14:49:09.681406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:09.681307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:09.681307+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.681307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:28:55.391390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.431675+0000","last_change":"2024-05-15T14:31:16.592460+0000","last_active":"2024-05-15T14:47:57.431675+0000","last_peered":"2024-05-15T14:47:57.431675+0000","last_clean":"2024-05-15T14:47:57.431675+0000","last_became_active":"2024-05-15T14:31:16.592053+0000","last_became_peered":"2024-05-15T14:31:16.592053+0000","last_unstale":"2024-05-15T14:47:57.431675+0000","last_undegraded":"2024-05-15T14:47:57.431675+0000","last_fullsized":"2024-05-15T14:47:57.431675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"39'30","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.665387+0000","last_change":"2024-05-15T14:49:08.665420+0000","last_active":"2024-05-15T14:49:08.665387+0000","last_peered":"2024-05-15T14:49:08.665387+0000","last_clean":"2024-05-15T14:49:08.665387+0000","last_became_active":"2024-05-15T14:28:02.894053+0000","last_became_peered":"2024-05-15T14:28:02.894053+0000","last_unstale":"2024-05-15T14:49:08.665387+0000","last_undegraded":"2024-05-15T14:49:08.665387+0000","last_fullsized":"2024-05-15T14:49:08.665387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2024-05-15T14:49:08.665299+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2024-05-15T14:49:08.665299+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.665299+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:32.897052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"39'12","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.079792+0000","last_change":"2024-05-15T14:49:09.079860+0000","last_active":"2024-05-15T14:49:09.079792+0000","last_peered":"2024-05-15T14:49:09.079792+0000","last_clean":"2024-05-15T14:49:09.079792+0000","last_became_active":"2024-05-15T14:27:52.849013+0000","last_became_peered":"2024-05-15T14:27:52.849013+0000","last_unstale":"2024-05-15T14:49:09.079792+0000","last_undegraded":"2024-05-15T14:49:09.079792+0000","last_fullsized":"2024-05-15T14:49:09.079792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:09.079673+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:09.079673+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.079673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:39.344389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"39'12","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.777833+0000","last_change":"2024-05-15T14:49:17.777868+0000","last_active":"2024-05-15T14:49:17.777833+0000","last_peered":"2024-05-15T14:49:17.777833+0000","last_clean":"2024-05-15T14:49:17.777833+0000","last_became_active":"2024-05-15T14:27:50.852755+0000","last_became_peered":"2024-05-15T14:27:50.852755+0000","last_unstale":"2024-05-15T14:49:17.777833+0000","last_undegraded":"2024-05-15T14:49:17.777833+0000","last_fullsized":"2024-05-15T14:49:17.777833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:17.777742+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:17.777742+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.777742+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:38.023267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.542873+0000","last_change":"2024-05-15T14:27:56.883749+0000","last_active":"2024-05-15T14:48:57.542873+0000","last_peered":"2024-05-15T14:48:57.542873+0000","last_clean":"2024-05-15T14:48:57.542873+0000","last_became_active":"2024-05-15T14:27:56.883312+0000","last_became_peered":"2024-05-15T14:27:56.883312+0000","last_unstale":"2024-05-15T14:48:57.542873+0000","last_undegraded":"2024-05-15T14:48:57.542873+0000","last_fullsized":"2024-05-15T14:48:57.542873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'161","reported_seq":222595,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.128051+0000","last_change":"2024-05-15T14:49:12.128133+0000","last_active":"2024-05-15T14:49:12.128051+0000","last_peered":"2024-05-15T14:49:12.128051+0000","last_clean":"2024-05-15T14:49:12.128051+0000","last_became_active":"2024-05-15T14:27:58.884647+0000","last_became_peered":"2024-05-15T14:27:58.884647+0000","last_unstale":"2024-05-15T14:49:12.128051+0000","last_undegraded":"2024-05-15T14:49:12.128051+0000","last_fullsized":"2024-05-15T14:49:12.128051+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'161","last_scrub_stamp":"2024-05-15T14:49:12.127934+0000","last_deep_scrub":"39'161","last_deep_scrub_stamp":"2024-05-15T14:49:12.127934+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.127934+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:26.110927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555956,"num_read_kb":2334405,"num_write":176,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1536,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.933696+0000","last_change":"2024-05-15T14:49:05.933725+0000","last_active":"2024-05-15T14:49:05.933696+0000","last_peered":"2024-05-15T14:49:05.933696+0000","last_clean":"2024-05-15T14:49:05.933696+0000","last_became_active":"2024-05-15T14:28:00.888834+0000","last_became_peered":"2024-05-15T14:28:00.888834+0000","last_unstale":"2024-05-15T14:49:05.933696+0000","last_undegraded":"2024-05-15T14:49:05.933696+0000","last_fullsized":"2024-05-15T14:49:05.933696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:05.933598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:05.933598+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.933598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:25.879629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438355+0000","last_change":"2024-05-15T14:31:16.594403+0000","last_active":"2024-05-15T14:48:47.438355+0000","last_peered":"2024-05-15T14:48:47.438355+0000","last_clean":"2024-05-15T14:48:47.438355+0000","last_became_active":"2024-05-15T14:31:16.594114+0000","last_became_peered":"2024-05-15T14:31:16.594114+0000","last_unstale":"2024-05-15T14:48:47.438355+0000","last_undegraded":"2024-05-15T14:48:47.438355+0000","last_fullsized":"2024-05-15T14:48:47.438355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"39'28","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.039996+0000","last_change":"2024-05-15T14:49:01.040056+0000","last_active":"2024-05-15T14:49:01.039996+0000","last_peered":"2024-05-15T14:49:01.039996+0000","last_clean":"2024-05-15T14:49:01.039996+0000","last_became_active":"2024-05-15T14:28:02.890071+0000","last_became_peered":"2024-05-15T14:28:02.890071+0000","last_unstale":"2024-05-15T14:49:01.039996+0000","last_undegraded":"2024-05-15T14:49:01.039996+0000","last_fullsized":"2024-05-15T14:49:01.039996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'28","last_scrub_stamp":"2024-05-15T14:49:01.039894+0000","last_deep_scrub":"39'28","last_deep_scrub_stamp":"2024-05-15T14:49:01.039894+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.039894+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:14:43.778244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":114,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'10","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.542329+0000","last_change":"2024-05-15T14:27:52.852243+0000","last_active":"2024-05-15T14:48:52.542329+0000","last_peered":"2024-05-15T14:48:52.542329+0000","last_clean":"2024-05-15T14:48:52.542329+0000","last_became_active":"2024-05-15T14:27:52.851940+0000","last_became_peered":"2024-05-15T14:27:52.851940+0000","last_unstale":"2024-05-15T14:48:52.542329+0000","last_undegraded":"2024-05-15T14:48:52.542329+0000","last_fullsized":"2024-05-15T14:48:52.542329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"39'4","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.420815+0000","last_change":"2024-05-15T14:27:50.846653+0000","last_active":"2024-05-15T14:47:12.420815+0000","last_peered":"2024-05-15T14:47:12.420815+0000","last_clean":"2024-05-15T14:47:12.420815+0000","last_became_active":"2024-05-15T14:27:50.846362+0000","last_became_peered":"2024-05-15T14:27:50.846362+0000","last_unstale":"2024-05-15T14:47:12.420815+0000","last_undegraded":"2024-05-15T14:47:12.420815+0000","last_fullsized":"2024-05-15T14:47:12.420815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"39'12","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.777551+0000","last_change":"2024-05-15T14:49:18.777587+0000","last_active":"2024-05-15T14:49:18.777551+0000","last_peered":"2024-05-15T14:49:18.777551+0000","last_clean":"2024-05-15T14:49:18.777551+0000","last_became_active":"2024-05-15T14:27:56.877413+0000","last_became_peered":"2024-05-15T14:27:56.877413+0000","last_unstale":"2024-05-15T14:49:18.777551+0000","last_undegraded":"2024-05-15T14:49:18.777551+0000","last_fullsized":"2024-05-15T14:49:18.777551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:18.777443+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:18.777443+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.777443+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:34:58.968978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"39'253","reported_seq":481,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.642376+0000","last_change":"2024-05-15T14:49:15.642416+0000","last_active":"2024-05-15T14:49:15.642376+0000","last_peered":"2024-05-15T14:49:15.642376+0000","last_clean":"2024-05-15T14:49:15.642376+0000","last_became_active":"2024-05-15T14:27:58.881581+0000","last_became_peered":"2024-05-15T14:27:58.881581+0000","last_unstale":"2024-05-15T14:49:15.642376+0000","last_undegraded":"2024-05-15T14:49:15.642376+0000","last_fullsized":"2024-05-15T14:49:15.642376+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'253","last_scrub_stamp":"2024-05-15T14:49:15.642282+0000","last_deep_scrub":"39'253","last_deep_scrub_stamp":"2024-05-15T14:49:15.642282+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.642282+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:15.646174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":391,"num_write":224,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.139014+0000","last_change":"2024-05-15T14:49:22.139037+0000","last_active":"2024-05-15T14:49:22.139014+0000","last_peered":"2024-05-15T14:49:22.139014+0000","last_clean":"2024-05-15T14:49:22.139014+0000","last_became_active":"2024-05-15T14:28:00.887738+0000","last_became_peered":"2024-05-15T14:28:00.887738+0000","last_unstale":"2024-05-15T14:49:22.139014+0000","last_undegraded":"2024-05-15T14:49:22.139014+0000","last_fullsized":"2024-05-15T14:49:22.139014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.138922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.138922+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.138922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:46.513303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438376+0000","last_change":"2024-05-15T14:31:16.591389+0000","last_active":"2024-05-15T14:48:47.438376+0000","last_peered":"2024-05-15T14:48:47.438376+0000","last_clean":"2024-05-15T14:48:47.438376+0000","last_became_active":"2024-05-15T14:31:16.590502+0000","last_became_peered":"2024-05-15T14:31:16.590502+0000","last_unstale":"2024-05-15T14:48:47.438376+0000","last_undegraded":"2024-05-15T14:48:47.438376+0000","last_fullsized":"2024-05-15T14:48:47.438376+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'26","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.018451+0000","last_change":"2024-05-15T14:49:12.018496+0000","last_active":"2024-05-15T14:49:12.018451+0000","last_peered":"2024-05-15T14:49:12.018451+0000","last_clean":"2024-05-15T14:49:12.018451+0000","last_became_active":"2024-05-15T14:28:02.894280+0000","last_became_peered":"2024-05-15T14:28:02.894280+0000","last_unstale":"2024-05-15T14:49:12.018451+0000","last_undegraded":"2024-05-15T14:49:12.018451+0000","last_fullsized":"2024-05-15T14:49:12.018451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:12.018320+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:12.018320+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.018320+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:32.578339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"39'66","reported_seq":159,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.542296+0000","last_change":"2024-05-15T14:27:52.862502+0000","last_active":"2024-05-15T14:48:52.542296+0000","last_peered":"2024-05-15T14:48:52.542296+0000","last_clean":"2024-05-15T14:48:52.542296+0000","last_became_active":"2024-05-15T14:27:52.862259+0000","last_became_peered":"2024-05-15T14:27:52.862259+0000","last_unstale":"2024-05-15T14:48:52.542296+0000","last_undegraded":"2024-05-15T14:48:52.542296+0000","last_fullsized":"2024-05-15T14:48:52.542296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":205,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"39'8","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.426049+0000","last_change":"2024-05-15T14:27:50.844225+0000","last_active":"2024-05-15T14:47:12.426049+0000","last_peered":"2024-05-15T14:47:12.426049+0000","last_clean":"2024-05-15T14:47:12.426049+0000","last_became_active":"2024-05-15T14:27:50.843223+0000","last_became_peered":"2024-05-15T14:27:50.843223+0000","last_unstale":"2024-05-15T14:47:12.426049+0000","last_undegraded":"2024-05-15T14:47:12.426049+0000","last_fullsized":"2024-05-15T14:47:12.426049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"39'10","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.155423+0000","last_change":"2024-05-15T14:49:03.155458+0000","last_active":"2024-05-15T14:49:03.155423+0000","last_peered":"2024-05-15T14:49:03.155423+0000","last_clean":"2024-05-15T14:49:03.155423+0000","last_became_active":"2024-05-15T14:27:56.879589+0000","last_became_peered":"2024-05-15T14:27:56.879589+0000","last_unstale":"2024-05-15T14:49:03.155423+0000","last_undegraded":"2024-05-15T14:49:03.155423+0000","last_fullsized":"2024-05-15T14:49:03.155423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:03.155336+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:03.155336+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.155336+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:22:33.777606+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"39'202","reported_seq":400,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.539358+0000","last_change":"2024-05-15T14:27:58.885088+0000","last_active":"2024-05-15T14:49:02.539358+0000","last_peered":"2024-05-15T14:49:02.539358+0000","last_clean":"2024-05-15T14:49:02.539358+0000","last_became_active":"2024-05-15T14:27:58.884831+0000","last_became_peered":"2024-05-15T14:27:58.884831+0000","last_unstale":"2024-05-15T14:49:02.539358+0000","last_undegraded":"2024-05-15T14:49:02.539358+0000","last_fullsized":"2024-05-15T14:49:02.539358+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":326,"num_write":178,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.071622+0000","last_change":"2024-05-15T14:49:04.071645+0000","last_active":"2024-05-15T14:49:04.071622+0000","last_peered":"2024-05-15T14:49:04.071622+0000","last_clean":"2024-05-15T14:49:04.071622+0000","last_became_active":"2024-05-15T14:28:00.887513+0000","last_became_peered":"2024-05-15T14:28:00.887513+0000","last_unstale":"2024-05-15T14:49:04.071622+0000","last_undegraded":"2024-05-15T14:49:04.071622+0000","last_fullsized":"2024-05-15T14:49:04.071622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.071548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.071548+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.071548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:45.604297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:37.424000+0000","last_change":"2024-05-15T14:31:16.594526+0000","last_active":"2024-05-15T14:47:37.424000+0000","last_peered":"2024-05-15T14:47:37.424000+0000","last_clean":"2024-05-15T14:47:37.424000+0000","last_became_active":"2024-05-15T14:31:16.594193+0000","last_became_peered":"2024-05-15T14:31:16.594193+0000","last_unstale":"2024-05-15T14:47:37.424000+0000","last_undegraded":"2024-05-15T14:47:37.424000+0000","last_fullsized":"2024-05-15T14:47:37.424000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"39'20","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.064388+0000","last_change":"2024-05-15T14:49:08.064433+0000","last_active":"2024-05-15T14:49:08.064388+0000","last_peered":"2024-05-15T14:49:08.064388+0000","last_clean":"2024-05-15T14:49:08.064388+0000","last_became_active":"2024-05-15T14:27:52.847609+0000","last_became_peered":"2024-05-15T14:27:52.847609+0000","last_unstale":"2024-05-15T14:49:08.064388+0000","last_undegraded":"2024-05-15T14:49:08.064388+0000","last_fullsized":"2024-05-15T14:49:08.064388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:08.064289+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:08.064289+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.064289+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:12:50.814001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":78,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.529332+0000","last_change":"2024-05-15T14:27:50.850851+0000","last_active":"2024-05-15T14:47:12.529332+0000","last_peered":"2024-05-15T14:47:12.529332+0000","last_clean":"2024-05-15T14:47:12.529332+0000","last_became_active":"2024-05-15T14:27:50.850524+0000","last_became_peered":"2024-05-15T14:27:50.850524+0000","last_unstale":"2024-05-15T14:47:12.529332+0000","last_undegraded":"2024-05-15T14:47:12.529332+0000","last_fullsized":"2024-05-15T14:47:12.529332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":18802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"39'11","reported_seq":151,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.900204+0000","last_change":"2024-05-15T14:27:56.882053+0000","last_active":"2024-05-15T14:48:56.900204+0000","last_peered":"2024-05-15T14:48:56.900204+0000","last_clean":"2024-05-15T14:48:56.900204+0000","last_became_active":"2024-05-15T14:27:56.881789+0000","last_became_peered":"2024-05-15T14:27:56.881789+0000","last_unstale":"2024-05-15T14:48:56.900204+0000","last_undegraded":"2024-05-15T14:48:56.900204+0000","last_fullsized":"2024-05-15T14:48:56.900204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":182,"num_write":22,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"39'280","reported_seq":577,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.045043+0000","last_change":"2024-05-15T14:49:12.045140+0000","last_active":"2024-05-15T14:49:12.045043+0000","last_peered":"2024-05-15T14:49:12.045043+0000","last_clean":"2024-05-15T14:49:12.045043+0000","last_became_active":"2024-05-15T14:27:58.887134+0000","last_became_peered":"2024-05-15T14:27:58.887134+0000","last_unstale":"2024-05-15T14:49:12.045043+0000","last_undegraded":"2024-05-15T14:49:12.045043+0000","last_fullsized":"2024-05-15T14:49:12.045043+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'280","last_scrub_stamp":"2024-05-15T14:49:12.044936+0000","last_deep_scrub":"39'280","last_deep_scrub_stamp":"2024-05-15T14:49:12.044936+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.044936+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:41.078456+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":462,"num_write":228,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.950191+0000","last_change":"2024-05-15T14:49:08.950216+0000","last_active":"2024-05-15T14:49:08.950191+0000","last_peered":"2024-05-15T14:49:08.950191+0000","last_clean":"2024-05-15T14:49:08.950191+0000","last_became_active":"2024-05-15T14:28:00.885174+0000","last_became_peered":"2024-05-15T14:28:00.885174+0000","last_unstale":"2024-05-15T14:49:08.950191+0000","last_undegraded":"2024-05-15T14:49:08.950191+0000","last_fullsized":"2024-05-15T14:49:08.950191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:08.950089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:08.950089+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.950089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:33.324469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"39'31","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.650844+0000","last_change":"2024-05-15T14:49:16.650875+0000","last_active":"2024-05-15T14:49:16.650844+0000","last_peered":"2024-05-15T14:49:16.650844+0000","last_clean":"2024-05-15T14:49:16.650844+0000","last_became_active":"2024-05-15T14:28:02.894515+0000","last_became_peered":"2024-05-15T14:28:02.894515+0000","last_unstale":"2024-05-15T14:49:16.650844+0000","last_undegraded":"2024-05-15T14:49:16.650844+0000","last_fullsized":"2024-05-15T14:49:16.650844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:16.650739+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:16.650739+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.650739+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:27:10.706293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:37.528387+0000","last_change":"2024-05-15T14:31:16.589730+0000","last_active":"2024-05-15T14:47:37.528387+0000","last_peered":"2024-05-15T14:47:37.528387+0000","last_clean":"2024-05-15T14:47:37.528387+0000","last_became_active":"2024-05-15T14:31:16.589442+0000","last_became_peered":"2024-05-15T14:31:16.589442+0000","last_unstale":"2024-05-15T14:47:37.528387+0000","last_undegraded":"2024-05-15T14:47:37.528387+0000","last_fullsized":"2024-05-15T14:47:37.528387+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"39'56","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.432209+0000","last_change":"2024-05-15T14:27:52.845888+0000","last_active":"2024-05-15T14:47:57.432209+0000","last_peered":"2024-05-15T14:47:57.432209+0000","last_clean":"2024-05-15T14:47:57.432209+0000","last_became_active":"2024-05-15T14:27:52.845557+0000","last_became_peered":"2024-05-15T14:27:52.845557+0000","last_unstale":"2024-05-15T14:47:57.432209+0000","last_undegraded":"2024-05-15T14:47:57.432209+0000","last_fullsized":"2024-05-15T14:47:57.432209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":171,"num_write":80,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"39'10","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:17.426501+0000","last_change":"2024-05-15T14:27:50.850506+0000","last_active":"2024-05-15T14:47:17.426501+0000","last_peered":"2024-05-15T14:47:17.426501+0000","last_clean":"2024-05-15T14:47:17.426501+0000","last_became_active":"2024-05-15T14:27:50.850175+0000","last_became_peered":"2024-05-15T14:27:50.850175+0000","last_unstale":"2024-05-15T14:47:17.426501+0000","last_undegraded":"2024-05-15T14:47:17.426501+0000","last_fullsized":"2024-05-15T14:47:17.426501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.146706+0000","last_change":"2024-05-15T14:49:04.146740+0000","last_active":"2024-05-15T14:49:04.146706+0000","last_peered":"2024-05-15T14:49:04.146706+0000","last_clean":"2024-05-15T14:49:04.146706+0000","last_became_active":"2024-05-15T14:27:56.879634+0000","last_became_peered":"2024-05-15T14:27:56.879634+0000","last_unstale":"2024-05-15T14:49:04.146706+0000","last_undegraded":"2024-05-15T14:49:04.146706+0000","last_fullsized":"2024-05-15T14:49:04.146706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.146612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.146612+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.146612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:07.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"39'510","reported_seq":1267,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.911817+0000","last_change":"2024-05-15T14:49:11.911862+0000","last_active":"2024-05-15T14:49:11.911817+0000","last_peered":"2024-05-15T14:49:11.911817+0000","last_clean":"2024-05-15T14:49:11.911817+0000","last_became_active":"2024-05-15T14:27:58.887144+0000","last_became_peered":"2024-05-15T14:27:58.887144+0000","last_unstale":"2024-05-15T14:49:11.911817+0000","last_undegraded":"2024-05-15T14:49:11.911817+0000","last_fullsized":"2024-05-15T14:49:11.911817+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'510","last_scrub_stamp":"2024-05-15T14:49:11.911710+0000","last_deep_scrub":"39'510","last_deep_scrub_stamp":"2024-05-15T14:49:11.911710+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.911710+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:26:29.857106+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1003,"num_read_kb":910,"num_write":675,"num_write_kb":1754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.013369+0000","last_change":"2024-05-15T14:49:16.013393+0000","last_active":"2024-05-15T14:49:16.013369+0000","last_peered":"2024-05-15T14:49:16.013369+0000","last_clean":"2024-05-15T14:49:16.013369+0000","last_became_active":"2024-05-15T14:28:00.891343+0000","last_became_peered":"2024-05-15T14:28:00.891343+0000","last_unstale":"2024-05-15T14:49:16.013369+0000","last_undegraded":"2024-05-15T14:49:16.013369+0000","last_fullsized":"2024-05-15T14:49:16.013369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:16.013268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:16.013268+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.013268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:40.387649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"39'31","reported_seq":116,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.434107+0000","last_change":"2024-05-15T14:28:02.890221+0000","last_active":"2024-05-15T14:49:02.434107+0000","last_peered":"2024-05-15T14:49:02.434107+0000","last_clean":"2024-05-15T14:49:02.434107+0000","last_became_active":"2024-05-15T14:28:02.889940+0000","last_became_peered":"2024-05-15T14:28:02.889940+0000","last_unstale":"2024-05-15T14:49:02.434107+0000","last_undegraded":"2024-05-15T14:49:02.434107+0000","last_fullsized":"2024-05-15T14:49:02.434107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":111,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:37.424030+0000","last_change":"2024-05-15T14:31:16.590555+0000","last_active":"2024-05-15T14:47:37.424030+0000","last_peered":"2024-05-15T14:47:37.424030+0000","last_clean":"2024-05-15T14:47:37.424030+0000","last_became_active":"2024-05-15T14:31:16.590270+0000","last_became_peered":"2024-05-15T14:31:16.590270+0000","last_unstale":"2024-05-15T14:47:37.424030+0000","last_undegraded":"2024-05-15T14:47:37.424030+0000","last_fullsized":"2024-05-15T14:47:37.424030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'14","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.643317+0000","last_change":"2024-05-15T14:49:18.643350+0000","last_active":"2024-05-15T14:49:18.643317+0000","last_peered":"2024-05-15T14:49:18.643317+0000","last_clean":"2024-05-15T14:49:18.643317+0000","last_became_active":"2024-05-15T14:27:52.861459+0000","last_became_peered":"2024-05-15T14:27:52.861459+0000","last_unstale":"2024-05-15T14:49:18.643317+0000","last_undegraded":"2024-05-15T14:49:18.643317+0000","last_fullsized":"2024-05-15T14:49:18.643317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:18.643228+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:18.643228+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.643228+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:21.768562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"39'12","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.425944+0000","last_change":"2024-05-15T14:27:50.836665+0000","last_active":"2024-05-15T14:47:52.425944+0000","last_peered":"2024-05-15T14:47:52.425944+0000","last_clean":"2024-05-15T14:47:52.425944+0000","last_became_active":"2024-05-15T14:27:50.836343+0000","last_became_peered":"2024-05-15T14:27:50.836343+0000","last_unstale":"2024-05-15T14:47:52.425944+0000","last_undegraded":"2024-05-15T14:47:52.425944+0000","last_fullsized":"2024-05-15T14:47:52.425944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.203034+0000","last_change":"2024-05-15T14:49:18.203061+0000","last_active":"2024-05-15T14:49:18.203034+0000","last_peered":"2024-05-15T14:49:18.203034+0000","last_clean":"2024-05-15T14:49:18.203034+0000","last_became_active":"2024-05-15T14:27:56.876994+0000","last_became_peered":"2024-05-15T14:27:56.876994+0000","last_unstale":"2024-05-15T14:49:18.203034+0000","last_undegraded":"2024-05-15T14:49:18.203034+0000","last_fullsized":"2024-05-15T14:49:18.203034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:18.202940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:18.202940+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.202940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:30.386529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"39'250","reported_seq":475,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:57.035681+0000","last_change":"2024-05-15T14:27:58.877101+0000","last_active":"2024-05-15T14:48:57.035681+0000","last_peered":"2024-05-15T14:48:57.035681+0000","last_clean":"2024-05-15T14:48:57.035681+0000","last_became_active":"2024-05-15T14:27:58.876807+0000","last_became_peered":"2024-05-15T14:27:58.876807+0000","last_unstale":"2024-05-15T14:48:57.035681+0000","last_undegraded":"2024-05-15T14:48:57.035681+0000","last_fullsized":"2024-05-15T14:48:57.035681+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":396,"num_write":226,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.078333+0000","last_change":"2024-05-15T14:49:14.078360+0000","last_active":"2024-05-15T14:49:14.078333+0000","last_peered":"2024-05-15T14:49:14.078333+0000","last_clean":"2024-05-15T14:49:14.078333+0000","last_became_active":"2024-05-15T14:28:00.891181+0000","last_became_peered":"2024-05-15T14:28:00.891181+0000","last_unstale":"2024-05-15T14:49:14.078333+0000","last_undegraded":"2024-05-15T14:49:14.078333+0000","last_fullsized":"2024-05-15T14:49:14.078333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:14.078232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:14.078232+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.078232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:32.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"39'31","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.950712+0000","last_change":"2024-05-15T14:49:05.950748+0000","last_active":"2024-05-15T14:49:05.950712+0000","last_peered":"2024-05-15T14:49:05.950712+0000","last_clean":"2024-05-15T14:49:05.950712+0000","last_became_active":"2024-05-15T14:28:02.889976+0000","last_became_peered":"2024-05-15T14:28:02.889976+0000","last_unstale":"2024-05-15T14:49:05.950712+0000","last_undegraded":"2024-05-15T14:49:05.950712+0000","last_fullsized":"2024-05-15T14:49:05.950712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:05.950622+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:05.950622+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.950622+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:32.800900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:37.528350+0000","last_change":"2024-05-15T14:31:16.592036+0000","last_active":"2024-05-15T14:47:37.528350+0000","last_peered":"2024-05-15T14:47:37.528350+0000","last_clean":"2024-05-15T14:47:37.528350+0000","last_became_active":"2024-05-15T14:31:16.591739+0000","last_became_peered":"2024-05-15T14:31:16.591739+0000","last_unstale":"2024-05-15T14:47:37.528350+0000","last_undegraded":"2024-05-15T14:47:37.528350+0000","last_fullsized":"2024-05-15T14:47:37.528350+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1c","version":"39'60","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.335021+0000","last_change":"2024-05-15T14:49:08.335055+0000","last_active":"2024-05-15T14:49:08.335021+0000","last_peered":"2024-05-15T14:49:08.335021+0000","last_clean":"2024-05-15T14:49:08.335021+0000","last_became_active":"2024-05-15T14:27:52.838558+0000","last_became_peered":"2024-05-15T14:27:52.838558+0000","last_unstale":"2024-05-15T14:49:08.335021+0000","last_undegraded":"2024-05-15T14:49:08.335021+0000","last_fullsized":"2024-05-15T14:49:08.335021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'60","last_scrub_stamp":"2024-05-15T14:49:08.334922+0000","last_deep_scrub":"39'60","last_deep_scrub_stamp":"2024-05-15T14:49:08.334922+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.334922+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:42:26.393241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":198,"num_write":84,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"39'14","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.026827+0000","last_change":"2024-05-15T14:27:50.834122+0000","last_active":"2024-05-15T14:48:26.026827+0000","last_peered":"2024-05-15T14:48:26.026827+0000","last_clean":"2024-05-15T14:48:26.026827+0000","last_became_active":"2024-05-15T14:27:50.833741+0000","last_became_peered":"2024-05-15T14:27:50.833741+0000","last_unstale":"2024-05-15T14:48:26.026827+0000","last_undegraded":"2024-05-15T14:48:26.026827+0000","last_fullsized":"2024-05-15T14:48:26.026827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20,"num_write":62,"num_write_kb":15860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"39'4","reported_seq":287,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.052843+0000","last_change":"2024-05-15T14:49:04.052897+0000","last_active":"2024-05-15T14:49:04.052843+0000","last_peered":"2024-05-15T14:49:04.052843+0000","last_clean":"2024-05-15T14:49:04.052843+0000","last_became_active":"2024-05-15T14:27:56.883663+0000","last_became_peered":"2024-05-15T14:27:56.883663+0000","last_unstale":"2024-05-15T14:49:04.052843+0000","last_undegraded":"2024-05-15T14:49:04.052843+0000","last_fullsized":"2024-05-15T14:49:04.052843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:04.052742+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:04.052742+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.052742+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:00.238835+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2211,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":456,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"39'289","reported_seq":646,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427832+0000","last_change":"2024-05-15T14:27:58.880803+0000","last_active":"2024-05-15T14:48:07.427832+0000","last_peered":"2024-05-15T14:48:07.427832+0000","last_clean":"2024-05-15T14:48:07.427832+0000","last_became_active":"2024-05-15T14:27:58.880510+0000","last_became_peered":"2024-05-15T14:27:58.880510+0000","last_unstale":"2024-05-15T14:48:07.427832+0000","last_undegraded":"2024-05-15T14:48:07.427832+0000","last_fullsized":"2024-05-15T14:48:07.427832+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":979,"num_read_kb":1295,"num_write":324,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'927","reported_seq":2566,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.113120+0000","last_change":"2024-05-15T14:49:07.113188+0000","last_active":"2024-05-15T14:49:07.113120+0000","last_peered":"2024-05-15T14:49:07.113120+0000","last_clean":"2024-05-15T14:49:07.113120+0000","last_became_active":"2024-05-15T14:28:00.885293+0000","last_became_peered":"2024-05-15T14:28:00.885293+0000","last_unstale":"2024-05-15T14:49:07.113120+0000","last_undegraded":"2024-05-15T14:49:07.113120+0000","last_fullsized":"2024-05-15T14:49:07.113120+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:07.113019+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:07.113019+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.113019+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:38:04.929797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"39'25","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.887862+0000","last_change":"2024-05-15T14:49:06.887889+0000","last_active":"2024-05-15T14:49:06.887862+0000","last_peered":"2024-05-15T14:49:06.887862+0000","last_clean":"2024-05-15T14:49:06.887862+0000","last_became_active":"2024-05-15T14:28:02.892984+0000","last_became_peered":"2024-05-15T14:28:02.892984+0000","last_unstale":"2024-05-15T14:49:06.887862+0000","last_undegraded":"2024-05-15T14:49:06.887862+0000","last_fullsized":"2024-05-15T14:49:06.887862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:06.887772+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:06.887772+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.887772+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:33.315561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":37,"num_write":54,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.428448+0000","last_change":"2024-05-15T14:31:16.594309+0000","last_active":"2024-05-15T14:48:12.428448+0000","last_peered":"2024-05-15T14:48:12.428448+0000","last_clean":"2024-05-15T14:48:12.428448+0000","last_became_active":"2024-05-15T14:31:16.594019+0000","last_became_peered":"2024-05-15T14:31:16.594019+0000","last_unstale":"2024-05-15T14:48:12.428448+0000","last_undegraded":"2024-05-15T14:48:12.428448+0000","last_fullsized":"2024-05-15T14:48:12.428448+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"39'52","reported_seq":150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.336418+0000","last_change":"2024-05-15T14:49:08.336446+0000","last_active":"2024-05-15T14:49:08.336418+0000","last_peered":"2024-05-15T14:49:08.336418+0000","last_clean":"2024-05-15T14:49:08.336418+0000","last_became_active":"2024-05-15T14:27:52.854479+0000","last_became_peered":"2024-05-15T14:27:52.854479+0000","last_unstale":"2024-05-15T14:49:08.336418+0000","last_undegraded":"2024-05-15T14:49:08.336418+0000","last_fullsized":"2024-05-15T14:49:08.336418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'52","last_scrub_stamp":"2024-05-15T14:49:08.336317+0000","last_deep_scrub":"39'52","last_deep_scrub_stamp":"2024-05-15T14:49:08.336317+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.336317+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:26.297455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":157,"num_write":72,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"39'14","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.425872+0000","last_change":"2024-05-15T14:27:50.841154+0000","last_active":"2024-05-15T14:47:52.425872+0000","last_peered":"2024-05-15T14:47:52.425872+0000","last_clean":"2024-05-15T14:47:52.425872+0000","last_became_active":"2024-05-15T14:27:50.840771+0000","last_became_peered":"2024-05-15T14:27:50.840771+0000","last_unstale":"2024-05-15T14:47:52.425872+0000","last_undegraded":"2024-05-15T14:47:52.425872+0000","last_fullsized":"2024-05-15T14:47:52.425872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.797856+0000","last_change":"2024-05-15T14:49:16.797903+0000","last_active":"2024-05-15T14:49:16.797856+0000","last_peered":"2024-05-15T14:49:16.797856+0000","last_clean":"2024-05-15T14:49:16.797856+0000","last_became_active":"2024-05-15T14:27:56.877367+0000","last_became_peered":"2024-05-15T14:27:56.877367+0000","last_unstale":"2024-05-15T14:49:16.797856+0000","last_undegraded":"2024-05-15T14:49:16.797856+0000","last_fullsized":"2024-05-15T14:49:16.797856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:16.797749+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:16.797749+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.797749+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:40.177618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":101,"num_read_kb":87,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"39'411","reported_seq":22984,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.955805+0000","last_change":"2024-05-15T14:27:58.882407+0000","last_active":"2024-05-15T14:48:56.955805+0000","last_peered":"2024-05-15T14:48:56.955805+0000","last_clean":"2024-05-15T14:48:56.955805+0000","last_became_active":"2024-05-15T14:27:58.882139+0000","last_became_peered":"2024-05-15T14:27:58.882139+0000","last_unstale":"2024-05-15T14:48:56.955805+0000","last_undegraded":"2024-05-15T14:48:56.955805+0000","last_fullsized":"2024-05-15T14:48:56.955805+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56371,"num_read_kb":194199,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.130778+0000","last_change":"2024-05-15T14:49:07.130805+0000","last_active":"2024-05-15T14:49:07.130778+0000","last_peered":"2024-05-15T14:49:07.130778+0000","last_clean":"2024-05-15T14:49:07.130778+0000","last_became_active":"2024-05-15T14:28:00.885872+0000","last_became_peered":"2024-05-15T14:28:00.885872+0000","last_unstale":"2024-05-15T14:49:07.130778+0000","last_undegraded":"2024-05-15T14:49:07.130778+0000","last_fullsized":"2024-05-15T14:49:07.130778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.130678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.130678+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.130678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:00.272870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"39'21","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.293506+0000","last_change":"2024-05-15T14:28:02.896566+0000","last_active":"2024-05-15T14:47:54.293506+0000","last_peered":"2024-05-15T14:47:54.293506+0000","last_clean":"2024-05-15T14:47:54.293506+0000","last_became_active":"2024-05-15T14:28:02.896293+0000","last_became_peered":"2024-05-15T14:28:02.896293+0000","last_unstale":"2024-05-15T14:47:54.293506+0000","last_undegraded":"2024-05-15T14:47:54.293506+0000","last_fullsized":"2024-05-15T14:47:54.293506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.533094+0000","last_change":"2024-05-15T14:31:16.594407+0000","last_active":"2024-05-15T14:48:12.533094+0000","last_peered":"2024-05-15T14:48:12.533094+0000","last_clean":"2024-05-15T14:48:12.533094+0000","last_became_active":"2024-05-15T14:31:16.594144+0000","last_became_peered":"2024-05-15T14:31:16.594144+0000","last_unstale":"2024-05-15T14:48:12.533094+0000","last_undegraded":"2024-05-15T14:48:12.533094+0000","last_fullsized":"2024-05-15T14:48:12.533094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"39'56","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.317080+0000","last_change":"2024-05-15T14:49:10.317106+0000","last_active":"2024-05-15T14:49:10.317080+0000","last_peered":"2024-05-15T14:49:10.317080+0000","last_clean":"2024-05-15T14:49:10.317080+0000","last_became_active":"2024-05-15T14:27:52.854517+0000","last_became_peered":"2024-05-15T14:27:52.854517+0000","last_unstale":"2024-05-15T14:49:10.317080+0000","last_undegraded":"2024-05-15T14:49:10.317080+0000","last_fullsized":"2024-05-15T14:49:10.317080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'56","last_scrub_stamp":"2024-05-15T14:49:10.316960+0000","last_deep_scrub":"39'56","last_deep_scrub_stamp":"2024-05-15T14:49:10.316960+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.316960+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:31.795310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":183,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.425903+0000","last_change":"2024-05-15T14:27:50.840481+0000","last_active":"2024-05-15T14:47:52.425903+0000","last_peered":"2024-05-15T14:47:52.425903+0000","last_clean":"2024-05-15T14:47:52.425903+0000","last_became_active":"2024-05-15T14:27:50.839960+0000","last_became_peered":"2024-05-15T14:27:50.839960+0000","last_unstale":"2024-05-15T14:47:52.425903+0000","last_undegraded":"2024-05-15T14:47:52.425903+0000","last_fullsized":"2024-05-15T14:47:52.425903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.426527+0000","last_change":"2024-05-15T14:27:56.883585+0000","last_active":"2024-05-15T14:47:57.426527+0000","last_peered":"2024-05-15T14:47:57.426527+0000","last_clean":"2024-05-15T14:47:57.426527+0000","last_became_active":"2024-05-15T14:27:56.883267+0000","last_became_peered":"2024-05-15T14:27:56.883267+0000","last_unstale":"2024-05-15T14:47:57.426527+0000","last_undegraded":"2024-05-15T14:47:57.426527+0000","last_fullsized":"2024-05-15T14:47:57.426527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:55.862227+0000","last_clean_scrub_stamp":"2024-05-15T14:27:55.862227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"39'219","reported_seq":421,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:56.959209+0000","last_change":"2024-05-15T14:27:58.882536+0000","last_active":"2024-05-15T14:48:56.959209+0000","last_peered":"2024-05-15T14:48:56.959209+0000","last_clean":"2024-05-15T14:48:56.959209+0000","last_became_active":"2024-05-15T14:27:58.882239+0000","last_became_peered":"2024-05-15T14:27:58.882239+0000","last_unstale":"2024-05-15T14:48:56.959209+0000","last_undegraded":"2024-05-15T14:48:56.959209+0000","last_fullsized":"2024-05-15T14:48:56.959209+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:57.865922+0000","last_clean_scrub_stamp":"2024-05-15T14:27:57.865922+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":346,"num_read_kb":338,"num_write":194,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.140247+0000","last_change":"2024-05-15T14:49:11.140271+0000","last_active":"2024-05-15T14:49:11.140247+0000","last_peered":"2024-05-15T14:49:11.140247+0000","last_clean":"2024-05-15T14:49:11.140247+0000","last_became_active":"2024-05-15T14:28:00.886898+0000","last_became_peered":"2024-05-15T14:28:00.886898+0000","last_unstale":"2024-05-15T14:49:11.140247+0000","last_undegraded":"2024-05-15T14:49:11.140247+0000","last_fullsized":"2024-05-15T14:49:11.140247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:11.140161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:11.140161+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.140161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:21:44.609330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"39'13","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.596345+0000","last_change":"2024-05-15T14:49:02.596392+0000","last_active":"2024-05-15T14:49:02.596345+0000","last_peered":"2024-05-15T14:49:02.596345+0000","last_clean":"2024-05-15T14:49:02.596345+0000","last_became_active":"2024-05-15T14:28:02.890595+0000","last_became_peered":"2024-05-15T14:28:02.890595+0000","last_unstale":"2024-05-15T14:49:02.596345+0000","last_undegraded":"2024-05-15T14:49:02.596345+0000","last_fullsized":"2024-05-15T14:49:02.596345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'13","last_scrub_stamp":"2024-05-15T14:49:02.596237+0000","last_deep_scrub":"39'13","last_deep_scrub_stamp":"2024-05-15T14:49:02.596237+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.596237+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:22.841762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:42.429595+0000","last_change":"2024-05-15T14:31:16.597622+0000","last_active":"2024-05-15T14:47:42.429595+0000","last_peered":"2024-05-15T14:47:42.429595+0000","last_clean":"2024-05-15T14:47:42.429595+0000","last_became_active":"2024-05-15T14:31:16.597207+0000","last_became_peered":"2024-05-15T14:31:16.597207+0000","last_unstale":"2024-05-15T14:47:42.429595+0000","last_undegraded":"2024-05-15T14:47:42.429595+0000","last_fullsized":"2024-05-15T14:47:42.429595+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"39'94","reported_seq":209,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:54.296133+0000","last_change":"2024-05-15T14:27:52.852789+0000","last_active":"2024-05-15T14:47:54.296133+0000","last_peered":"2024-05-15T14:47:54.296133+0000","last_clean":"2024-05-15T14:47:54.296133+0000","last_became_active":"2024-05-15T14:27:52.852536+0000","last_became_peered":"2024-05-15T14:27:52.852536+0000","last_unstale":"2024-05-15T14:47:54.296133+0000","last_undegraded":"2024-05-15T14:47:54.296133+0000","last_fullsized":"2024-05-15T14:47:54.296133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":296,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"39'22","reported_seq":106,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:52.534690+0000","last_change":"2024-05-15T14:27:50.848136+0000","last_active":"2024-05-15T14:47:52.534690+0000","last_peered":"2024-05-15T14:47:52.534690+0000","last_clean":"2024-05-15T14:47:52.534690+0000","last_became_active":"2024-05-15T14:27:50.847850+0000","last_became_peered":"2024-05-15T14:27:50.847850+0000","last_unstale":"2024-05-15T14:47:52.534690+0000","last_undegraded":"2024-05-15T14:47:52.534690+0000","last_fullsized":"2024-05-15T14:47:52.534690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":44,"num_write":110,"num_write_kb":26471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"39'4","reported_seq":1319,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.188708+0000","last_change":"2024-05-15T14:49:20.188745+0000","last_active":"2024-05-15T14:49:20.188708+0000","last_peered":"2024-05-15T14:49:20.188708+0000","last_clean":"2024-05-15T14:49:20.188708+0000","last_became_active":"2024-05-15T14:27:56.879092+0000","last_became_peered":"2024-05-15T14:27:56.879092+0000","last_unstale":"2024-05-15T14:49:20.188708+0000","last_undegraded":"2024-05-15T14:49:20.188708+0000","last_fullsized":"2024-05-15T14:49:20.188708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:20.188613+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:20.188613+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.188613+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:54.028706+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1596,"num_read_kb":1594,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'235","reported_seq":404,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.658410+0000","last_change":"2024-05-15T14:49:10.658453+0000","last_active":"2024-05-15T14:49:10.658410+0000","last_peered":"2024-05-15T14:49:10.658410+0000","last_clean":"2024-05-15T14:49:10.658410+0000","last_became_active":"2024-05-15T14:27:58.882703+0000","last_became_peered":"2024-05-15T14:27:58.882703+0000","last_unstale":"2024-05-15T14:49:10.658410+0000","last_undegraded":"2024-05-15T14:49:10.658410+0000","last_fullsized":"2024-05-15T14:49:10.658410+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'235","last_scrub_stamp":"2024-05-15T14:49:10.658310+0000","last_deep_scrub":"39'235","last_deep_scrub_stamp":"2024-05-15T14:49:10.658310+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.658310+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:47.078696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":469,"num_write":437,"num_write_kb":1979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.387544+0000","last_change":"2024-05-15T14:49:06.387569+0000","last_active":"2024-05-15T14:49:06.387544+0000","last_peered":"2024-05-15T14:49:06.387544+0000","last_clean":"2024-05-15T14:49:06.387544+0000","last_became_active":"2024-05-15T14:28:00.884499+0000","last_became_peered":"2024-05-15T14:28:00.884499+0000","last_unstale":"2024-05-15T14:49:06.387544+0000","last_undegraded":"2024-05-15T14:49:06.387544+0000","last_fullsized":"2024-05-15T14:49:06.387544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.387416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.387416+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.387416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:35.420936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"39'19","reported_seq":62,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.861398+0000","last_change":"2024-05-15T14:49:10.861426+0000","last_active":"2024-05-15T14:49:10.861398+0000","last_peered":"2024-05-15T14:49:10.861398+0000","last_clean":"2024-05-15T14:49:10.861398+0000","last_became_active":"2024-05-15T14:28:02.895999+0000","last_became_peered":"2024-05-15T14:28:02.895999+0000","last_unstale":"2024-05-15T14:49:10.861398+0000","last_undegraded":"2024-05-15T14:49:10.861398+0000","last_fullsized":"2024-05-15T14:49:10.861398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'19","last_scrub_stamp":"2024-05-15T14:49:10.861308+0000","last_deep_scrub":"39'19","last_deep_scrub_stamp":"2024-05-15T14:49:10.861308+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.861308+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:20:05.506912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.533048+0000","last_change":"2024-05-15T14:31:16.593403+0000","last_active":"2024-05-15T14:48:12.533048+0000","last_peered":"2024-05-15T14:48:12.533048+0000","last_clean":"2024-05-15T14:48:12.533048+0000","last_became_active":"2024-05-15T14:31:16.593126+0000","last_became_peered":"2024-05-15T14:31:16.593126+0000","last_unstale":"2024-05-15T14:48:12.533048+0000","last_undegraded":"2024-05-15T14:48:12.533048+0000","last_fullsized":"2024-05-15T14:48:12.533048+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:12.420941+0000","last_change":"2024-05-15T14:27:52.844385+0000","last_active":"2024-05-15T14:47:12.420941+0000","last_peered":"2024-05-15T14:47:12.420941+0000","last_clean":"2024-05-15T14:47:12.420941+0000","last_became_active":"2024-05-15T14:27:52.844112+0000","last_became_peered":"2024-05-15T14:27:52.844112+0000","last_unstale":"2024-05-15T14:47:12.420941+0000","last_undegraded":"2024-05-15T14:47:12.420941+0000","last_fullsized":"2024-05-15T14:47:12.420941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"39'20","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.437791+0000","last_change":"2024-05-15T14:27:50.844543+0000","last_active":"2024-05-15T14:48:42.437791+0000","last_peered":"2024-05-15T14:48:42.437791+0000","last_clean":"2024-05-15T14:48:42.437791+0000","last_became_active":"2024-05-15T14:27:50.843701+0000","last_became_peered":"2024-05-15T14:27:50.843701+0000","last_unstale":"2024-05-15T14:48:42.437791+0000","last_undegraded":"2024-05-15T14:48:42.437791+0000","last_fullsized":"2024-05-15T14:48:42.437791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":100,"num_write_kb":23517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.095887+0000","last_change":"2024-05-15T14:49:02.095906+0000","last_active":"2024-05-15T14:49:02.095887+0000","last_peered":"2024-05-15T14:49:02.095887+0000","last_clean":"2024-05-15T14:49:02.095887+0000","last_became_active":"2024-05-15T14:27:56.883534+0000","last_became_peered":"2024-05-15T14:27:56.883534+0000","last_unstale":"2024-05-15T14:49:02.095887+0000","last_undegraded":"2024-05-15T14:49:02.095887+0000","last_fullsized":"2024-05-15T14:49:02.095887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:02.095799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:02.095799+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.095799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:14:42.041400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"39'327","reported_seq":542,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.407498+0000","last_change":"2024-05-15T14:49:03.407537+0000","last_active":"2024-05-15T14:49:03.407498+0000","last_peered":"2024-05-15T14:49:03.407498+0000","last_clean":"2024-05-15T14:49:03.407498+0000","last_became_active":"2024-05-15T14:27:58.885479+0000","last_became_peered":"2024-05-15T14:27:58.885479+0000","last_unstale":"2024-05-15T14:49:03.407498+0000","last_undegraded":"2024-05-15T14:49:03.407498+0000","last_fullsized":"2024-05-15T14:49:03.407498+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'327","last_scrub_stamp":"2024-05-15T14:49:03.407417+0000","last_deep_scrub":"39'327","last_deep_scrub_stamp":"2024-05-15T14:49:03.407417+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.407417+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:33.672132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":606,"num_write":518,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.127126+0000","last_change":"2024-05-15T14:49:10.127153+0000","last_active":"2024-05-15T14:49:10.127126+0000","last_peered":"2024-05-15T14:49:10.127126+0000","last_clean":"2024-05-15T14:49:10.127126+0000","last_became_active":"2024-05-15T14:28:00.885171+0000","last_became_peered":"2024-05-15T14:28:00.885171+0000","last_unstale":"2024-05-15T14:49:10.127126+0000","last_undegraded":"2024-05-15T14:49:10.127126+0000","last_fullsized":"2024-05-15T14:49:10.127126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:10.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:10.127026+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:33.506895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'26","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.977441+0000","last_change":"2024-05-15T14:28:02.888549+0000","last_active":"2024-05-15T14:49:01.977441+0000","last_peered":"2024-05-15T14:49:01.977441+0000","last_clean":"2024-05-15T14:49:01.977441+0000","last_became_active":"2024-05-15T14:28:02.888247+0000","last_became_peered":"2024-05-15T14:28:02.888247+0000","last_unstale":"2024-05-15T14:49:01.977441+0000","last_undegraded":"2024-05-15T14:49:01.977441+0000","last_fullsized":"2024-05-15T14:49:01.977441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:28:01.873141+0000","last_clean_scrub_stamp":"2024-05-15T14:28:01.873141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":30,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"39'16","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.075022+0000","last_change":"2024-05-15T14:49:11.075052+0000","last_active":"2024-05-15T14:49:11.075022+0000","last_peered":"2024-05-15T14:49:11.075022+0000","last_clean":"2024-05-15T14:49:11.075022+0000","last_became_active":"2024-05-15T14:27:52.844292+0000","last_became_peered":"2024-05-15T14:27:52.844292+0000","last_unstale":"2024-05-15T14:49:11.075022+0000","last_undegraded":"2024-05-15T14:49:11.075022+0000","last_fullsized":"2024-05-15T14:49:11.075022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:11.074913+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:11.074913+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.074913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:37.502702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"39'20","reported_seq":108,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.149154+0000","last_change":"2024-05-15T14:49:19.149192+0000","last_active":"2024-05-15T14:49:19.149154+0000","last_peered":"2024-05-15T14:49:19.149154+0000","last_clean":"2024-05-15T14:49:19.149154+0000","last_became_active":"2024-05-15T14:27:50.853042+0000","last_became_peered":"2024-05-15T14:27:50.853042+0000","last_unstale":"2024-05-15T14:49:19.149154+0000","last_undegraded":"2024-05-15T14:49:19.149154+0000","last_fullsized":"2024-05-15T14:49:19.149154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:19.149063+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:19.149063+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.149063+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:12.578395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":35,"num_write":92,"num_write_kb":30554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"39'20","reported_seq":121,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.060027+0000","last_change":"2024-05-15T14:49:15.060054+0000","last_active":"2024-05-15T14:49:15.060027+0000","last_peered":"2024-05-15T14:49:15.060027+0000","last_clean":"2024-05-15T14:49:15.060027+0000","last_became_active":"2024-05-15T14:27:52.840716+0000","last_became_peered":"2024-05-15T14:27:52.840716+0000","last_unstale":"2024-05-15T14:49:15.060027+0000","last_undegraded":"2024-05-15T14:49:15.060027+0000","last_fullsized":"2024-05-15T14:49:15.060027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:15.059932+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:15.059932+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.059932+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:56.592681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"39'16","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.508457+0000","last_change":"2024-05-15T14:49:20.508498+0000","last_active":"2024-05-15T14:49:20.508457+0000","last_peered":"2024-05-15T14:49:20.508457+0000","last_clean":"2024-05-15T14:49:20.508457+0000","last_became_active":"2024-05-15T14:28:38.450578+0000","last_became_peered":"2024-05-15T14:28:38.450578+0000","last_unstale":"2024-05-15T14:49:20.508457+0000","last_undegraded":"2024-05-15T14:49:20.508457+0000","last_fullsized":"2024-05-15T14:49:20.508457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.508362+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.508362+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.508362+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:16.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"39'26","reported_seq":119,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.072778+0000","last_change":"2024-05-15T14:49:15.072811+0000","last_active":"2024-05-15T14:49:15.072778+0000","last_peered":"2024-05-15T14:49:15.072778+0000","last_clean":"2024-05-15T14:49:15.072778+0000","last_became_active":"2024-05-15T14:27:52.841192+0000","last_became_peered":"2024-05-15T14:27:52.841192+0000","last_unstale":"2024-05-15T14:49:15.072778+0000","last_undegraded":"2024-05-15T14:49:15.072778+0000","last_fullsized":"2024-05-15T14:49:15.072778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.072647+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.072647+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.072647+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:35.318172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":93,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"39'18","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432096+0000","last_change":"2024-05-15T14:28:38.450889+0000","last_active":"2024-05-15T14:48:42.432096+0000","last_peered":"2024-05-15T14:48:42.432096+0000","last_clean":"2024-05-15T14:48:42.432096+0000","last_became_active":"2024-05-15T14:28:38.450592+0000","last_became_peered":"2024-05-15T14:28:38.450592+0000","last_unstale":"2024-05-15T14:48:42.432096+0000","last_undegraded":"2024-05-15T14:48:42.432096+0000","last_fullsized":"2024-05-15T14:48:42.432096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"39'72","reported_seq":150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427792+0000","last_change":"2024-05-15T14:28:37.941694+0000","last_active":"2024-05-15T14:48:07.427792+0000","last_peered":"2024-05-15T14:48:07.427792+0000","last_clean":"2024-05-15T14:48:07.427792+0000","last_became_active":"2024-05-15T14:28:37.941389+0000","last_became_peered":"2024-05-15T14:28:37.941389+0000","last_unstale":"2024-05-15T14:48:07.427792+0000","last_undegraded":"2024-05-15T14:48:07.427792+0000","last_fullsized":"2024-05-15T14:48:07.427792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":236,"num_write":102,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"39'18","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438313+0000","last_change":"2024-05-15T14:27:50.849038+0000","last_active":"2024-05-15T14:48:47.438313+0000","last_peered":"2024-05-15T14:48:47.438313+0000","last_clean":"2024-05-15T14:48:47.438313+0000","last_became_active":"2024-05-15T14:27:50.848763+0000","last_became_peered":"2024-05-15T14:27:50.848763+0000","last_unstale":"2024-05-15T14:48:47.438313+0000","last_undegraded":"2024-05-15T14:48:47.438313+0000","last_fullsized":"2024-05-15T14:48:47.438313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":82,"num_write_kb":24675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"39'82","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.667759+0000","last_change":"2024-05-15T14:49:21.667789+0000","last_active":"2024-05-15T14:49:21.667759+0000","last_peered":"2024-05-15T14:49:21.667759+0000","last_clean":"2024-05-15T14:49:21.667759+0000","last_became_active":"2024-05-15T14:27:52.851068+0000","last_became_peered":"2024-05-15T14:27:52.851068+0000","last_unstale":"2024-05-15T14:49:21.667759+0000","last_undegraded":"2024-05-15T14:49:21.667759+0000","last_fullsized":"2024-05-15T14:49:21.667759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'82","last_scrub_stamp":"2024-05-15T14:49:21.667665+0000","last_deep_scrub":"39'82","last_deep_scrub_stamp":"2024-05-15T14:49:21.667665+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.667665+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:27.464154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":322,"num_read_kb":258,"num_write":116,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"39'10","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.530939+0000","last_change":"2024-05-15T14:27:50.847365+0000","last_active":"2024-05-15T14:47:22.530939+0000","last_peered":"2024-05-15T14:47:22.530939+0000","last_clean":"2024-05-15T14:47:22.530939+0000","last_became_active":"2024-05-15T14:27:50.847042+0000","last_became_peered":"2024-05-15T14:27:50.847042+0000","last_unstale":"2024-05-15T14:47:22.530939+0000","last_undegraded":"2024-05-15T14:47:22.530939+0000","last_fullsized":"2024-05-15T14:47:22.530939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'66","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432085+0000","last_change":"2024-05-15T14:27:52.847215+0000","last_active":"2024-05-15T14:48:42.432085+0000","last_peered":"2024-05-15T14:48:42.432085+0000","last_clean":"2024-05-15T14:48:42.432085+0000","last_became_active":"2024-05-15T14:27:52.846918+0000","last_became_peered":"2024-05-15T14:27:52.846918+0000","last_unstale":"2024-05-15T14:48:42.432085+0000","last_undegraded":"2024-05-15T14:48:42.432085+0000","last_fullsized":"2024-05-15T14:48:42.432085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":226,"num_write":90,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"39'16","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.427302+0000","last_change":"2024-05-15T14:27:50.850495+0000","last_active":"2024-05-15T14:47:22.427302+0000","last_peered":"2024-05-15T14:47:22.427302+0000","last_clean":"2024-05-15T14:47:22.427302+0000","last_became_active":"2024-05-15T14:27:50.849910+0000","last_became_peered":"2024-05-15T14:27:50.849910+0000","last_unstale":"2024-05-15T14:47:22.427302+0000","last_undegraded":"2024-05-15T14:47:22.427302+0000","last_fullsized":"2024-05-15T14:47:22.427302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.650883+0000","last_change":"2024-05-15T14:49:20.650911+0000","last_active":"2024-05-15T14:49:20.650883+0000","last_peered":"2024-05-15T14:49:20.650883+0000","last_clean":"2024-05-15T14:49:20.650883+0000","last_became_active":"2024-05-15T14:27:52.862227+0000","last_became_peered":"2024-05-15T14:27:52.862227+0000","last_unstale":"2024-05-15T14:49:20.650883+0000","last_undegraded":"2024-05-15T14:49:20.650883+0000","last_fullsized":"2024-05-15T14:49:20.650883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-05-15T14:49:20.650774+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-05-15T14:49:20.650774+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.650774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:11.656167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"39'14","reported_seq":94,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.421817+0000","last_change":"2024-05-15T14:28:37.942575+0000","last_active":"2024-05-15T14:47:22.421817+0000","last_peered":"2024-05-15T14:47:22.421817+0000","last_clean":"2024-05-15T14:47:22.421817+0000","last_became_active":"2024-05-15T14:28:37.942198+0000","last_became_peered":"2024-05-15T14:28:37.942198+0000","last_unstale":"2024-05-15T14:47:22.421817+0000","last_undegraded":"2024-05-15T14:47:22.421817+0000","last_fullsized":"2024-05-15T14:47:22.421817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"39'16","reported_seq":109,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.110507+0000","last_change":"2024-05-15T14:49:20.110542+0000","last_active":"2024-05-15T14:49:20.110507+0000","last_peered":"2024-05-15T14:49:20.110507+0000","last_clean":"2024-05-15T14:49:20.110507+0000","last_became_active":"2024-05-15T14:27:52.840941+0000","last_became_peered":"2024-05-15T14:27:52.840941+0000","last_unstale":"2024-05-15T14:49:20.110507+0000","last_undegraded":"2024-05-15T14:49:20.110507+0000","last_fullsized":"2024-05-15T14:49:20.110507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.110386+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.110386+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.110386+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:46.960664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"39'16","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:22.530987+0000","last_change":"2024-05-15T14:27:50.849503+0000","last_active":"2024-05-15T14:47:22.530987+0000","last_peered":"2024-05-15T14:47:22.530987+0000","last_clean":"2024-05-15T14:47:22.530987+0000","last_became_active":"2024-05-15T14:27:50.847998+0000","last_became_peered":"2024-05-15T14:27:50.847998+0000","last_unstale":"2024-05-15T14:47:22.530987+0000","last_undegraded":"2024-05-15T14:47:22.530987+0000","last_fullsized":"2024-05-15T14:47:22.530987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"39'8","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.150410+0000","last_change":"2024-05-15T14:49:20.150486+0000","last_active":"2024-05-15T14:49:20.150410+0000","last_peered":"2024-05-15T14:49:20.150410+0000","last_clean":"2024-05-15T14:49:20.150410+0000","last_became_active":"2024-05-15T14:27:52.852947+0000","last_became_peered":"2024-05-15T14:27:52.852947+0000","last_unstale":"2024-05-15T14:49:20.150410+0000","last_undegraded":"2024-05-15T14:49:20.150410+0000","last_fullsized":"2024-05-15T14:49:20.150410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:20.150300+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:20.150300+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.150300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:02.975219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"39'14","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.028262+0000","last_change":"2024-05-15T14:27:50.856154+0000","last_active":"2024-05-15T14:48:26.028262+0000","last_peered":"2024-05-15T14:48:26.028262+0000","last_clean":"2024-05-15T14:48:26.028262+0000","last_became_active":"2024-05-15T14:27:50.855927+0000","last_became_peered":"2024-05-15T14:27:50.855927+0000","last_unstale":"2024-05-15T14:48:26.028262+0000","last_undegraded":"2024-05-15T14:48:26.028262+0000","last_fullsized":"2024-05-15T14:48:26.028262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24,"num_write":62,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"39'24","reported_seq":119,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.304690+0000","last_change":"2024-05-15T14:49:09.304727+0000","last_active":"2024-05-15T14:49:09.304690+0000","last_peered":"2024-05-15T14:49:09.304690+0000","last_clean":"2024-05-15T14:49:09.304690+0000","last_became_active":"2024-05-15T14:27:52.853857+0000","last_became_peered":"2024-05-15T14:27:52.853857+0000","last_unstale":"2024-05-15T14:49:09.304690+0000","last_undegraded":"2024-05-15T14:49:09.304690+0000","last_fullsized":"2024-05-15T14:49:09.304690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:09.304568+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:09.304568+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.304568+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:50.837317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":91,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"39'18","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.536636+0000","last_change":"2024-05-15T14:27:50.844170+0000","last_active":"2024-05-15T14:48:07.536636+0000","last_peered":"2024-05-15T14:48:07.536636+0000","last_clean":"2024-05-15T14:48:07.536636+0000","last_became_active":"2024-05-15T14:27:50.843874+0000","last_became_peered":"2024-05-15T14:27:50.843874+0000","last_unstale":"2024-05-15T14:48:07.536636+0000","last_undegraded":"2024-05-15T14:48:07.536636+0000","last_fullsized":"2024-05-15T14:48:07.536636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"39'58","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.314239+0000","last_change":"2024-05-15T14:49:09.314267+0000","last_active":"2024-05-15T14:49:09.314239+0000","last_peered":"2024-05-15T14:49:09.314239+0000","last_clean":"2024-05-15T14:49:09.314239+0000","last_became_active":"2024-05-15T14:27:52.847362+0000","last_became_peered":"2024-05-15T14:27:52.847362+0000","last_unstale":"2024-05-15T14:49:09.314239+0000","last_undegraded":"2024-05-15T14:49:09.314239+0000","last_fullsized":"2024-05-15T14:49:09.314239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'58","last_scrub_stamp":"2024-05-15T14:49:09.314142+0000","last_deep_scrub":"39'58","last_deep_scrub_stamp":"2024-05-15T14:49:09.314142+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.314142+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:37:44.576275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":172,"num_write":84,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"39'12","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427773+0000","last_change":"2024-05-15T14:27:50.846611+0000","last_active":"2024-05-15T14:48:07.427773+0000","last_peered":"2024-05-15T14:48:07.427773+0000","last_clean":"2024-05-15T14:48:07.427773+0000","last_became_active":"2024-05-15T14:27:50.846291+0000","last_became_peered":"2024-05-15T14:27:50.846291+0000","last_unstale":"2024-05-15T14:48:07.427773+0000","last_undegraded":"2024-05-15T14:48:07.427773+0000","last_fullsized":"2024-05-15T14:48:07.427773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":14702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"39'74","reported_seq":193,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.427801+0000","last_change":"2024-05-15T14:27:52.848460+0000","last_active":"2024-05-15T14:48:07.427801+0000","last_peered":"2024-05-15T14:48:07.427801+0000","last_clean":"2024-05-15T14:48:07.427801+0000","last_became_active":"2024-05-15T14:27:52.848173+0000","last_became_peered":"2024-05-15T14:27:52.848173+0000","last_unstale":"2024-05-15T14:48:07.427801+0000","last_undegraded":"2024-05-15T14:48:07.427801+0000","last_fullsized":"2024-05-15T14:48:07.427801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:51.826537+0000","last_clean_scrub_stamp":"2024-05-15T14:27:51.826537+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":248,"num_write":102,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"39'16","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:07.433482+0000","last_change":"2024-05-15T14:27:50.847115+0000","last_active":"2024-05-15T14:48:07.433482+0000","last_peered":"2024-05-15T14:48:07.433482+0000","last_clean":"2024-05-15T14:48:07.433482+0000","last_became_active":"2024-05-15T14:27:50.846782+0000","last_became_peered":"2024-05-15T14:27:50.846782+0000","last_unstale":"2024-05-15T14:48:07.433482+0000","last_undegraded":"2024-05-15T14:48:07.433482+0000","last_fullsized":"2024-05-15T14:48:07.433482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"39'30","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.850454+0000","last_change":"2024-05-15T14:49:13.850479+0000","last_active":"2024-05-15T14:49:13.850454+0000","last_peered":"2024-05-15T14:49:13.850454+0000","last_clean":"2024-05-15T14:49:13.850454+0000","last_became_active":"2024-05-15T14:27:52.851642+0000","last_became_peered":"2024-05-15T14:27:52.851642+0000","last_unstale":"2024-05-15T14:49:13.850454+0000","last_undegraded":"2024-05-15T14:49:13.850454+0000","last_fullsized":"2024-05-15T14:49:13.850454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2024-05-15T14:49:13.850366+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2024-05-15T14:49:13.850366+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.850366+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:06.992558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":127,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"39'26","reported_seq":120,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.078023+0000","last_change":"2024-05-15T14:49:15.078070+0000","last_active":"2024-05-15T14:49:15.078023+0000","last_peered":"2024-05-15T14:49:15.078023+0000","last_clean":"2024-05-15T14:49:15.078023+0000","last_became_active":"2024-05-15T14:27:50.840467+0000","last_became_peered":"2024-05-15T14:27:50.840467+0000","last_unstale":"2024-05-15T14:49:15.078023+0000","last_undegraded":"2024-05-15T14:49:15.078023+0000","last_fullsized":"2024-05-15T14:49:15.078023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.077923+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.077923+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.077923+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:14.720369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"39'92","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.171104+0000","last_change":"2024-05-15T14:49:19.171130+0000","last_active":"2024-05-15T14:49:19.171104+0000","last_peered":"2024-05-15T14:49:19.171104+0000","last_clean":"2024-05-15T14:49:19.171104+0000","last_became_active":"2024-05-15T14:27:52.859926+0000","last_became_peered":"2024-05-15T14:27:52.859926+0000","last_unstale":"2024-05-15T14:49:19.171104+0000","last_undegraded":"2024-05-15T14:49:19.171104+0000","last_fullsized":"2024-05-15T14:49:19.171104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2024-05-15T14:49:19.171010+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2024-05-15T14:49:19.171010+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.171010+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:55.591396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":270,"num_write":132,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"39'24","reported_seq":106,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:26.025463+0000","last_change":"2024-05-15T14:27:50.850215+0000","last_active":"2024-05-15T14:48:26.025463+0000","last_peered":"2024-05-15T14:48:26.025463+0000","last_clean":"2024-05-15T14:48:26.025463+0000","last_became_active":"2024-05-15T14:27:50.849936+0000","last_became_peered":"2024-05-15T14:27:50.849936+0000","last_unstale":"2024-05-15T14:48:26.025463+0000","last_undegraded":"2024-05-15T14:48:26.025463+0000","last_fullsized":"2024-05-15T14:48:26.025463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":112,"num_write_kb":36442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"39'62","reported_seq":171,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.630250+0000","last_change":"2024-05-15T14:49:19.630277+0000","last_active":"2024-05-15T14:49:19.630250+0000","last_peered":"2024-05-15T14:49:19.630250+0000","last_clean":"2024-05-15T14:49:19.630250+0000","last_became_active":"2024-05-15T14:27:52.856767+0000","last_became_peered":"2024-05-15T14:27:52.856767+0000","last_unstale":"2024-05-15T14:49:19.630250+0000","last_undegraded":"2024-05-15T14:49:19.630250+0000","last_fullsized":"2024-05-15T14:49:19.630250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'62","last_scrub_stamp":"2024-05-15T14:49:19.630152+0000","last_deep_scrub":"39'62","last_deep_scrub_stamp":"2024-05-15T14:49:19.630152+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.630152+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:26:20.896798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":205,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"39'18","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.338853+0000","last_change":"2024-05-15T14:49:07.338895+0000","last_active":"2024-05-15T14:49:07.338853+0000","last_peered":"2024-05-15T14:49:07.338853+0000","last_clean":"2024-05-15T14:49:07.338853+0000","last_became_active":"2024-05-15T14:27:50.842512+0000","last_became_peered":"2024-05-15T14:27:50.842512+0000","last_unstale":"2024-05-15T14:49:07.338853+0000","last_undegraded":"2024-05-15T14:49:07.338853+0000","last_fullsized":"2024-05-15T14:49:07.338853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:07.338747+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:07.338747+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.338747+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:29.168239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"39'56","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.881425+0000","last_change":"2024-05-15T14:49:12.881484+0000","last_active":"2024-05-15T14:49:12.881425+0000","last_peered":"2024-05-15T14:49:12.881425+0000","last_clean":"2024-05-15T14:49:12.881425+0000","last_became_active":"2024-05-15T14:27:52.854841+0000","last_became_peered":"2024-05-15T14:27:52.854841+0000","last_unstale":"2024-05-15T14:49:12.881425+0000","last_undegraded":"2024-05-15T14:49:12.881425+0000","last_fullsized":"2024-05-15T14:49:12.881425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'56","last_scrub_stamp":"2024-05-15T14:49:12.881296+0000","last_deep_scrub":"39'56","last_deep_scrub_stamp":"2024-05-15T14:49:12.881296+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.881296+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:54:16.688582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":78,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"39'20","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433402+0000","last_change":"2024-05-15T14:27:50.848570+0000","last_active":"2024-05-15T14:48:52.433402+0000","last_peered":"2024-05-15T14:48:52.433402+0000","last_clean":"2024-05-15T14:48:52.433402+0000","last_became_active":"2024-05-15T14:27:50.848291+0000","last_became_peered":"2024-05-15T14:27:50.848291+0000","last_unstale":"2024-05-15T14:48:52.433402+0000","last_undegraded":"2024-05-15T14:48:52.433402+0000","last_fullsized":"2024-05-15T14:48:52.433402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":40,"num_write":100,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"39'18","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:52.433287+0000","last_change":"2024-05-15T14:27:50.842699+0000","last_active":"2024-05-15T14:48:52.433287+0000","last_peered":"2024-05-15T14:48:52.433287+0000","last_clean":"2024-05-15T14:48:52.433287+0000","last_became_active":"2024-05-15T14:27:50.842420+0000","last_became_peered":"2024-05-15T14:27:50.842420+0000","last_unstale":"2024-05-15T14:48:52.433287+0000","last_undegraded":"2024-05-15T14:48:52.433287+0000","last_fullsized":"2024-05-15T14:48:52.433287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:27:49.817353+0000","last_clean_scrub_stamp":"2024-05-15T14:27:49.817353+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":90,"num_write_kb":20587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'14","reported_seq":106,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.203974+0000","last_change":"2024-05-15T14:49:18.204045+0000","last_active":"2024-05-15T14:49:18.203974+0000","last_peered":"2024-05-15T14:49:18.203974+0000","last_clean":"2024-05-15T14:49:18.203974+0000","last_became_active":"2024-05-15T14:27:52.853329+0000","last_became_peered":"2024-05-15T14:27:52.853329+0000","last_unstale":"2024-05-15T14:49:18.203974+0000","last_undegraded":"2024-05-15T14:49:18.203974+0000","last_fullsized":"2024-05-15T14:49:18.203974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:18.203851+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:18.203851+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.203851+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:29:03.913933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.971863+0000","last_change":"2024-05-15T14:49:20.971893+0000","last_active":"2024-05-15T14:49:20.971863+0000","last_peered":"2024-05-15T14:49:20.971863+0000","last_clean":"2024-05-15T14:49:20.971863+0000","last_became_active":"2024-05-15T14:27:50.839496+0000","last_became_peered":"2024-05-15T14:27:50.839496+0000","last_unstale":"2024-05-15T14:49:20.971863+0000","last_undegraded":"2024-05-15T14:49:20.971863+0000","last_fullsized":"2024-05-15T14:49:20.971863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.971755+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.971755+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.971755+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:44.351624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":17647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"39'70","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.109280+0000","last_change":"2024-05-15T14:49:18.109324+0000","last_active":"2024-05-15T14:49:18.109280+0000","last_peered":"2024-05-15T14:49:18.109280+0000","last_clean":"2024-05-15T14:49:18.109280+0000","last_became_active":"2024-05-15T14:27:52.851973+0000","last_became_peered":"2024-05-15T14:27:52.851973+0000","last_unstale":"2024-05-15T14:49:18.109280+0000","last_undegraded":"2024-05-15T14:49:18.109280+0000","last_fullsized":"2024-05-15T14:49:18.109280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'70","last_scrub_stamp":"2024-05-15T14:49:18.109179+0000","last_deep_scrub":"39'70","last_deep_scrub_stamp":"2024-05-15T14:49:18.109179+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.109179+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:59.326269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":234,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3423,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1381,"num_read_kb":1449,"num_write":1045,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":6846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":845,"ondisk_log_size":845,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11724,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":2162820,"num_read_kb":7062227,"num_write":12291,"num_write_kb":15784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25484,"num_omap_keys":66,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":14929,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5671,"num_read_kb":6915,"num_write":192,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":29858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9598,"num_read_kb":7988,"num_write":3212,"num_write_kb":1308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2246,"ondisk_log_size":2246,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2611,"num_read_kb":1724,"num_write":4445,"num_write_kb":1235021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575110,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40588,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331252,"statfs":{"total":96636764160,"available":96595202048,"internally_reserved":0,"allocated":1118208,"data_stored":815108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575111,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":487424,"data_stored":221551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575110,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44180,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327660,"statfs":{"total":96636764160,"available":96591523840,"internally_reserved":0,"allocated":536576,"data_stored":225223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575111,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":227462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575111,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45584,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326256,"statfs":{"total":96636764160,"available":96590086144,"internally_reserved":0,"allocated":532480,"data_stored":222205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575111,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":491520,"data_stored":224011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575111,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":222247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575112,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1118208,"data_stored":816897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":68,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:49:24.160 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.160 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.161 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.161 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.161 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.161 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.162 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.162 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.162 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.162 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.162 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.163 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.163 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.163 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.163 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.163 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.164 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.164 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.164 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.164 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.164 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.164 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.165 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.165 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.165 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.165 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.165 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.165 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.166 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.166 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.166 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.166 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.166 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.167 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.167 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.167 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.167 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.167 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.167 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.168 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.168 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.168 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.168 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.168 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.169 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.169 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.169 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-15T14:27:59.869572+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=59, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.169 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.169 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.169 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.170 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.170 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.170 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-15T14:27:42.789461+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.170 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.170 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.170 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.171 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.171 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.171 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.171 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.171 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.172 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.172 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.172 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.172 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.172 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.173 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.173 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.173 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.173 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-15T14:27:43.793466+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=43, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.173 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.174 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.174 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.174 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.174 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.174 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.174 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.175 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.175 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.175 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.175 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.175 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.176 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.176 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.176 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.176 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.176 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.177 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.177 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.177 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.177 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.177 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.177 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.178 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.178 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.178 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.178 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.178 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.179 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.179 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.179 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.179 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.179 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.179 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.180 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.180 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.180 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-15T14:27:55.862227+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.181 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-15T14:27:57.865922+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=57, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.181 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.181 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.181 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.181 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.182 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.182 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.182 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-15T14:28:01.873141+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=28, tm_sec=1, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.182 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.183 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.183 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.183 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.183 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.183 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.183 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.184 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.184 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.184 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.184 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.184 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-15T14:27:51.826537+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=51, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.184 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.185 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.185 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.185 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-15T14:27:49.817353+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=27, tm_sec=49, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:24.185 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T14:49:44.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:49:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:49:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:49:44.540 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":692,"stamp":"2024-05-15T14:49:42.785388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620444,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":2182158,"num_read_kb":7080366,"num_write":21294,"num_write_kb":1254163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30692,"num_omap_keys":82,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6401,"ondisk_log_size":6401,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285128,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":279859,"kb_avail":754689592,"statfs":{"total":773094113280,"available":772802142208,"internally_reserved":0,"allocated":5316608,"data_stored":2974704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":286576177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3966,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003730"},"pg_stats":[{"pgid":"3.3f","version":"39'26","reported_seq":120,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:35.537286+0000","last_change":"2024-05-15T14:49:35.537327+0000","last_active":"2024-05-15T14:49:35.537286+0000","last_peered":"2024-05-15T14:49:35.537286+0000","last_clean":"2024-05-15T14:49:35.537286+0000","last_became_active":"2024-05-15T14:27:50.849951+0000","last_became_peered":"2024-05-15T14:27:50.849951+0000","last_unstale":"2024-05-15T14:49:35.537286+0000","last_undegraded":"2024-05-15T14:49:35.537286+0000","last_fullsized":"2024-05-15T14:49:35.537286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:35.537148+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:35.537148+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.537148+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:12:27.131142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'2","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.065623+0000","last_change":"2024-05-15T14:49:16.065651+0000","last_active":"2024-05-15T14:49:16.065623+0000","last_peered":"2024-05-15T14:49:16.065623+0000","last_clean":"2024-05-15T14:49:16.065623+0000","last_became_active":"2024-05-15T14:27:52.843836+0000","last_became_peered":"2024-05-15T14:27:52.843836+0000","last_unstale":"2024-05-15T14:49:16.065623+0000","last_undegraded":"2024-05-15T14:49:16.065623+0000","last_fullsized":"2024-05-15T14:49:16.065623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:16.065521+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:16.065521+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.065521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:34:56.257057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"39'10","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.005891+0000","last_change":"2024-05-15T14:49:20.005922+0000","last_active":"2024-05-15T14:49:20.005891+0000","last_peered":"2024-05-15T14:49:20.005891+0000","last_clean":"2024-05-15T14:49:20.005891+0000","last_became_active":"2024-05-15T14:27:50.837321+0000","last_became_peered":"2024-05-15T14:27:50.837321+0000","last_unstale":"2024-05-15T14:49:20.005891+0000","last_undegraded":"2024-05-15T14:49:20.005891+0000","last_fullsized":"2024-05-15T14:49:20.005891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:20.005776+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:20.005776+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.005776+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:43.743219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":50,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"39'10","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.835870+0000","last_change":"2024-05-15T14:49:15.835898+0000","last_active":"2024-05-15T14:49:15.835870+0000","last_peered":"2024-05-15T14:49:15.835870+0000","last_clean":"2024-05-15T14:49:15.835870+0000","last_became_active":"2024-05-15T14:27:52.840977+0000","last_became_peered":"2024-05-15T14:27:52.840977+0000","last_unstale":"2024-05-15T14:49:15.835870+0000","last_undegraded":"2024-05-15T14:49:15.835870+0000","last_fullsized":"2024-05-15T14:49:15.835870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:15.835781+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:15.835781+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.835781+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:02:18.086441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"39'8","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.349003+0000","last_change":"2024-05-15T14:49:37.349033+0000","last_active":"2024-05-15T14:49:37.349003+0000","last_peered":"2024-05-15T14:49:37.349003+0000","last_clean":"2024-05-15T14:49:37.349003+0000","last_became_active":"2024-05-15T14:27:50.844989+0000","last_became_peered":"2024-05-15T14:27:50.844989+0000","last_unstale":"2024-05-15T14:49:37.349003+0000","last_undegraded":"2024-05-15T14:49:37.349003+0000","last_fullsized":"2024-05-15T14:49:37.349003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:37.348904+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:37.348904+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.348904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:06.760470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'24","reported_seq":133,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.243441+0000","last_change":"2024-05-15T14:49:17.243471+0000","last_active":"2024-05-15T14:49:17.243441+0000","last_peered":"2024-05-15T14:49:17.243441+0000","last_clean":"2024-05-15T14:49:17.243441+0000","last_became_active":"2024-05-15T14:27:52.850449+0000","last_became_peered":"2024-05-15T14:27:52.850449+0000","last_unstale":"2024-05-15T14:49:17.243441+0000","last_undegraded":"2024-05-15T14:49:17.243441+0000","last_fullsized":"2024-05-15T14:49:17.243441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:17.243328+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:17.243328+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.243328+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:31.226320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":101,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"39'22","reported_seq":112,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.042792+0000","last_change":"2024-05-15T14:49:25.042820+0000","last_active":"2024-05-15T14:49:25.042792+0000","last_peered":"2024-05-15T14:49:25.042792+0000","last_clean":"2024-05-15T14:49:25.042792+0000","last_became_active":"2024-05-15T14:27:50.851846+0000","last_became_peered":"2024-05-15T14:27:50.851846+0000","last_unstale":"2024-05-15T14:49:25.042792+0000","last_undegraded":"2024-05-15T14:49:25.042792+0000","last_fullsized":"2024-05-15T14:49:25.042792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:25.042676+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:25.042676+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.042676+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:34.406768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":27630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"39'4","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.149849+0000","last_change":"2024-05-15T14:49:16.149877+0000","last_active":"2024-05-15T14:49:16.149849+0000","last_peered":"2024-05-15T14:49:16.149849+0000","last_clean":"2024-05-15T14:49:16.149849+0000","last_became_active":"2024-05-15T14:27:52.854481+0000","last_became_peered":"2024-05-15T14:27:52.854481+0000","last_unstale":"2024-05-15T14:49:16.149849+0000","last_undegraded":"2024-05-15T14:49:16.149849+0000","last_fullsized":"2024-05-15T14:49:16.149849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:16.149743+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:16.149743+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.149743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:32.252193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"39'8","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.737453+0000","last_change":"2024-05-15T14:49:19.737479+0000","last_active":"2024-05-15T14:49:19.737453+0000","last_peered":"2024-05-15T14:49:19.737453+0000","last_clean":"2024-05-15T14:49:19.737453+0000","last_became_active":"2024-05-15T14:27:50.851756+0000","last_became_peered":"2024-05-15T14:27:50.851756+0000","last_unstale":"2024-05-15T14:49:19.737453+0000","last_undegraded":"2024-05-15T14:49:19.737453+0000","last_fullsized":"2024-05-15T14:49:19.737453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:19.737363+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:19.737363+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.737363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:00.148124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14,"num_write":40,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"39'8","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.144271+0000","last_change":"2024-05-15T14:49:12.144299+0000","last_active":"2024-05-15T14:49:12.144271+0000","last_peered":"2024-05-15T14:49:12.144271+0000","last_clean":"2024-05-15T14:49:12.144271+0000","last_became_active":"2024-05-15T14:27:52.844904+0000","last_became_peered":"2024-05-15T14:27:52.844904+0000","last_unstale":"2024-05-15T14:49:12.144271+0000","last_undegraded":"2024-05-15T14:49:12.144271+0000","last_fullsized":"2024-05-15T14:49:12.144271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:12.144177+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:12.144177+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.144177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:07.442839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"39'8","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.050513+0000","last_change":"2024-05-15T14:49:37.050535+0000","last_active":"2024-05-15T14:49:37.050513+0000","last_peered":"2024-05-15T14:49:37.050513+0000","last_clean":"2024-05-15T14:49:37.050513+0000","last_became_active":"2024-05-15T14:27:50.847121+0000","last_became_peered":"2024-05-15T14:27:50.847121+0000","last_unstale":"2024-05-15T14:49:37.050513+0000","last_undegraded":"2024-05-15T14:49:37.050513+0000","last_fullsized":"2024-05-15T14:49:37.050513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:37.050420+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:37.050420+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.050420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:07:57.844151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":24,"num_write_kb":14074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'100","reported_seq":217,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.162647+0000","last_change":"2024-05-15T14:49:19.162673+0000","last_active":"2024-05-15T14:49:19.162647+0000","last_peered":"2024-05-15T14:49:19.162647+0000","last_clean":"2024-05-15T14:49:19.162647+0000","last_became_active":"2024-05-15T14:27:52.848482+0000","last_became_peered":"2024-05-15T14:27:52.848482+0000","last_unstale":"2024-05-15T14:49:19.162647+0000","last_undegraded":"2024-05-15T14:49:19.162647+0000","last_fullsized":"2024-05-15T14:49:19.162647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'100","last_scrub_stamp":"2024-05-15T14:49:19.162557+0000","last_deep_scrub":"39'100","last_deep_scrub_stamp":"2024-05-15T14:49:19.162557+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.162557+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:42.092463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":302,"num_write":142,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.668563+0000","last_change":"2024-05-15T14:49:23.668590+0000","last_active":"2024-05-15T14:49:23.668563+0000","last_peered":"2024-05-15T14:49:23.668563+0000","last_clean":"2024-05-15T14:49:23.668563+0000","last_became_active":"2024-05-15T14:27:50.852659+0000","last_became_peered":"2024-05-15T14:27:50.852659+0000","last_unstale":"2024-05-15T14:49:23.668563+0000","last_undegraded":"2024-05-15T14:49:23.668563+0000","last_fullsized":"2024-05-15T14:49:23.668563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:23.668477+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:23.668477+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.668477+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:47.900230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"39'10","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.057201+0000","last_change":"2024-05-15T14:49:21.057226+0000","last_active":"2024-05-15T14:49:21.057201+0000","last_peered":"2024-05-15T14:49:21.057201+0000","last_clean":"2024-05-15T14:49:21.057201+0000","last_became_active":"2024-05-15T14:27:52.839017+0000","last_became_peered":"2024-05-15T14:27:52.839017+0000","last_unstale":"2024-05-15T14:49:21.057201+0000","last_undegraded":"2024-05-15T14:49:21.057201+0000","last_fullsized":"2024-05-15T14:49:21.057201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:21.057108+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:21.057108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.057108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:45.288861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"39'14","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.585517+0000","last_change":"2024-05-15T14:49:29.585549+0000","last_active":"2024-05-15T14:49:29.585517+0000","last_peered":"2024-05-15T14:49:29.585517+0000","last_clean":"2024-05-15T14:49:29.585517+0000","last_became_active":"2024-05-15T14:27:50.854408+0000","last_became_peered":"2024-05-15T14:27:50.854408+0000","last_unstale":"2024-05-15T14:49:29.585517+0000","last_undegraded":"2024-05-15T14:49:29.585517+0000","last_fullsized":"2024-05-15T14:49:29.585517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:29.585423+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:29.585423+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.585423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:34:35.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25,"num_write":70,"num_write_kb":17643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"39'10","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.314704+0000","last_change":"2024-05-15T14:49:11.314730+0000","last_active":"2024-05-15T14:49:11.314704+0000","last_peered":"2024-05-15T14:49:11.314704+0000","last_clean":"2024-05-15T14:49:11.314704+0000","last_became_active":"2024-05-15T14:27:52.853688+0000","last_became_peered":"2024-05-15T14:27:52.853688+0000","last_unstale":"2024-05-15T14:49:11.314704+0000","last_undegraded":"2024-05-15T14:49:11.314704+0000","last_fullsized":"2024-05-15T14:49:11.314704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:11.314615+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:11.314615+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.314615+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:22:41.936884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"39'4","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.263543+0000","last_change":"2024-05-15T14:49:15.263569+0000","last_active":"2024-05-15T14:49:15.263543+0000","last_peered":"2024-05-15T14:49:15.263543+0000","last_clean":"2024-05-15T14:49:15.263543+0000","last_became_active":"2024-05-15T14:27:52.850532+0000","last_became_peered":"2024-05-15T14:27:52.850532+0000","last_unstale":"2024-05-15T14:49:15.263543+0000","last_undegraded":"2024-05-15T14:49:15.263543+0000","last_fullsized":"2024-05-15T14:49:15.263543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:15.263455+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:15.263455+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.263455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:13:18.960113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.605493+0000","last_change":"2024-05-15T14:49:25.605493+0000","last_active":"2024-05-15T14:49:25.605493+0000","last_peered":"2024-05-15T14:49:25.605493+0000","last_clean":"2024-05-15T14:49:25.605493+0000","last_became_active":"2024-05-15T14:27:50.852229+0000","last_became_peered":"2024-05-15T14:27:50.852229+0000","last_unstale":"2024-05-15T14:49:25.605493+0000","last_undegraded":"2024-05-15T14:49:25.605493+0000","last_fullsized":"2024-05-15T14:49:25.605493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:25.605325+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:25.605325+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.605325+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:54.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"39'34","reported_seq":138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.885289+0000","last_change":"2024-05-15T14:49:14.885338+0000","last_active":"2024-05-15T14:49:14.885289+0000","last_peered":"2024-05-15T14:49:14.885289+0000","last_clean":"2024-05-15T14:49:14.885289+0000","last_became_active":"2024-05-15T14:27:52.858331+0000","last_became_peered":"2024-05-15T14:27:52.858331+0000","last_unstale":"2024-05-15T14:49:14.885289+0000","last_undegraded":"2024-05-15T14:49:14.885289+0000","last_fullsized":"2024-05-15T14:49:14.885289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'34","last_scrub_stamp":"2024-05-15T14:49:14.885193+0000","last_deep_scrub":"39'34","last_deep_scrub_stamp":"2024-05-15T14:49:14.885193+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.885193+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:35.445212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":123,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"39'16","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.136706+0000","last_change":"2024-05-15T14:49:18.136706+0000","last_active":"2024-05-15T14:49:18.136706+0000","last_peered":"2024-05-15T14:49:18.136706+0000","last_clean":"2024-05-15T14:49:18.136706+0000","last_became_active":"2024-05-15T14:27:50.849526+0000","last_became_peered":"2024-05-15T14:27:50.849526+0000","last_unstale":"2024-05-15T14:49:18.136706+0000","last_undegraded":"2024-05-15T14:49:18.136706+0000","last_fullsized":"2024-05-15T14:49:18.136706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:18.136598+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:18.136598+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.136598+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:44.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"39'6","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.096856+0000","last_change":"2024-05-15T14:49:19.096881+0000","last_active":"2024-05-15T14:49:19.096856+0000","last_peered":"2024-05-15T14:49:19.096856+0000","last_clean":"2024-05-15T14:49:19.096856+0000","last_became_active":"2024-05-15T14:27:52.838137+0000","last_became_peered":"2024-05-15T14:27:52.838137+0000","last_unstale":"2024-05-15T14:49:19.096856+0000","last_undegraded":"2024-05-15T14:49:19.096856+0000","last_fullsized":"2024-05-15T14:49:19.096856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:19.096756+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:19.096756+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.096756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:17.238088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"39'14","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.099231+0000","last_change":"2024-05-15T14:49:17.099231+0000","last_active":"2024-05-15T14:49:17.099231+0000","last_peered":"2024-05-15T14:49:17.099231+0000","last_clean":"2024-05-15T14:49:17.099231+0000","last_became_active":"2024-05-15T14:27:50.842240+0000","last_became_peered":"2024-05-15T14:27:50.842240+0000","last_unstale":"2024-05-15T14:49:17.099231+0000","last_undegraded":"2024-05-15T14:49:17.099231+0000","last_fullsized":"2024-05-15T14:49:17.099231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:17.099108+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:17.099108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.099108+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:37.045139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":70,"num_write_kb":11769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"39'44","reported_seq":123,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.344978+0000","last_change":"2024-05-15T14:49:12.344978+0000","last_active":"2024-05-15T14:49:12.344978+0000","last_peered":"2024-05-15T14:49:12.344978+0000","last_clean":"2024-05-15T14:49:12.344978+0000","last_became_active":"2024-05-15T14:27:52.854742+0000","last_became_peered":"2024-05-15T14:27:52.854742+0000","last_unstale":"2024-05-15T14:49:12.344978+0000","last_undegraded":"2024-05-15T14:49:12.344978+0000","last_fullsized":"2024-05-15T14:49:12.344978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'44","last_scrub_stamp":"2024-05-15T14:49:12.344854+0000","last_deep_scrub":"39'44","last_deep_scrub_stamp":"2024-05-15T14:49:12.344854+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.344854+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.742018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":128,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.266743+0000","last_change":"2024-05-15T14:49:26.266743+0000","last_active":"2024-05-15T14:49:26.266743+0000","last_peered":"2024-05-15T14:49:26.266743+0000","last_clean":"2024-05-15T14:49:26.266743+0000","last_became_active":"2024-05-15T14:27:50.840405+0000","last_became_peered":"2024-05-15T14:27:50.840405+0000","last_unstale":"2024-05-15T14:49:26.266743+0000","last_undegraded":"2024-05-15T14:49:26.266743+0000","last_fullsized":"2024-05-15T14:49:26.266743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:26.266609+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:26.266609+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.266609+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:09.091528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'52","reported_seq":159,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.335892+0000","last_change":"2024-05-15T14:49:10.335892+0000","last_active":"2024-05-15T14:49:10.335892+0000","last_peered":"2024-05-15T14:49:10.335892+0000","last_clean":"2024-05-15T14:49:10.335892+0000","last_became_active":"2024-05-15T14:27:52.850696+0000","last_became_peered":"2024-05-15T14:27:52.850696+0000","last_unstale":"2024-05-15T14:49:10.335892+0000","last_undegraded":"2024-05-15T14:49:10.335892+0000","last_fullsized":"2024-05-15T14:49:10.335892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'52","last_scrub_stamp":"2024-05-15T14:49:10.335711+0000","last_deep_scrub":"39'52","last_deep_scrub_stamp":"2024-05-15T14:49:10.335711+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.335711+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:40:00.831370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":72,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.453551+0000","last_change":"2024-05-15T14:49:39.453577+0000","last_active":"2024-05-15T14:49:39.453551+0000","last_peered":"2024-05-15T14:49:39.453551+0000","last_clean":"2024-05-15T14:49:39.453551+0000","last_became_active":"2024-05-15T14:27:50.848542+0000","last_became_peered":"2024-05-15T14:27:50.848542+0000","last_unstale":"2024-05-15T14:49:39.453551+0000","last_undegraded":"2024-05-15T14:49:39.453551+0000","last_fullsized":"2024-05-15T14:49:39.453551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:39.453468+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:39.453468+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.453468+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:11:42.493290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":70,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"39'28","reported_seq":126,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.311088+0000","last_change":"2024-05-15T14:49:12.311088+0000","last_active":"2024-05-15T14:49:12.311088+0000","last_peered":"2024-05-15T14:49:12.311088+0000","last_clean":"2024-05-15T14:49:12.311088+0000","last_became_active":"2024-05-15T14:27:52.861166+0000","last_became_peered":"2024-05-15T14:27:52.861166+0000","last_unstale":"2024-05-15T14:49:12.311088+0000","last_undegraded":"2024-05-15T14:49:12.311088+0000","last_fullsized":"2024-05-15T14:49:12.311088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'28","last_scrub_stamp":"2024-05-15T14:49:12.310979+0000","last_deep_scrub":"39'28","last_deep_scrub_stamp":"2024-05-15T14:49:12.310979+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.310979+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:05.453171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":102,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"39'14","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.252708+0000","last_change":"2024-05-15T14:49:33.252763+0000","last_active":"2024-05-15T14:49:33.252708+0000","last_peered":"2024-05-15T14:49:33.252708+0000","last_clean":"2024-05-15T14:49:33.252708+0000","last_became_active":"2024-05-15T14:27:50.837594+0000","last_became_peered":"2024-05-15T14:27:50.837594+0000","last_unstale":"2024-05-15T14:49:33.252708+0000","last_undegraded":"2024-05-15T14:49:33.252708+0000","last_fullsized":"2024-05-15T14:49:33.252708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:33.252596+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:33.252596+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.252596+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:37:23.717173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.537224+0000","last_change":"2024-05-15T14:31:16.589931+0000","last_active":"2024-05-15T14:48:12.537224+0000","last_peered":"2024-05-15T14:48:12.537224+0000","last_clean":"2024-05-15T14:48:12.537224+0000","last_became_active":"2024-05-15T14:31:16.589649+0000","last_became_peered":"2024-05-15T14:31:16.589649+0000","last_unstale":"2024-05-15T14:48:12.537224+0000","last_undegraded":"2024-05-15T14:48:12.537224+0000","last_fullsized":"2024-05-15T14:48:12.537224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"39'27","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.261836+0000","last_change":"2024-05-15T14:49:37.261871+0000","last_active":"2024-05-15T14:49:37.261836+0000","last_peered":"2024-05-15T14:49:37.261836+0000","last_clean":"2024-05-15T14:49:37.261836+0000","last_became_active":"2024-05-15T14:28:02.891340+0000","last_became_peered":"2024-05-15T14:28:02.891340+0000","last_unstale":"2024-05-15T14:49:37.261836+0000","last_undegraded":"2024-05-15T14:49:37.261836+0000","last_fullsized":"2024-05-15T14:49:37.261836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'27","last_scrub_stamp":"2024-05-15T14:49:37.261754+0000","last_deep_scrub":"39'27","last_deep_scrub_stamp":"2024-05-15T14:49:37.261754+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.261754+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:02:05.378903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":38,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"39'78","reported_seq":176,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.712014+0000","last_change":"2024-05-15T14:49:24.712050+0000","last_active":"2024-05-15T14:49:24.712014+0000","last_peered":"2024-05-15T14:49:24.712014+0000","last_clean":"2024-05-15T14:49:24.712014+0000","last_became_active":"2024-05-15T14:27:52.862960+0000","last_became_peered":"2024-05-15T14:27:52.862960+0000","last_unstale":"2024-05-15T14:49:24.712014+0000","last_undegraded":"2024-05-15T14:49:24.712014+0000","last_fullsized":"2024-05-15T14:49:24.712014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'78","last_scrub_stamp":"2024-05-15T14:49:24.711902+0000","last_deep_scrub":"39'78","last_deep_scrub_stamp":"2024-05-15T14:49:24.711902+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.711902+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:37:15.176478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":231,"num_write":112,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"39'4","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.629761+0000","last_change":"2024-05-15T14:49:33.629789+0000","last_active":"2024-05-15T14:49:33.629761+0000","last_peered":"2024-05-15T14:49:33.629761+0000","last_clean":"2024-05-15T14:49:33.629761+0000","last_became_active":"2024-05-15T14:27:50.849039+0000","last_became_peered":"2024-05-15T14:27:50.849039+0000","last_unstale":"2024-05-15T14:49:33.629761+0000","last_undegraded":"2024-05-15T14:49:33.629761+0000","last_fullsized":"2024-05-15T14:49:33.629761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:33.629654+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:33.629654+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.629654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:36.754988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.094982+0000","last_change":"2024-05-15T14:49:22.094982+0000","last_active":"2024-05-15T14:49:22.094982+0000","last_peered":"2024-05-15T14:49:22.094982+0000","last_clean":"2024-05-15T14:49:22.094982+0000","last_became_active":"2024-05-15T14:27:56.876559+0000","last_became_peered":"2024-05-15T14:27:56.876559+0000","last_unstale":"2024-05-15T14:49:22.094982+0000","last_undegraded":"2024-05-15T14:49:22.094982+0000","last_fullsized":"2024-05-15T14:49:22.094982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.094867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.094867+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.094867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:00.671723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"39'273","reported_seq":561,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.163219+0000","last_change":"2024-05-15T14:49:14.163273+0000","last_active":"2024-05-15T14:49:14.163219+0000","last_peered":"2024-05-15T14:49:14.163219+0000","last_clean":"2024-05-15T14:49:14.163219+0000","last_became_active":"2024-05-15T14:27:58.883983+0000","last_became_peered":"2024-05-15T14:27:58.883983+0000","last_unstale":"2024-05-15T14:49:14.163219+0000","last_undegraded":"2024-05-15T14:49:14.163219+0000","last_fullsized":"2024-05-15T14:49:14.163219+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'273","last_scrub_stamp":"2024-05-15T14:49:14.163129+0000","last_deep_scrub":"39'273","last_deep_scrub_stamp":"2024-05-15T14:49:14.163129+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.163129+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:48.003222+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":459,"num_read_kb":564,"num_write":244,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.906676+0000","last_change":"2024-05-15T14:49:07.906703+0000","last_active":"2024-05-15T14:49:07.906676+0000","last_peered":"2024-05-15T14:49:07.906676+0000","last_clean":"2024-05-15T14:49:07.906676+0000","last_became_active":"2024-05-15T14:28:00.887947+0000","last_became_peered":"2024-05-15T14:28:00.887947+0000","last_unstale":"2024-05-15T14:49:07.906676+0000","last_undegraded":"2024-05-15T14:49:07.906676+0000","last_fullsized":"2024-05-15T14:49:07.906676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.906558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.906558+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.906558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:01.335889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.171879+0000","last_change":"2024-05-15T14:49:28.171918+0000","last_active":"2024-05-15T14:49:28.171879+0000","last_peered":"2024-05-15T14:49:28.171879+0000","last_clean":"2024-05-15T14:49:28.171879+0000","last_became_active":"2024-05-15T14:31:16.588437+0000","last_became_peered":"2024-05-15T14:31:16.588437+0000","last_unstale":"2024-05-15T14:49:28.171879+0000","last_undegraded":"2024-05-15T14:49:28.171879+0000","last_fullsized":"2024-05-15T14:49:28.171879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:28.171777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:28.171777+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.171777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:48.417301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"39'110","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.919624+0000","last_change":"2024-05-15T14:49:04.919691+0000","last_active":"2024-05-15T14:49:04.919624+0000","last_peered":"2024-05-15T14:49:04.919624+0000","last_clean":"2024-05-15T14:49:04.919624+0000","last_became_active":"2024-05-15T14:28:02.890477+0000","last_became_peered":"2024-05-15T14:28:02.890477+0000","last_unstale":"2024-05-15T14:49:04.919624+0000","last_undegraded":"2024-05-15T14:49:04.919624+0000","last_fullsized":"2024-05-15T14:49:04.919624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'110","last_scrub_stamp":"2024-05-15T14:49:04.919526+0000","last_deep_scrub":"39'110","last_deep_scrub_stamp":"2024-05-15T14:49:04.919526+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.919526+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:33.953046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":241,"num_write":191,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"39'4","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.072115+0000","last_change":"2024-05-15T14:49:17.072115+0000","last_active":"2024-05-15T14:49:17.072115+0000","last_peered":"2024-05-15T14:49:17.072115+0000","last_clean":"2024-05-15T14:49:17.072115+0000","last_became_active":"2024-05-15T14:27:52.840847+0000","last_became_peered":"2024-05-15T14:27:52.840847+0000","last_unstale":"2024-05-15T14:49:17.072115+0000","last_undegraded":"2024-05-15T14:49:17.072115+0000","last_fullsized":"2024-05-15T14:49:17.072115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:17.071956+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:17.071956+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.071956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:47:57.482717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"39'18","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.325766+0000","last_change":"2024-05-15T14:49:38.325800+0000","last_active":"2024-05-15T14:49:38.325766+0000","last_peered":"2024-05-15T14:49:38.325766+0000","last_clean":"2024-05-15T14:49:38.325766+0000","last_became_active":"2024-05-15T14:27:50.845923+0000","last_became_peered":"2024-05-15T14:27:50.845923+0000","last_unstale":"2024-05-15T14:49:38.325766+0000","last_undegraded":"2024-05-15T14:49:38.325766+0000","last_fullsized":"2024-05-15T14:49:38.325766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:38.325661+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:38.325661+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.325661+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:34:44.505941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32,"num_write":82,"num_write_kb":27622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.626618+0000","last_change":"2024-05-15T14:49:28.626642+0000","last_active":"2024-05-15T14:49:28.626618+0000","last_peered":"2024-05-15T14:49:28.626618+0000","last_clean":"2024-05-15T14:49:28.626618+0000","last_became_active":"2024-05-15T14:27:56.876325+0000","last_became_peered":"2024-05-15T14:27:56.876325+0000","last_unstale":"2024-05-15T14:49:28.626618+0000","last_undegraded":"2024-05-15T14:49:28.626618+0000","last_fullsized":"2024-05-15T14:49:28.626618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:28.626528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:28.626528+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.626528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:29:58.038093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"39'146","reported_seq":268,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.354381+0000","last_change":"2024-05-15T14:49:07.354466+0000","last_active":"2024-05-15T14:49:07.354381+0000","last_peered":"2024-05-15T14:49:07.354381+0000","last_clean":"2024-05-15T14:49:07.354381+0000","last_became_active":"2024-05-15T14:27:58.883792+0000","last_became_peered":"2024-05-15T14:27:58.883792+0000","last_unstale":"2024-05-15T14:49:07.354381+0000","last_undegraded":"2024-05-15T14:49:07.354381+0000","last_fullsized":"2024-05-15T14:49:07.354381+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'146","last_scrub_stamp":"2024-05-15T14:49:07.354281+0000","last_deep_scrub":"39'146","last_deep_scrub_stamp":"2024-05-15T14:49:07.354281+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.354281+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:34.204559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":205,"num_write":143,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":356,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.321940+0000","last_change":"2024-05-15T14:49:33.321977+0000","last_active":"2024-05-15T14:49:33.321940+0000","last_peered":"2024-05-15T14:49:33.321940+0000","last_clean":"2024-05-15T14:49:33.321940+0000","last_became_active":"2024-05-15T14:28:00.885933+0000","last_became_peered":"2024-05-15T14:28:00.885933+0000","last_unstale":"2024-05-15T14:49:33.321940+0000","last_undegraded":"2024-05-15T14:49:33.321940+0000","last_fullsized":"2024-05-15T14:49:33.321940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:33.321832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:33.321832+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.321832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:36.447166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.541759+0000","last_change":"2024-05-15T14:31:16.594655+0000","last_active":"2024-05-15T14:48:47.541759+0000","last_peered":"2024-05-15T14:48:47.541759+0000","last_clean":"2024-05-15T14:48:47.541759+0000","last_became_active":"2024-05-15T14:31:16.594357+0000","last_became_peered":"2024-05-15T14:31:16.594357+0000","last_unstale":"2024-05-15T14:48:47.541759+0000","last_undegraded":"2024-05-15T14:48:47.541759+0000","last_fullsized":"2024-05-15T14:48:47.541759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"39'17","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.157550+0000","last_change":"2024-05-15T14:49:13.157580+0000","last_active":"2024-05-15T14:49:13.157550+0000","last_peered":"2024-05-15T14:49:13.157550+0000","last_clean":"2024-05-15T14:49:13.157550+0000","last_became_active":"2024-05-15T14:28:02.892764+0000","last_became_peered":"2024-05-15T14:28:02.892764+0000","last_unstale":"2024-05-15T14:49:13.157550+0000","last_undegraded":"2024-05-15T14:49:13.157550+0000","last_fullsized":"2024-05-15T14:49:13.157550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'17","last_scrub_stamp":"2024-05-15T14:49:13.157460+0000","last_deep_scrub":"39'17","last_deep_scrub_stamp":"2024-05-15T14:49:13.157460+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.157460+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:36.087366+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"39'26","reported_seq":134,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.207780+0000","last_change":"2024-05-15T14:49:22.207780+0000","last_active":"2024-05-15T14:49:22.207780+0000","last_peered":"2024-05-15T14:49:22.207780+0000","last_clean":"2024-05-15T14:49:22.207780+0000","last_became_active":"2024-05-15T14:27:52.852883+0000","last_became_peered":"2024-05-15T14:27:52.852883+0000","last_unstale":"2024-05-15T14:49:22.207780+0000","last_undegraded":"2024-05-15T14:49:22.207780+0000","last_fullsized":"2024-05-15T14:49:22.207780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:22.207662+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:22.207662+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.207662+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:55.309176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"39'12","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.597982+0000","last_change":"2024-05-15T14:49:32.598006+0000","last_active":"2024-05-15T14:49:32.597982+0000","last_peered":"2024-05-15T14:49:32.597982+0000","last_clean":"2024-05-15T14:49:32.597982+0000","last_became_active":"2024-05-15T14:27:50.848412+0000","last_became_peered":"2024-05-15T14:27:50.848412+0000","last_unstale":"2024-05-15T14:49:32.597982+0000","last_undegraded":"2024-05-15T14:49:32.597982+0000","last_fullsized":"2024-05-15T14:49:32.597982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:32.597889+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:32.597889+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.597889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:34.907427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"39'17","reported_seq":708,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.623151+0000","last_change":"2024-05-15T14:49:30.623151+0000","last_active":"2024-05-15T14:49:30.623151+0000","last_peered":"2024-05-15T14:49:30.623151+0000","last_clean":"2024-05-15T14:49:30.623151+0000","last_became_active":"2024-05-15T14:27:56.877039+0000","last_became_peered":"2024-05-15T14:27:56.877039+0000","last_unstale":"2024-05-15T14:49:30.623151+0000","last_undegraded":"2024-05-15T14:49:30.623151+0000","last_fullsized":"2024-05-15T14:49:30.623151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'17","last_scrub_stamp":"2024-05-15T14:49:30.623009+0000","last_deep_scrub":"39'17","last_deep_scrub_stamp":"2024-05-15T14:49:30.623009+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.623009+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:53.407137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":635,"num_read_kb":635,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"39'249","reported_seq":420,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.388027+0000","last_change":"2024-05-15T14:49:14.388079+0000","last_active":"2024-05-15T14:49:14.388027+0000","last_peered":"2024-05-15T14:49:14.388027+0000","last_clean":"2024-05-15T14:49:14.388027+0000","last_became_active":"2024-05-15T14:27:58.887969+0000","last_became_peered":"2024-05-15T14:27:58.887969+0000","last_unstale":"2024-05-15T14:49:14.388027+0000","last_undegraded":"2024-05-15T14:49:14.388027+0000","last_fullsized":"2024-05-15T14:49:14.388027+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'249","last_scrub_stamp":"2024-05-15T14:49:14.387915+0000","last_deep_scrub":"39'249","last_deep_scrub_stamp":"2024-05-15T14:49:14.387915+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.387915+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:38:24.882431+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":351,"num_read_kb":343,"num_write":242,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'927","reported_seq":1442,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.918271+0000","last_change":"2024-05-15T14:49:03.918299+0000","last_active":"2024-05-15T14:49:03.918271+0000","last_peered":"2024-05-15T14:49:03.918271+0000","last_clean":"2024-05-15T14:49:03.918271+0000","last_became_active":"2024-05-15T14:28:00.892864+0000","last_became_peered":"2024-05-15T14:28:00.892864+0000","last_unstale":"2024-05-15T14:49:03.918271+0000","last_undegraded":"2024-05-15T14:49:03.918271+0000","last_fullsized":"2024-05-15T14:49:03.918271+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:03.918163+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:03.918163+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.918163+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:03.560609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.541728+0000","last_change":"2024-05-15T14:31:16.584361+0000","last_active":"2024-05-15T14:48:47.541728+0000","last_peered":"2024-05-15T14:48:47.541728+0000","last_clean":"2024-05-15T14:48:47.541728+0000","last_became_active":"2024-05-15T14:31:16.583997+0000","last_became_peered":"2024-05-15T14:31:16.583997+0000","last_unstale":"2024-05-15T14:48:47.541728+0000","last_undegraded":"2024-05-15T14:48:47.541728+0000","last_fullsized":"2024-05-15T14:48:47.541728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"39'31","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.348341+0000","last_change":"2024-05-15T14:49:34.348404+0000","last_active":"2024-05-15T14:49:34.348341+0000","last_peered":"2024-05-15T14:49:34.348341+0000","last_clean":"2024-05-15T14:49:34.348341+0000","last_became_active":"2024-05-15T14:28:02.887257+0000","last_became_peered":"2024-05-15T14:28:02.887257+0000","last_unstale":"2024-05-15T14:49:34.348341+0000","last_undegraded":"2024-05-15T14:49:34.348341+0000","last_fullsized":"2024-05-15T14:49:34.348341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:34.348219+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:34.348219+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.348219+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:10:42.654627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":53,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"39'24","reported_seq":118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.698770+0000","last_change":"2024-05-15T14:49:25.698770+0000","last_active":"2024-05-15T14:49:25.698770+0000","last_peered":"2024-05-15T14:49:25.698770+0000","last_clean":"2024-05-15T14:49:25.698770+0000","last_became_active":"2024-05-15T14:27:52.851979+0000","last_became_peered":"2024-05-15T14:27:52.851979+0000","last_unstale":"2024-05-15T14:49:25.698770+0000","last_undegraded":"2024-05-15T14:49:25.698770+0000","last_fullsized":"2024-05-15T14:49:25.698770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:25.698643+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:25.698643+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.698643+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:11:16.054932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":90,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"39'6","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.054924+0000","last_change":"2024-05-15T14:49:16.054952+0000","last_active":"2024-05-15T14:49:16.054924+0000","last_peered":"2024-05-15T14:49:16.054924+0000","last_clean":"2024-05-15T14:49:16.054924+0000","last_became_active":"2024-05-15T14:27:50.840772+0000","last_became_peered":"2024-05-15T14:27:50.840772+0000","last_unstale":"2024-05-15T14:49:16.054924+0000","last_undegraded":"2024-05-15T14:49:16.054924+0000","last_fullsized":"2024-05-15T14:49:16.054924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:16.054831+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:16.054831+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.054831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:32.603698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":30,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.037640+0000","last_change":"2024-05-15T14:49:24.037640+0000","last_active":"2024-05-15T14:49:24.037640+0000","last_peered":"2024-05-15T14:49:24.037640+0000","last_clean":"2024-05-15T14:49:24.037640+0000","last_became_active":"2024-05-15T14:27:56.877825+0000","last_became_peered":"2024-05-15T14:27:56.877825+0000","last_unstale":"2024-05-15T14:49:24.037640+0000","last_undegraded":"2024-05-15T14:49:24.037640+0000","last_fullsized":"2024-05-15T14:49:24.037640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:24.037485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:24.037485+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.037485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:06.862404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"39'280","reported_seq":23297,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.882423+0000","last_change":"2024-05-15T14:49:09.882459+0000","last_active":"2024-05-15T14:49:09.882423+0000","last_peered":"2024-05-15T14:49:09.882423+0000","last_clean":"2024-05-15T14:49:09.882423+0000","last_became_active":"2024-05-15T14:27:58.887424+0000","last_became_peered":"2024-05-15T14:27:58.887424+0000","last_unstale":"2024-05-15T14:49:09.882423+0000","last_undegraded":"2024-05-15T14:49:09.882423+0000","last_fullsized":"2024-05-15T14:49:09.882423+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'280","last_scrub_stamp":"2024-05-15T14:49:09.882332+0000","last_deep_scrub":"39'280","last_deep_scrub_stamp":"2024-05-15T14:49:09.882332+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.882332+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:27.843470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57546,"num_read_kb":170986,"num_write":274,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'927","reported_seq":2608,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.662712+0000","last_change":"2024-05-15T14:49:06.662741+0000","last_active":"2024-05-15T14:49:06.662712+0000","last_peered":"2024-05-15T14:49:06.662712+0000","last_clean":"2024-05-15T14:49:06.662712+0000","last_became_active":"2024-05-15T14:28:00.887493+0000","last_became_peered":"2024-05-15T14:28:00.887493+0000","last_unstale":"2024-05-15T14:49:06.662712+0000","last_undegraded":"2024-05-15T14:49:06.662712+0000","last_fullsized":"2024-05-15T14:49:06.662712+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:06.662621+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:06.662621+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.662621+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:14.729989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:02.432811+0000","last_change":"2024-05-15T14:31:16.592231+0000","last_active":"2024-05-15T14:48:02.432811+0000","last_peered":"2024-05-15T14:48:02.432811+0000","last_clean":"2024-05-15T14:48:02.432811+0000","last_became_active":"2024-05-15T14:31:16.591945+0000","last_became_peered":"2024-05-15T14:31:16.591945+0000","last_unstale":"2024-05-15T14:48:02.432811+0000","last_undegraded":"2024-05-15T14:48:02.432811+0000","last_fullsized":"2024-05-15T14:48:02.432811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"39'16","reported_seq":106,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.074781+0000","last_change":"2024-05-15T14:49:14.074781+0000","last_active":"2024-05-15T14:49:14.074781+0000","last_peered":"2024-05-15T14:49:14.074781+0000","last_clean":"2024-05-15T14:49:14.074781+0000","last_became_active":"2024-05-15T14:27:52.842056+0000","last_became_peered":"2024-05-15T14:27:52.842056+0000","last_unstale":"2024-05-15T14:49:14.074781+0000","last_undegraded":"2024-05-15T14:49:14.074781+0000","last_fullsized":"2024-05-15T14:49:14.074781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:14.074605+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:14.074605+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.074605+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:37.454474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.581647+0000","last_change":"2024-05-15T14:49:27.581673+0000","last_active":"2024-05-15T14:49:27.581647+0000","last_peered":"2024-05-15T14:49:27.581647+0000","last_clean":"2024-05-15T14:49:27.581647+0000","last_became_active":"2024-05-15T14:27:50.849981+0000","last_became_peered":"2024-05-15T14:27:50.849981+0000","last_unstale":"2024-05-15T14:49:27.581647+0000","last_undegraded":"2024-05-15T14:49:27.581647+0000","last_fullsized":"2024-05-15T14:49:27.581647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:27.581552+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:27.581552+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.581552+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:36.945643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"39'2","reported_seq":139,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.696222+0000","last_change":"2024-05-15T14:49:20.696222+0000","last_active":"2024-05-15T14:49:20.696222+0000","last_peered":"2024-05-15T14:49:20.696222+0000","last_clean":"2024-05-15T14:49:20.696222+0000","last_became_active":"2024-05-15T14:27:56.878269+0000","last_became_peered":"2024-05-15T14:27:56.878269+0000","last_unstale":"2024-05-15T14:49:20.696222+0000","last_undegraded":"2024-05-15T14:49:20.696222+0000","last_fullsized":"2024-05-15T14:49:20.696222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:20.696101+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:20.696101+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.696101+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:01.913190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":160,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"39'436","reported_seq":756,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.984682+0000","last_change":"2024-05-15T14:49:10.984753+0000","last_active":"2024-05-15T14:49:10.984682+0000","last_peered":"2024-05-15T14:49:10.984682+0000","last_clean":"2024-05-15T14:49:10.984682+0000","last_became_active":"2024-05-15T14:27:58.883546+0000","last_became_peered":"2024-05-15T14:27:58.883546+0000","last_unstale":"2024-05-15T14:49:10.984682+0000","last_undegraded":"2024-05-15T14:49:10.984682+0000","last_fullsized":"2024-05-15T14:49:10.984682+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'436","last_scrub_stamp":"2024-05-15T14:49:10.984585+0000","last_deep_scrub":"39'436","last_deep_scrub_stamp":"2024-05-15T14:49:10.984585+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.984585+0000","objects_scrubbed":10,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:04.126776+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":668,"num_read_kb":656,"num_write":402,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.927586+0000","last_change":"2024-05-15T14:49:25.927614+0000","last_active":"2024-05-15T14:49:25.927586+0000","last_peered":"2024-05-15T14:49:25.927586+0000","last_clean":"2024-05-15T14:49:25.927586+0000","last_became_active":"2024-05-15T14:28:00.891863+0000","last_became_peered":"2024-05-15T14:28:00.891863+0000","last_unstale":"2024-05-15T14:49:25.927586+0000","last_undegraded":"2024-05-15T14:49:25.927586+0000","last_fullsized":"2024-05-15T14:49:25.927586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:25.927479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:25.927479+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.927479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:33.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"39'26","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.857505+0000","last_change":"2024-05-15T14:49:02.857570+0000","last_active":"2024-05-15T14:49:02.857505+0000","last_peered":"2024-05-15T14:49:02.857505+0000","last_clean":"2024-05-15T14:49:02.857505+0000","last_became_active":"2024-05-15T14:28:02.890450+0000","last_became_peered":"2024-05-15T14:28:02.890450+0000","last_unstale":"2024-05-15T14:49:02.857505+0000","last_undegraded":"2024-05-15T14:49:02.857505+0000","last_fullsized":"2024-05-15T14:49:02.857505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:02.857396+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:02.857396+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.857396+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:42.403406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.822934+0000","last_change":"2024-05-15T14:49:31.822963+0000","last_active":"2024-05-15T14:49:31.822934+0000","last_peered":"2024-05-15T14:49:31.822934+0000","last_clean":"2024-05-15T14:49:31.822934+0000","last_became_active":"2024-05-15T14:31:16.596344+0000","last_became_peered":"2024-05-15T14:31:16.596344+0000","last_unstale":"2024-05-15T14:49:31.822934+0000","last_undegraded":"2024-05-15T14:49:31.822934+0000","last_fullsized":"2024-05-15T14:49:31.822934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:31.822794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:31.822794+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.822794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:35.207732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'6","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.270195+0000","last_change":"2024-05-15T14:49:14.270195+0000","last_active":"2024-05-15T14:49:14.270195+0000","last_peered":"2024-05-15T14:49:14.270195+0000","last_clean":"2024-05-15T14:49:14.270195+0000","last_became_active":"2024-05-15T14:27:52.861131+0000","last_became_peered":"2024-05-15T14:27:52.861131+0000","last_unstale":"2024-05-15T14:49:14.270195+0000","last_undegraded":"2024-05-15T14:49:14.270195+0000","last_fullsized":"2024-05-15T14:49:14.270195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:14.270082+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:14.270082+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.270082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:38.007525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"39'10","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.623310+0000","last_change":"2024-05-15T14:49:31.623337+0000","last_active":"2024-05-15T14:49:31.623310+0000","last_peered":"2024-05-15T14:49:31.623310+0000","last_clean":"2024-05-15T14:49:31.623310+0000","last_became_active":"2024-05-15T14:27:50.847875+0000","last_became_peered":"2024-05-15T14:27:50.847875+0000","last_unstale":"2024-05-15T14:49:31.623310+0000","last_undegraded":"2024-05-15T14:49:31.623310+0000","last_fullsized":"2024-05-15T14:49:31.623310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:31.623219+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:31.623219+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.623219+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:21.749187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":11761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"39'2","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.405677+0000","last_change":"2024-05-15T14:49:01.405677+0000","last_active":"2024-05-15T14:49:01.405677+0000","last_peered":"2024-05-15T14:49:01.405677+0000","last_clean":"2024-05-15T14:49:01.405677+0000","last_became_active":"2024-05-15T14:27:56.881088+0000","last_became_peered":"2024-05-15T14:27:56.881088+0000","last_unstale":"2024-05-15T14:49:01.405677+0000","last_undegraded":"2024-05-15T14:49:01.405677+0000","last_fullsized":"2024-05-15T14:49:01.405677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:01.405573+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:01.405573+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.405573+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:12:23.625819+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"39'629","reported_seq":1024,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.696175+0000","last_change":"2024-05-15T14:49:11.696218+0000","last_active":"2024-05-15T14:49:11.696175+0000","last_peered":"2024-05-15T14:49:11.696175+0000","last_clean":"2024-05-15T14:49:11.696175+0000","last_became_active":"2024-05-15T14:27:58.882302+0000","last_became_peered":"2024-05-15T14:27:58.882302+0000","last_unstale":"2024-05-15T14:49:11.696175+0000","last_undegraded":"2024-05-15T14:49:11.696175+0000","last_fullsized":"2024-05-15T14:49:11.696175+0000","mapping_epoch":26,"log_start":"39'598","ondisk_log_start":"39'598","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'629","last_scrub_stamp":"2024-05-15T14:49:11.696077+0000","last_deep_scrub":"39'629","last_deep_scrub_stamp":"2024-05-15T14:49:11.696077+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.696077+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":598,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:39:54.520996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1288,"num_read_kb":3202,"num_write":806,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.705697+0000","last_change":"2024-05-15T14:49:07.705697+0000","last_active":"2024-05-15T14:49:07.705697+0000","last_peered":"2024-05-15T14:49:07.705697+0000","last_clean":"2024-05-15T14:49:07.705697+0000","last_became_active":"2024-05-15T14:28:00.887335+0000","last_became_peered":"2024-05-15T14:28:00.887335+0000","last_unstale":"2024-05-15T14:49:07.705697+0000","last_undegraded":"2024-05-15T14:49:07.705697+0000","last_fullsized":"2024-05-15T14:49:07.705697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.705526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.705526+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.705526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:23.807975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"39'16","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.142730+0000","last_change":"2024-05-15T14:49:24.142774+0000","last_active":"2024-05-15T14:49:24.142730+0000","last_peered":"2024-05-15T14:49:24.142730+0000","last_clean":"2024-05-15T14:49:24.142730+0000","last_became_active":"2024-05-15T14:28:02.889193+0000","last_became_peered":"2024-05-15T14:28:02.889193+0000","last_unstale":"2024-05-15T14:49:24.142730+0000","last_undegraded":"2024-05-15T14:49:24.142730+0000","last_fullsized":"2024-05-15T14:49:24.142730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:24.142625+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:24.142625+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.142625+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:17.284817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:41.018489+0000","last_change":"2024-05-15T14:49:41.018513+0000","last_active":"2024-05-15T14:49:41.018489+0000","last_peered":"2024-05-15T14:49:41.018489+0000","last_clean":"2024-05-15T14:49:41.018489+0000","last_became_active":"2024-05-15T14:31:16.590510+0000","last_became_peered":"2024-05-15T14:31:16.590510+0000","last_unstale":"2024-05-15T14:49:41.018489+0000","last_undegraded":"2024-05-15T14:49:41.018489+0000","last_fullsized":"2024-05-15T14:49:41.018489+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:41.018393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:41.018393+0000","last_clean_scrub_stamp":"2024-05-15T14:49:41.018393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:34:47.194760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"39'64","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.096871+0000","last_change":"2024-05-15T14:49:06.096871+0000","last_active":"2024-05-15T14:49:06.096871+0000","last_peered":"2024-05-15T14:49:06.096871+0000","last_clean":"2024-05-15T14:49:06.096871+0000","last_became_active":"2024-05-15T14:27:52.861183+0000","last_became_peered":"2024-05-15T14:27:52.861183+0000","last_unstale":"2024-05-15T14:49:06.096871+0000","last_undegraded":"2024-05-15T14:49:06.096871+0000","last_fullsized":"2024-05-15T14:49:06.096871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'64","last_scrub_stamp":"2024-05-15T14:49:06.096747+0000","last_deep_scrub":"39'64","last_deep_scrub_stamp":"2024-05-15T14:49:06.096747+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.096747+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:53:33.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":194,"num_write":90,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"39'4","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.700206+0000","last_change":"2024-05-15T14:49:21.700263+0000","last_active":"2024-05-15T14:49:21.700206+0000","last_peered":"2024-05-15T14:49:21.700206+0000","last_clean":"2024-05-15T14:49:21.700206+0000","last_became_active":"2024-05-15T14:27:50.852376+0000","last_became_peered":"2024-05-15T14:27:50.852376+0000","last_unstale":"2024-05-15T14:49:21.700206+0000","last_undegraded":"2024-05-15T14:49:21.700206+0000","last_fullsized":"2024-05-15T14:49:21.700206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:21.700108+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:21.700108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.700108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:19.841440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.442355+0000","last_change":"2024-05-15T14:49:02.442381+0000","last_active":"2024-05-15T14:49:02.442355+0000","last_peered":"2024-05-15T14:49:02.442355+0000","last_clean":"2024-05-15T14:49:02.442355+0000","last_became_active":"2024-05-15T14:27:56.881701+0000","last_became_peered":"2024-05-15T14:27:56.881701+0000","last_unstale":"2024-05-15T14:49:02.442355+0000","last_undegraded":"2024-05-15T14:49:02.442355+0000","last_fullsized":"2024-05-15T14:49:02.442355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:02.442283+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:02.442283+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.442283+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:35:32.123039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"39'443","reported_seq":816,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.498970+0000","last_change":"2024-05-15T14:49:36.498970+0000","last_active":"2024-05-15T14:49:36.498970+0000","last_peered":"2024-05-15T14:49:36.498970+0000","last_clean":"2024-05-15T14:49:36.498970+0000","last_became_active":"2024-05-15T14:27:58.885487+0000","last_became_peered":"2024-05-15T14:27:58.885487+0000","last_unstale":"2024-05-15T14:49:36.498970+0000","last_undegraded":"2024-05-15T14:49:36.498970+0000","last_fullsized":"2024-05-15T14:49:36.498970+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'443","last_scrub_stamp":"2024-05-15T14:49:36.498817+0000","last_deep_scrub":"39'443","last_deep_scrub_stamp":"2024-05-15T14:49:36.498817+0000","last_clean_scrub_stamp":"2024-05-15T14:49:36.498817+0000","objects_scrubbed":9,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:58:53.867892+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":878,"num_read_kb":1340,"num_write":447,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"39'927","reported_seq":1557,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.091914+0000","last_change":"2024-05-15T14:49:03.091914+0000","last_active":"2024-05-15T14:49:03.091914+0000","last_peered":"2024-05-15T14:49:03.091914+0000","last_clean":"2024-05-15T14:49:03.091914+0000","last_became_active":"2024-05-15T14:28:00.892897+0000","last_became_peered":"2024-05-15T14:28:00.892897+0000","last_unstale":"2024-05-15T14:49:03.091914+0000","last_undegraded":"2024-05-15T14:49:03.091914+0000","last_fullsized":"2024-05-15T14:49:03.091914+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:03.091775+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:03.091775+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.091775+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:21:11.950686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"39'14","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:40.380485+0000","last_change":"2024-05-15T14:49:40.380485+0000","last_active":"2024-05-15T14:49:40.380485+0000","last_peered":"2024-05-15T14:49:40.380485+0000","last_clean":"2024-05-15T14:49:40.380485+0000","last_became_active":"2024-05-15T14:28:02.894071+0000","last_became_peered":"2024-05-15T14:28:02.894071+0000","last_unstale":"2024-05-15T14:49:40.380485+0000","last_undegraded":"2024-05-15T14:49:40.380485+0000","last_fullsized":"2024-05-15T14:49:40.380485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:40.380339+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:40.380339+0000","last_clean_scrub_stamp":"2024-05-15T14:49:40.380339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:37:37.630782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:42.050391+0000","last_change":"2024-05-15T14:49:42.050428+0000","last_active":"2024-05-15T14:49:42.050391+0000","last_peered":"2024-05-15T14:49:42.050391+0000","last_clean":"2024-05-15T14:49:42.050391+0000","last_became_active":"2024-05-15T14:31:16.591166+0000","last_became_peered":"2024-05-15T14:31:16.591166+0000","last_unstale":"2024-05-15T14:49:42.050391+0000","last_undegraded":"2024-05-15T14:49:42.050391+0000","last_fullsized":"2024-05-15T14:49:42.050391+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:42.050294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:42.050294+0000","last_clean_scrub_stamp":"2024-05-15T14:49:42.050294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:34:48.230574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'114","reported_seq":215,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.173130+0000","last_change":"2024-05-15T14:49:17.173165+0000","last_active":"2024-05-15T14:49:17.173130+0000","last_peered":"2024-05-15T14:49:17.173130+0000","last_clean":"2024-05-15T14:49:17.173130+0000","last_became_active":"2024-05-15T14:27:52.859814+0000","last_became_peered":"2024-05-15T14:27:52.859814+0000","last_unstale":"2024-05-15T14:49:17.173130+0000","last_undegraded":"2024-05-15T14:49:17.173130+0000","last_fullsized":"2024-05-15T14:49:17.173130+0000","mapping_epoch":20,"log_start":"39'100","ondisk_log_start":"39'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'114","last_scrub_stamp":"2024-05-15T14:49:17.173033+0000","last_deep_scrub":"39'114","last_deep_scrub_stamp":"2024-05-15T14:49:17.173033+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.173033+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:41.404786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":332,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"39'12","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.088317+0000","last_change":"2024-05-15T14:49:27.088368+0000","last_active":"2024-05-15T14:49:27.088317+0000","last_peered":"2024-05-15T14:49:27.088317+0000","last_clean":"2024-05-15T14:49:27.088317+0000","last_became_active":"2024-05-15T14:27:50.849548+0000","last_became_peered":"2024-05-15T14:27:50.849548+0000","last_unstale":"2024-05-15T14:49:27.088317+0000","last_undegraded":"2024-05-15T14:49:27.088317+0000","last_fullsized":"2024-05-15T14:49:27.088317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:27.088207+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:27.088207+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.088207+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:10:32.723805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"39'7","reported_seq":658,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.339142+0000","last_change":"2024-05-15T14:49:13.339142+0000","last_active":"2024-05-15T14:49:13.339142+0000","last_peered":"2024-05-15T14:49:13.339142+0000","last_clean":"2024-05-15T14:49:13.339142+0000","last_became_active":"2024-05-15T14:27:56.871644+0000","last_became_peered":"2024-05-15T14:27:56.871644+0000","last_unstale":"2024-05-15T14:49:13.339142+0000","last_undegraded":"2024-05-15T14:49:13.339142+0000","last_fullsized":"2024-05-15T14:49:13.339142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'7","last_scrub_stamp":"2024-05-15T14:49:13.339007+0000","last_deep_scrub":"39'7","last_deep_scrub_stamp":"2024-05-15T14:49:13.339007+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.339007+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:00.220785+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":148,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'288","reported_seq":591,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.281357+0000","last_change":"2024-05-15T14:49:27.281357+0000","last_active":"2024-05-15T14:49:27.281357+0000","last_peered":"2024-05-15T14:49:27.281357+0000","last_clean":"2024-05-15T14:49:27.281357+0000","last_became_active":"2024-05-15T14:27:58.880926+0000","last_became_peered":"2024-05-15T14:27:58.880926+0000","last_unstale":"2024-05-15T14:49:27.281357+0000","last_undegraded":"2024-05-15T14:49:27.281357+0000","last_fullsized":"2024-05-15T14:49:27.281357+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'288","last_scrub_stamp":"2024-05-15T14:49:27.281226+0000","last_deep_scrub":"39'288","last_deep_scrub_stamp":"2024-05-15T14:49:27.281226+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.281226+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:30.406560+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":467,"num_write":232,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.429665+0000","last_change":"2024-05-15T14:49:16.429665+0000","last_active":"2024-05-15T14:49:16.429665+0000","last_peered":"2024-05-15T14:49:16.429665+0000","last_clean":"2024-05-15T14:49:16.429665+0000","last_became_active":"2024-05-15T14:28:00.886359+0000","last_became_peered":"2024-05-15T14:28:00.886359+0000","last_unstale":"2024-05-15T14:49:16.429665+0000","last_undegraded":"2024-05-15T14:49:16.429665+0000","last_fullsized":"2024-05-15T14:49:16.429665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:16.429548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:16.429548+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.429548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:12:59.179260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"39'30","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.830637+0000","last_change":"2024-05-15T14:49:28.830637+0000","last_active":"2024-05-15T14:49:28.830637+0000","last_peered":"2024-05-15T14:49:28.830637+0000","last_clean":"2024-05-15T14:49:28.830637+0000","last_became_active":"2024-05-15T14:28:02.892287+0000","last_became_peered":"2024-05-15T14:28:02.892287+0000","last_unstale":"2024-05-15T14:49:28.830637+0000","last_undegraded":"2024-05-15T14:49:28.830637+0000","last_fullsized":"2024-05-15T14:49:28.830637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2024-05-15T14:49:28.830499+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2024-05-15T14:49:28.830499+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.830499+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:07.407355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.535310+0000","last_change":"2024-05-15T14:31:16.590519+0000","last_active":"2024-05-15T14:47:57.535310+0000","last_peered":"2024-05-15T14:47:57.535310+0000","last_clean":"2024-05-15T14:47:57.535310+0000","last_became_active":"2024-05-15T14:31:16.590227+0000","last_became_peered":"2024-05-15T14:31:16.590227+0000","last_unstale":"2024-05-15T14:47:57.535310+0000","last_undegraded":"2024-05-15T14:47:57.535310+0000","last_fullsized":"2024-05-15T14:47:57.535310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.285333+0000","last_change":"2024-05-15T14:49:13.285358+0000","last_active":"2024-05-15T14:49:13.285333+0000","last_peered":"2024-05-15T14:49:13.285333+0000","last_clean":"2024-05-15T14:49:13.285333+0000","last_became_active":"2024-05-15T14:27:52.851589+0000","last_became_peered":"2024-05-15T14:27:52.851589+0000","last_unstale":"2024-05-15T14:49:13.285333+0000","last_undegraded":"2024-05-15T14:49:13.285333+0000","last_fullsized":"2024-05-15T14:49:13.285333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-05-15T14:49:13.285211+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-05-15T14:49:13.285211+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.285211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:33.845230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"39'14","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:41.406982+0000","last_change":"2024-05-15T14:49:41.407038+0000","last_active":"2024-05-15T14:49:41.406982+0000","last_peered":"2024-05-15T14:49:41.406982+0000","last_clean":"2024-05-15T14:49:41.406982+0000","last_became_active":"2024-05-15T14:27:50.850389+0000","last_became_peered":"2024-05-15T14:27:50.850389+0000","last_unstale":"2024-05-15T14:49:41.406982+0000","last_undegraded":"2024-05-15T14:49:41.406982+0000","last_fullsized":"2024-05-15T14:49:41.406982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:41.406870+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:41.406870+0000","last_clean_scrub_stamp":"2024-05-15T14:49:41.406870+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:42:12.288745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":19,"num_write":54,"num_write_kb":19955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"39'2","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.375023+0000","last_change":"2024-05-15T14:49:05.375068+0000","last_active":"2024-05-15T14:49:05.375023+0000","last_peered":"2024-05-15T14:49:05.375023+0000","last_clean":"2024-05-15T14:49:05.375023+0000","last_became_active":"2024-05-15T14:27:56.876626+0000","last_became_peered":"2024-05-15T14:27:56.876626+0000","last_unstale":"2024-05-15T14:49:05.375023+0000","last_undegraded":"2024-05-15T14:49:05.375023+0000","last_fullsized":"2024-05-15T14:49:05.375023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:05.374887+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:05.374887+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.374887+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:18:12.646630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"39'370","reported_seq":605,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.358051+0000","last_change":"2024-05-15T14:49:05.358132+0000","last_active":"2024-05-15T14:49:05.358051+0000","last_peered":"2024-05-15T14:49:05.358051+0000","last_clean":"2024-05-15T14:49:05.358051+0000","last_became_active":"2024-05-15T14:27:58.885156+0000","last_became_peered":"2024-05-15T14:27:58.885156+0000","last_unstale":"2024-05-15T14:49:05.358051+0000","last_undegraded":"2024-05-15T14:49:05.358051+0000","last_fullsized":"2024-05-15T14:49:05.358051+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'370","last_scrub_stamp":"2024-05-15T14:49:05.357940+0000","last_deep_scrub":"39'370","last_deep_scrub_stamp":"2024-05-15T14:49:05.357940+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.357940+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:31.785729+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":666,"num_write":563,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.155853+0000","last_change":"2024-05-15T14:49:08.155879+0000","last_active":"2024-05-15T14:49:08.155853+0000","last_peered":"2024-05-15T14:49:08.155853+0000","last_clean":"2024-05-15T14:49:08.155853+0000","last_became_active":"2024-05-15T14:28:00.885582+0000","last_became_peered":"2024-05-15T14:28:00.885582+0000","last_unstale":"2024-05-15T14:49:08.155853+0000","last_undegraded":"2024-05-15T14:49:08.155853+0000","last_fullsized":"2024-05-15T14:49:08.155853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:08.155739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:08.155739+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.155739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:28.715758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"39'25","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.644153+0000","last_change":"2024-05-15T14:49:01.644201+0000","last_active":"2024-05-15T14:49:01.644153+0000","last_peered":"2024-05-15T14:49:01.644153+0000","last_clean":"2024-05-15T14:49:01.644153+0000","last_became_active":"2024-05-15T14:28:02.891419+0000","last_became_peered":"2024-05-15T14:28:02.891419+0000","last_unstale":"2024-05-15T14:49:01.644153+0000","last_undegraded":"2024-05-15T14:49:01.644153+0000","last_fullsized":"2024-05-15T14:49:01.644153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:01.644062+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:01.644062+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.644062+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:25.023932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.833931+0000","last_change":"2024-05-15T14:49:30.833954+0000","last_active":"2024-05-15T14:49:30.833931+0000","last_peered":"2024-05-15T14:49:30.833931+0000","last_clean":"2024-05-15T14:49:30.833931+0000","last_became_active":"2024-05-15T14:31:16.593942+0000","last_became_peered":"2024-05-15T14:31:16.593942+0000","last_unstale":"2024-05-15T14:49:30.833931+0000","last_undegraded":"2024-05-15T14:49:30.833931+0000","last_fullsized":"2024-05-15T14:49:30.833931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:30.833823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:30.833823+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.833823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:53:00.396380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'62","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.353713+0000","last_change":"2024-05-15T14:49:11.353752+0000","last_active":"2024-05-15T14:49:11.353713+0000","last_peered":"2024-05-15T14:49:11.353713+0000","last_clean":"2024-05-15T14:49:11.353713+0000","last_became_active":"2024-05-15T14:27:52.853828+0000","last_became_peered":"2024-05-15T14:27:52.853828+0000","last_unstale":"2024-05-15T14:49:11.353713+0000","last_undegraded":"2024-05-15T14:49:11.353713+0000","last_fullsized":"2024-05-15T14:49:11.353713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'62","last_scrub_stamp":"2024-05-15T14:49:11.353622+0000","last_deep_scrub":"39'62","last_deep_scrub_stamp":"2024-05-15T14:49:11.353622+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.353622+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:09.197152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":210,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"39'10","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.123271+0000","last_change":"2024-05-15T14:49:14.123271+0000","last_active":"2024-05-15T14:49:14.123271+0000","last_peered":"2024-05-15T14:49:14.123271+0000","last_clean":"2024-05-15T14:49:14.123271+0000","last_became_active":"2024-05-15T14:27:50.838561+0000","last_became_peered":"2024-05-15T14:27:50.838561+0000","last_unstale":"2024-05-15T14:49:14.123271+0000","last_undegraded":"2024-05-15T14:49:14.123271+0000","last_fullsized":"2024-05-15T14:49:14.123271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:14.123131+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:14.123131+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.123131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:55.813793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.101861+0000","last_change":"2024-05-15T14:49:06.101896+0000","last_active":"2024-05-15T14:49:06.101861+0000","last_peered":"2024-05-15T14:49:06.101861+0000","last_clean":"2024-05-15T14:49:06.101861+0000","last_became_active":"2024-05-15T14:27:56.884903+0000","last_became_peered":"2024-05-15T14:27:56.884903+0000","last_unstale":"2024-05-15T14:49:06.101861+0000","last_undegraded":"2024-05-15T14:49:06.101861+0000","last_fullsized":"2024-05-15T14:49:06.101861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.101757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.101757+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.101757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:12:19.458737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"39'350","reported_seq":622,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.403780+0000","last_change":"2024-05-15T14:49:04.403823+0000","last_active":"2024-05-15T14:49:04.403780+0000","last_peered":"2024-05-15T14:49:04.403780+0000","last_clean":"2024-05-15T14:49:04.403780+0000","last_became_active":"2024-05-15T14:27:58.876221+0000","last_became_peered":"2024-05-15T14:27:58.876221+0000","last_unstale":"2024-05-15T14:49:04.403780+0000","last_undegraded":"2024-05-15T14:49:04.403780+0000","last_fullsized":"2024-05-15T14:49:04.403780+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'350","last_scrub_stamp":"2024-05-15T14:49:04.403697+0000","last_deep_scrub":"39'350","last_deep_scrub_stamp":"2024-05-15T14:49:04.403697+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.403697+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:59:21.647975+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":528,"num_write":320,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'927","reported_seq":1409,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.391534+0000","last_change":"2024-05-15T14:49:15.391565+0000","last_active":"2024-05-15T14:49:15.391534+0000","last_peered":"2024-05-15T14:49:15.391534+0000","last_clean":"2024-05-15T14:49:15.391534+0000","last_became_active":"2024-05-15T14:28:00.884042+0000","last_became_peered":"2024-05-15T14:28:00.884042+0000","last_unstale":"2024-05-15T14:49:15.391534+0000","last_undegraded":"2024-05-15T14:49:15.391534+0000","last_fullsized":"2024-05-15T14:49:15.391534+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:15.391447+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:15.391447+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.391447+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:52:07.864522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"39'23","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.892920+0000","last_change":"2024-05-15T14:49:26.892950+0000","last_active":"2024-05-15T14:49:26.892920+0000","last_peered":"2024-05-15T14:49:26.892920+0000","last_clean":"2024-05-15T14:49:26.892920+0000","last_became_active":"2024-05-15T14:28:02.888602+0000","last_became_peered":"2024-05-15T14:28:02.888602+0000","last_unstale":"2024-05-15T14:49:26.892920+0000","last_undegraded":"2024-05-15T14:49:26.892920+0000","last_fullsized":"2024-05-15T14:49:26.892920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'23","last_scrub_stamp":"2024-05-15T14:49:26.892788+0000","last_deep_scrub":"39'23","last_deep_scrub_stamp":"2024-05-15T14:49:26.892788+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.892788+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:42.995238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.509710+0000","last_change":"2024-05-15T14:49:39.509745+0000","last_active":"2024-05-15T14:49:39.509710+0000","last_peered":"2024-05-15T14:49:39.509710+0000","last_clean":"2024-05-15T14:49:39.509710+0000","last_became_active":"2024-05-15T14:31:16.591677+0000","last_became_peered":"2024-05-15T14:31:16.591677+0000","last_unstale":"2024-05-15T14:49:39.509710+0000","last_undegraded":"2024-05-15T14:49:39.509710+0000","last_fullsized":"2024-05-15T14:49:39.509710+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:39.509600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:39.509600+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.509600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:37:29.974176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'72","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.318322+0000","last_change":"2024-05-15T14:49:30.318355+0000","last_active":"2024-05-15T14:49:30.318322+0000","last_peered":"2024-05-15T14:49:30.318322+0000","last_clean":"2024-05-15T14:49:30.318322+0000","last_became_active":"2024-05-15T14:27:52.844221+0000","last_became_peered":"2024-05-15T14:27:52.844221+0000","last_unstale":"2024-05-15T14:49:30.318322+0000","last_undegraded":"2024-05-15T14:49:30.318322+0000","last_fullsized":"2024-05-15T14:49:30.318322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'72","last_scrub_stamp":"2024-05-15T14:49:30.318216+0000","last_deep_scrub":"39'72","last_deep_scrub_stamp":"2024-05-15T14:49:30.318216+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.318216+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:30.322108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":255,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"39'18","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.303503+0000","last_change":"2024-05-15T14:49:27.303503+0000","last_active":"2024-05-15T14:49:27.303503+0000","last_peered":"2024-05-15T14:49:27.303503+0000","last_clean":"2024-05-15T14:49:27.303503+0000","last_became_active":"2024-05-15T14:27:50.846927+0000","last_became_peered":"2024-05-15T14:27:50.846927+0000","last_unstale":"2024-05-15T14:49:27.303503+0000","last_undegraded":"2024-05-15T14:49:27.303503+0000","last_fullsized":"2024-05-15T14:49:27.303503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:27.303383+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:27.303383+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.303383+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:30.688321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":82,"num_write_kb":24687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'8","reported_seq":814,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.094573+0000","last_change":"2024-05-15T14:49:26.094607+0000","last_active":"2024-05-15T14:49:26.094573+0000","last_peered":"2024-05-15T14:49:26.094573+0000","last_clean":"2024-05-15T14:49:26.094573+0000","last_became_active":"2024-05-15T14:27:56.882055+0000","last_became_peered":"2024-05-15T14:27:56.882055+0000","last_unstale":"2024-05-15T14:49:26.094573+0000","last_undegraded":"2024-05-15T14:49:26.094573+0000","last_fullsized":"2024-05-15T14:49:26.094573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:26.094482+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:26.094482+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.094482+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:02.156212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1075,"num_read_kb":1818,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"39'236","reported_seq":398,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.677996+0000","last_change":"2024-05-15T14:49:17.678035+0000","last_active":"2024-05-15T14:49:17.677996+0000","last_peered":"2024-05-15T14:49:17.677996+0000","last_clean":"2024-05-15T14:49:17.677996+0000","last_became_active":"2024-05-15T14:27:58.878514+0000","last_became_peered":"2024-05-15T14:27:58.878514+0000","last_unstale":"2024-05-15T14:49:17.677996+0000","last_undegraded":"2024-05-15T14:49:17.677996+0000","last_fullsized":"2024-05-15T14:49:17.677996+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'236","last_scrub_stamp":"2024-05-15T14:49:17.677899+0000","last_deep_scrub":"39'236","last_deep_scrub_stamp":"2024-05-15T14:49:17.677899+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.677899+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:19.987437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":332,"num_write":230,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'927","reported_seq":1441,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.122473+0000","last_change":"2024-05-15T14:49:23.122522+0000","last_active":"2024-05-15T14:49:23.122473+0000","last_peered":"2024-05-15T14:49:23.122473+0000","last_clean":"2024-05-15T14:49:23.122473+0000","last_became_active":"2024-05-15T14:28:00.891535+0000","last_became_peered":"2024-05-15T14:28:00.891535+0000","last_unstale":"2024-05-15T14:49:23.122473+0000","last_undegraded":"2024-05-15T14:49:23.122473+0000","last_fullsized":"2024-05-15T14:49:23.122473+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:23.122375+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:23.122375+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.122375+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:20.965906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"39'19","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.276780+0000","last_change":"2024-05-15T14:49:36.276820+0000","last_active":"2024-05-15T14:49:36.276780+0000","last_peered":"2024-05-15T14:49:36.276780+0000","last_clean":"2024-05-15T14:49:36.276780+0000","last_became_active":"2024-05-15T14:28:02.889039+0000","last_became_peered":"2024-05-15T14:28:02.889039+0000","last_unstale":"2024-05-15T14:49:36.276780+0000","last_undegraded":"2024-05-15T14:49:36.276780+0000","last_fullsized":"2024-05-15T14:49:36.276780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'19","last_scrub_stamp":"2024-05-15T14:49:36.276654+0000","last_deep_scrub":"39'19","last_deep_scrub_stamp":"2024-05-15T14:49:36.276654+0000","last_clean_scrub_stamp":"2024-05-15T14:49:36.276654+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:42.073143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:57.535332+0000","last_change":"2024-05-15T14:31:16.593519+0000","last_active":"2024-05-15T14:47:57.535332+0000","last_peered":"2024-05-15T14:47:57.535332+0000","last_clean":"2024-05-15T14:47:57.535332+0000","last_became_active":"2024-05-15T14:31:16.593216+0000","last_became_peered":"2024-05-15T14:31:16.593216+0000","last_unstale":"2024-05-15T14:47:57.535332+0000","last_undegraded":"2024-05-15T14:47:57.535332+0000","last_fullsized":"2024-05-15T14:47:57.535332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'24","reported_seq":127,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.074672+0000","last_change":"2024-05-15T14:49:05.074702+0000","last_active":"2024-05-15T14:49:05.074672+0000","last_peered":"2024-05-15T14:49:05.074672+0000","last_clean":"2024-05-15T14:49:05.074672+0000","last_became_active":"2024-05-15T14:27:52.854963+0000","last_became_peered":"2024-05-15T14:27:52.854963+0000","last_unstale":"2024-05-15T14:49:05.074672+0000","last_undegraded":"2024-05-15T14:49:05.074672+0000","last_fullsized":"2024-05-15T14:49:05.074672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:05.074578+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:05.074578+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.074578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:32:21.114015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.399633+0000","last_change":"2024-05-15T14:49:36.399660+0000","last_active":"2024-05-15T14:49:36.399633+0000","last_peered":"2024-05-15T14:49:36.399633+0000","last_clean":"2024-05-15T14:49:36.399633+0000","last_became_active":"2024-05-15T14:27:50.847163+0000","last_became_peered":"2024-05-15T14:27:50.847163+0000","last_unstale":"2024-05-15T14:49:36.399633+0000","last_undegraded":"2024-05-15T14:49:36.399633+0000","last_fullsized":"2024-05-15T14:49:36.399633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:36.399538+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:36.399538+0000","last_clean_scrub_stamp":"2024-05-15T14:49:36.399538+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:55:23.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.263987+0000","last_change":"2024-05-15T14:49:22.264039+0000","last_active":"2024-05-15T14:49:22.263987+0000","last_peered":"2024-05-15T14:49:22.263987+0000","last_clean":"2024-05-15T14:49:22.263987+0000","last_became_active":"2024-05-15T14:27:56.879526+0000","last_became_peered":"2024-05-15T14:27:56.879526+0000","last_unstale":"2024-05-15T14:49:22.263987+0000","last_undegraded":"2024-05-15T14:49:22.263987+0000","last_fullsized":"2024-05-15T14:49:22.263987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.263889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.263889+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.263889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:36.466384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"39'416","reported_seq":710,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.057957+0000","last_change":"2024-05-15T14:49:13.058004+0000","last_active":"2024-05-15T14:49:13.057957+0000","last_peered":"2024-05-15T14:49:13.057957+0000","last_clean":"2024-05-15T14:49:13.057957+0000","last_became_active":"2024-05-15T14:27:58.882886+0000","last_became_peered":"2024-05-15T14:27:58.882886+0000","last_unstale":"2024-05-15T14:49:13.057957+0000","last_undegraded":"2024-05-15T14:49:13.057957+0000","last_fullsized":"2024-05-15T14:49:13.057957+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'416","last_scrub_stamp":"2024-05-15T14:49:13.057869+0000","last_deep_scrub":"39'416","last_deep_scrub_stamp":"2024-05-15T14:49:13.057869+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.057869+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:36.795312+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":660,"num_read_kb":650,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20716,"num_omap_keys":50,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.111476+0000","last_change":"2024-05-15T14:49:09.111501+0000","last_active":"2024-05-15T14:49:09.111476+0000","last_peered":"2024-05-15T14:49:09.111476+0000","last_clean":"2024-05-15T14:49:09.111476+0000","last_became_active":"2024-05-15T14:28:00.885434+0000","last_became_peered":"2024-05-15T14:28:00.885434+0000","last_unstale":"2024-05-15T14:49:09.111476+0000","last_undegraded":"2024-05-15T14:49:09.111476+0000","last_fullsized":"2024-05-15T14:49:09.111476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:09.111389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:09.111389+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.111389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:45:41.785247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"39'18","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.844612+0000","last_change":"2024-05-15T14:49:27.844638+0000","last_active":"2024-05-15T14:49:27.844612+0000","last_peered":"2024-05-15T14:49:27.844612+0000","last_clean":"2024-05-15T14:49:27.844612+0000","last_became_active":"2024-05-15T14:28:02.889918+0000","last_became_peered":"2024-05-15T14:28:02.889918+0000","last_unstale":"2024-05-15T14:49:27.844612+0000","last_undegraded":"2024-05-15T14:49:27.844612+0000","last_fullsized":"2024-05-15T14:49:27.844612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:27.844524+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:27.844524+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.844524+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:52.076277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:37.540394+0000","last_change":"2024-05-15T14:31:16.594123+0000","last_active":"2024-05-15T14:48:37.540394+0000","last_peered":"2024-05-15T14:48:37.540394+0000","last_clean":"2024-05-15T14:48:37.540394+0000","last_became_active":"2024-05-15T14:31:16.593813+0000","last_became_peered":"2024-05-15T14:31:16.593813+0000","last_unstale":"2024-05-15T14:48:37.540394+0000","last_undegraded":"2024-05-15T14:48:37.540394+0000","last_fullsized":"2024-05-15T14:48:37.540394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'64","reported_seq":193,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.154976+0000","last_change":"2024-05-15T14:49:10.155001+0000","last_active":"2024-05-15T14:49:10.154976+0000","last_peered":"2024-05-15T14:49:10.154976+0000","last_clean":"2024-05-15T14:49:10.154976+0000","last_became_active":"2024-05-15T14:27:52.846508+0000","last_became_peered":"2024-05-15T14:27:52.846508+0000","last_unstale":"2024-05-15T14:49:10.154976+0000","last_undegraded":"2024-05-15T14:49:10.154976+0000","last_fullsized":"2024-05-15T14:49:10.154976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'64","last_scrub_stamp":"2024-05-15T14:49:10.154883+0000","last_deep_scrub":"39'64","last_deep_scrub_stamp":"2024-05-15T14:49:10.154883+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.154883+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:47:28.394116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":231,"num_write":88,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"39'74","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.587822+0000","last_change":"2024-05-15T14:49:28.587864+0000","last_active":"2024-05-15T14:49:28.587822+0000","last_peered":"2024-05-15T14:49:28.587822+0000","last_clean":"2024-05-15T14:49:28.587822+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:49:28.587822+0000","last_undegraded":"2024-05-15T14:49:28.587822+0000","last_fullsized":"2024-05-15T14:49:28.587822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2024-05-15T14:49:28.587714+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2024-05-15T14:49:28.587714+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.587714+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:04.649444+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.016557+0000","last_change":"2024-05-15T14:49:30.016580+0000","last_active":"2024-05-15T14:49:30.016557+0000","last_peered":"2024-05-15T14:49:30.016557+0000","last_clean":"2024-05-15T14:49:30.016557+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:49:30.016557+0000","last_undegraded":"2024-05-15T14:49:30.016557+0000","last_fullsized":"2024-05-15T14:49:30.016557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:30.016466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:30.016466+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.016466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:32.326004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"39'26","reported_seq":121,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:40.454187+0000","last_change":"2024-05-15T14:49:40.454217+0000","last_active":"2024-05-15T14:49:40.454187+0000","last_peered":"2024-05-15T14:49:40.454187+0000","last_clean":"2024-05-15T14:49:40.454187+0000","last_became_active":"2024-05-15T14:27:50.849731+0000","last_became_peered":"2024-05-15T14:27:50.849731+0000","last_unstale":"2024-05-15T14:49:40.454187+0000","last_undegraded":"2024-05-15T14:49:40.454187+0000","last_fullsized":"2024-05-15T14:49:40.454187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:40.454087+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:40.454087+0000","last_clean_scrub_stamp":"2024-05-15T14:49:40.454087+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:47:16.424071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":50,"num_write":130,"num_write_kb":35292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.696735+0000","last_change":"2024-05-15T14:49:22.696760+0000","last_active":"2024-05-15T14:49:22.696735+0000","last_peered":"2024-05-15T14:49:22.696735+0000","last_clean":"2024-05-15T14:49:22.696735+0000","last_became_active":"2024-05-15T14:27:56.878611+0000","last_became_peered":"2024-05-15T14:27:56.878611+0000","last_unstale":"2024-05-15T14:49:22.696735+0000","last_undegraded":"2024-05-15T14:49:22.696735+0000","last_fullsized":"2024-05-15T14:49:22.696735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.696623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.696623+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.696623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:38.799072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"39'354","reported_seq":3199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.975561+0000","last_change":"2024-05-15T14:49:09.975561+0000","last_active":"2024-05-15T14:49:09.975561+0000","last_peered":"2024-05-15T14:49:09.975561+0000","last_clean":"2024-05-15T14:49:09.975561+0000","last_became_active":"2024-05-15T14:27:58.884237+0000","last_became_peered":"2024-05-15T14:27:58.884237+0000","last_unstale":"2024-05-15T14:49:09.975561+0000","last_undegraded":"2024-05-15T14:49:09.975561+0000","last_fullsized":"2024-05-15T14:49:09.975561+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'354","last_scrub_stamp":"2024-05-15T14:49:09.975429+0000","last_deep_scrub":"39'354","last_deep_scrub_stamp":"2024-05-15T14:49:09.975429+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.975429+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:07.818959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":8049,"num_read_kb":5529,"num_write":261,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2876,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.100873+0000","last_change":"2024-05-15T14:49:06.100873+0000","last_active":"2024-05-15T14:49:06.100873+0000","last_peered":"2024-05-15T14:49:06.100873+0000","last_clean":"2024-05-15T14:49:06.100873+0000","last_became_active":"2024-05-15T14:28:00.886539+0000","last_became_peered":"2024-05-15T14:28:00.886539+0000","last_unstale":"2024-05-15T14:49:06.100873+0000","last_undegraded":"2024-05-15T14:49:06.100873+0000","last_fullsized":"2024-05-15T14:49:06.100873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.100716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.100716+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.100716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:03.944246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"39'22","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.146255+0000","last_change":"2024-05-15T14:49:26.146255+0000","last_active":"2024-05-15T14:49:26.146255+0000","last_peered":"2024-05-15T14:49:26.146255+0000","last_clean":"2024-05-15T14:49:26.146255+0000","last_became_active":"2024-05-15T14:28:02.892076+0000","last_became_peered":"2024-05-15T14:28:02.892076+0000","last_unstale":"2024-05-15T14:49:26.146255+0000","last_undegraded":"2024-05-15T14:49:26.146255+0000","last_fullsized":"2024-05-15T14:49:26.146255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:26.146097+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:26.146097+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.146097+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:49.883540+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.b","version":"39'3","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:00.116287+0000","last_change":"2024-05-15T14:31:16.592642+0000","last_active":"2024-05-15T14:49:00.116287+0000","last_peered":"2024-05-15T14:49:00.116287+0000","last_clean":"2024-05-15T14:49:00.116287+0000","last_became_active":"2024-05-15T14:31:16.592325+0000","last_became_peered":"2024-05-15T14:31:16.592325+0000","last_unstale":"2024-05-15T14:49:00.116287+0000","last_undegraded":"2024-05-15T14:49:00.116287+0000","last_fullsized":"2024-05-15T14:49:00.116287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'26","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.181514+0000","last_change":"2024-05-15T14:49:15.181514+0000","last_active":"2024-05-15T14:49:15.181514+0000","last_peered":"2024-05-15T14:49:15.181514+0000","last_clean":"2024-05-15T14:49:15.181514+0000","last_became_active":"2024-05-15T14:27:52.858631+0000","last_became_peered":"2024-05-15T14:27:52.858631+0000","last_unstale":"2024-05-15T14:49:15.181514+0000","last_undegraded":"2024-05-15T14:49:15.181514+0000","last_fullsized":"2024-05-15T14:49:15.181514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.181369+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.181369+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.181369+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:23.248736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.598491+0000","last_change":"2024-05-15T14:49:29.598516+0000","last_active":"2024-05-15T14:49:29.598491+0000","last_peered":"2024-05-15T14:49:29.598491+0000","last_clean":"2024-05-15T14:49:29.598491+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:49:29.598491+0000","last_undegraded":"2024-05-15T14:49:29.598491+0000","last_fullsized":"2024-05-15T14:49:29.598491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:29.598393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:29.598393+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.598393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:10:35.233991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'9","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.246523+0000","last_change":"2024-05-15T14:49:31.246550+0000","last_active":"2024-05-15T14:49:31.246523+0000","last_peered":"2024-05-15T14:49:31.246523+0000","last_clean":"2024-05-15T14:49:31.246523+0000","last_became_active":"2024-05-15T14:27:50.833509+0000","last_became_peered":"2024-05-15T14:27:50.833509+0000","last_unstale":"2024-05-15T14:49:31.246523+0000","last_undegraded":"2024-05-15T14:49:31.246523+0000","last_fullsized":"2024-05-15T14:49:31.246523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'9","last_scrub_stamp":"2024-05-15T14:49:31.246424+0000","last_deep_scrub":"39'9","last_deep_scrub_stamp":"2024-05-15T14:49:31.246424+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.246424+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:37:15.619769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":37,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.092794+0000","last_change":"2024-05-15T14:49:20.092794+0000","last_active":"2024-05-15T14:49:20.092794+0000","last_peered":"2024-05-15T14:49:20.092794+0000","last_clean":"2024-05-15T14:49:20.092794+0000","last_became_active":"2024-05-15T14:27:56.876526+0000","last_became_peered":"2024-05-15T14:27:56.876526+0000","last_unstale":"2024-05-15T14:49:20.092794+0000","last_undegraded":"2024-05-15T14:49:20.092794+0000","last_fullsized":"2024-05-15T14:49:20.092794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:20.092624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:20.092624+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.092624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:36.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"39'1105","reported_seq":2239,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.104318+0000","last_change":"2024-05-15T14:49:10.104373+0000","last_active":"2024-05-15T14:49:10.104318+0000","last_peered":"2024-05-15T14:49:10.104318+0000","last_clean":"2024-05-15T14:49:10.104318+0000","last_became_active":"2024-05-15T14:27:58.887083+0000","last_became_peered":"2024-05-15T14:27:58.887083+0000","last_unstale":"2024-05-15T14:49:10.104318+0000","last_undegraded":"2024-05-15T14:49:10.104318+0000","last_fullsized":"2024-05-15T14:49:10.104318+0000","mapping_epoch":26,"log_start":"39'1000","ondisk_log_start":"39'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1105","last_scrub_stamp":"2024-05-15T14:49:10.104218+0000","last_deep_scrub":"39'1105","last_deep_scrub_stamp":"2024-05-15T14:49:10.104218+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.104218+0000","objects_scrubbed":11,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:30.050249+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1728,"num_read_kb":1712,"num_write":408,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.957705+0000","last_change":"2024-05-15T14:49:04.957756+0000","last_active":"2024-05-15T14:49:04.957705+0000","last_peered":"2024-05-15T14:49:04.957705+0000","last_clean":"2024-05-15T14:49:04.957705+0000","last_became_active":"2024-05-15T14:28:00.890321+0000","last_became_peered":"2024-05-15T14:28:00.890321+0000","last_unstale":"2024-05-15T14:49:04.957705+0000","last_undegraded":"2024-05-15T14:49:04.957705+0000","last_fullsized":"2024-05-15T14:49:04.957705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.957607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.957607+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.957607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:35.222322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"39'20","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.124776+0000","last_change":"2024-05-15T14:49:01.124836+0000","last_active":"2024-05-15T14:49:01.124776+0000","last_peered":"2024-05-15T14:49:01.124776+0000","last_clean":"2024-05-15T14:49:01.124776+0000","last_became_active":"2024-05-15T14:28:02.883249+0000","last_became_peered":"2024-05-15T14:28:02.883249+0000","last_unstale":"2024-05-15T14:49:01.124776+0000","last_undegraded":"2024-05-15T14:49:01.124776+0000","last_fullsized":"2024-05-15T14:49:01.124776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:01.124687+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:01.124687+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.124687+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:37.809153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:42.432061+0000","last_change":"2024-05-15T14:31:16.593784+0000","last_active":"2024-05-15T14:48:42.432061+0000","last_peered":"2024-05-15T14:48:42.432061+0000","last_clean":"2024-05-15T14:48:42.432061+0000","last_became_active":"2024-05-15T14:31:16.593500+0000","last_became_peered":"2024-05-15T14:31:16.593500+0000","last_unstale":"2024-05-15T14:48:42.432061+0000","last_undegraded":"2024-05-15T14:48:42.432061+0000","last_fullsized":"2024-05-15T14:48:42.432061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"39'14","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.041346+0000","last_change":"2024-05-15T14:49:13.041346+0000","last_active":"2024-05-15T14:49:13.041346+0000","last_peered":"2024-05-15T14:49:13.041346+0000","last_clean":"2024-05-15T14:49:13.041346+0000","last_became_active":"2024-05-15T14:27:52.844149+0000","last_became_peered":"2024-05-15T14:27:52.844149+0000","last_unstale":"2024-05-15T14:49:13.041346+0000","last_undegraded":"2024-05-15T14:49:13.041346+0000","last_fullsized":"2024-05-15T14:49:13.041346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:13.041221+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:13.041221+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.041221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:39.891498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.377083+0000","last_change":"2024-05-15T14:49:06.377115+0000","last_active":"2024-05-15T14:49:06.377083+0000","last_peered":"2024-05-15T14:49:06.377083+0000","last_clean":"2024-05-15T14:49:06.377083+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:49:06.377083+0000","last_undegraded":"2024-05-15T14:49:06.377083+0000","last_fullsized":"2024-05-15T14:49:06.377083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.376986+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.376986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:08.760321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'16","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.984108+0000","last_change":"2024-05-15T14:49:22.984137+0000","last_active":"2024-05-15T14:49:22.984108+0000","last_peered":"2024-05-15T14:49:22.984108+0000","last_clean":"2024-05-15T14:49:22.984108+0000","last_became_active":"2024-05-15T14:27:50.844771+0000","last_became_peered":"2024-05-15T14:27:50.844771+0000","last_unstale":"2024-05-15T14:49:22.984108+0000","last_undegraded":"2024-05-15T14:49:22.984108+0000","last_fullsized":"2024-05-15T14:49:22.984108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:22.984002+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:22.984002+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.984002+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:36.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"39'15","reported_seq":735,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.399123+0000","last_change":"2024-05-15T14:49:03.399123+0000","last_active":"2024-05-15T14:49:03.399123+0000","last_peered":"2024-05-15T14:49:03.399123+0000","last_clean":"2024-05-15T14:49:03.399123+0000","last_became_active":"2024-05-15T14:27:56.880109+0000","last_became_peered":"2024-05-15T14:27:56.880109+0000","last_unstale":"2024-05-15T14:49:03.399123+0000","last_undegraded":"2024-05-15T14:49:03.399123+0000","last_fullsized":"2024-05-15T14:49:03.399123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2024-05-15T14:49:03.399009+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2024-05-15T14:49:03.399009+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.399009+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:30:51.827026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":702,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"39'279","reported_seq":780,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.913793+0000","last_change":"2024-05-15T14:49:08.913863+0000","last_active":"2024-05-15T14:49:08.913793+0000","last_peered":"2024-05-15T14:49:08.913793+0000","last_clean":"2024-05-15T14:49:08.913793+0000","last_became_active":"2024-05-15T14:27:58.888477+0000","last_became_peered":"2024-05-15T14:27:58.888477+0000","last_unstale":"2024-05-15T14:49:08.913793+0000","last_undegraded":"2024-05-15T14:49:08.913793+0000","last_fullsized":"2024-05-15T14:49:08.913793+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'279","last_scrub_stamp":"2024-05-15T14:49:08.913654+0000","last_deep_scrub":"39'279","last_deep_scrub_stamp":"2024-05-15T14:49:08.913654+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.913654+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:35.763932+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":392,"num_write":265,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.161705+0000","last_change":"2024-05-15T14:49:11.161731+0000","last_active":"2024-05-15T14:49:11.161705+0000","last_peered":"2024-05-15T14:49:11.161705+0000","last_clean":"2024-05-15T14:49:11.161705+0000","last_became_active":"2024-05-15T14:28:00.880488+0000","last_became_peered":"2024-05-15T14:28:00.880488+0000","last_unstale":"2024-05-15T14:49:11.161705+0000","last_undegraded":"2024-05-15T14:49:11.161705+0000","last_fullsized":"2024-05-15T14:49:11.161705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:11.161591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:11.161591+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.161591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:31.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'21","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.651522+0000","last_change":"2024-05-15T14:49:12.651546+0000","last_active":"2024-05-15T14:49:12.651522+0000","last_peered":"2024-05-15T14:49:12.651522+0000","last_clean":"2024-05-15T14:49:12.651522+0000","last_became_active":"2024-05-15T14:28:02.893812+0000","last_became_peered":"2024-05-15T14:28:02.893812+0000","last_unstale":"2024-05-15T14:49:12.651522+0000","last_undegraded":"2024-05-15T14:49:12.651522+0000","last_fullsized":"2024-05-15T14:49:12.651522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'21","last_scrub_stamp":"2024-05-15T14:49:12.651430+0000","last_deep_scrub":"39'21","last_deep_scrub_stamp":"2024-05-15T14:49:12.651430+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.651430+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:16.036367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":112,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:41.428283+0000","last_change":"2024-05-15T14:49:41.428309+0000","last_active":"2024-05-15T14:49:41.428283+0000","last_peered":"2024-05-15T14:49:41.428283+0000","last_clean":"2024-05-15T14:49:41.428283+0000","last_became_active":"2024-05-15T14:31:16.589610+0000","last_became_peered":"2024-05-15T14:31:16.589610+0000","last_unstale":"2024-05-15T14:49:41.428283+0000","last_undegraded":"2024-05-15T14:49:41.428283+0000","last_fullsized":"2024-05-15T14:49:41.428283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:41.428185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:41.428185+0000","last_clean_scrub_stamp":"2024-05-15T14:49:41.428185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:24:46.801884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"39'4","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.055419+0000","last_change":"2024-05-15T14:49:17.055450+0000","last_active":"2024-05-15T14:49:17.055419+0000","last_peered":"2024-05-15T14:49:17.055419+0000","last_clean":"2024-05-15T14:49:17.055419+0000","last_became_active":"2024-05-15T14:27:52.839722+0000","last_became_peered":"2024-05-15T14:27:52.839722+0000","last_unstale":"2024-05-15T14:49:17.055419+0000","last_undegraded":"2024-05-15T14:49:17.055419+0000","last_fullsized":"2024-05-15T14:49:17.055419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:17.055311+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:17.055311+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.055311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:14.898841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.012122+0000","last_change":"2024-05-15T14:49:31.012146+0000","last_active":"2024-05-15T14:49:31.012122+0000","last_peered":"2024-05-15T14:49:31.012122+0000","last_clean":"2024-05-15T14:49:31.012122+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:49:31.012122+0000","last_undegraded":"2024-05-15T14:49:31.012122+0000","last_fullsized":"2024-05-15T14:49:31.012122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:31.012020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:31.012020+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.012020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:34.137354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'16","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.231777+0000","last_change":"2024-05-15T14:49:25.231800+0000","last_active":"2024-05-15T14:49:25.231777+0000","last_peered":"2024-05-15T14:49:25.231777+0000","last_clean":"2024-05-15T14:49:25.231777+0000","last_became_active":"2024-05-15T14:27:50.836731+0000","last_became_peered":"2024-05-15T14:27:50.836731+0000","last_unstale":"2024-05-15T14:49:25.231777+0000","last_undegraded":"2024-05-15T14:49:25.231777+0000","last_fullsized":"2024-05-15T14:49:25.231777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:25.231680+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:25.231680+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.231680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:01.652066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.169731+0000","last_change":"2024-05-15T14:49:21.169756+0000","last_active":"2024-05-15T14:49:21.169731+0000","last_peered":"2024-05-15T14:49:21.169731+0000","last_clean":"2024-05-15T14:49:21.169731+0000","last_became_active":"2024-05-15T14:27:56.880118+0000","last_became_peered":"2024-05-15T14:27:56.880118+0000","last_unstale":"2024-05-15T14:49:21.169731+0000","last_undegraded":"2024-05-15T14:49:21.169731+0000","last_fullsized":"2024-05-15T14:49:21.169731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.169636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.169636+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.169636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:24.554573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"39'336","reported_seq":83291,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.635265+0000","last_change":"2024-05-15T14:49:13.635265+0000","last_active":"2024-05-15T14:49:13.635265+0000","last_peered":"2024-05-15T14:49:13.635265+0000","last_clean":"2024-05-15T14:49:13.635265+0000","last_became_active":"2024-05-15T14:27:58.882039+0000","last_became_peered":"2024-05-15T14:27:58.882039+0000","last_unstale":"2024-05-15T14:49:13.635265+0000","last_undegraded":"2024-05-15T14:49:13.635265+0000","last_fullsized":"2024-05-15T14:49:13.635265+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'336","last_scrub_stamp":"2024-05-15T14:49:13.635123+0000","last_deep_scrub":"39'336","last_deep_scrub_stamp":"2024-05-15T14:49:13.635123+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.635123+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:46.736637+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207654,"num_read_kb":557003,"num_write":353,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.107779+0000","last_change":"2024-05-15T14:49:21.107779+0000","last_active":"2024-05-15T14:49:21.107779+0000","last_peered":"2024-05-15T14:49:21.107779+0000","last_clean":"2024-05-15T14:49:21.107779+0000","last_became_active":"2024-05-15T14:28:00.887095+0000","last_became_peered":"2024-05-15T14:28:00.887095+0000","last_unstale":"2024-05-15T14:49:21.107779+0000","last_undegraded":"2024-05-15T14:49:21.107779+0000","last_fullsized":"2024-05-15T14:49:21.107779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.107618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.107618+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.107618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:39.068756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"39'15","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.884290+0000","last_change":"2024-05-15T14:49:03.884290+0000","last_active":"2024-05-15T14:49:03.884290+0000","last_peered":"2024-05-15T14:49:03.884290+0000","last_clean":"2024-05-15T14:49:03.884290+0000","last_became_active":"2024-05-15T14:28:02.892255+0000","last_became_peered":"2024-05-15T14:28:02.892255+0000","last_unstale":"2024-05-15T14:49:03.884290+0000","last_undegraded":"2024-05-15T14:49:03.884290+0000","last_fullsized":"2024-05-15T14:49:03.884290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2024-05-15T14:49:03.884167+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2024-05-15T14:49:03.884167+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.884167+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:57:22.423172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.446109+0000","last_change":"2024-05-15T14:31:16.593868+0000","last_active":"2024-05-15T14:49:02.446109+0000","last_peered":"2024-05-15T14:49:02.446109+0000","last_clean":"2024-05-15T14:49:02.446109+0000","last_became_active":"2024-05-15T14:31:16.593582+0000","last_became_peered":"2024-05-15T14:31:16.593582+0000","last_unstale":"2024-05-15T14:49:02.446109+0000","last_undegraded":"2024-05-15T14:49:02.446109+0000","last_fullsized":"2024-05-15T14:49:02.446109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'44","reported_seq":122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.067907+0000","last_change":"2024-05-15T14:49:07.067938+0000","last_active":"2024-05-15T14:49:07.067907+0000","last_peered":"2024-05-15T14:49:07.067907+0000","last_clean":"2024-05-15T14:49:07.067907+0000","last_became_active":"2024-05-15T14:27:52.851166+0000","last_became_peered":"2024-05-15T14:27:52.851166+0000","last_unstale":"2024-05-15T14:49:07.067907+0000","last_undegraded":"2024-05-15T14:49:07.067907+0000","last_fullsized":"2024-05-15T14:49:07.067907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'44","last_scrub_stamp":"2024-05-15T14:49:07.067797+0000","last_deep_scrub":"39'44","last_deep_scrub_stamp":"2024-05-15T14:49:07.067797+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.067797+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:04.265322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":125,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"39'8","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.432913+0000","last_change":"2024-05-15T14:49:18.432913+0000","last_active":"2024-05-15T14:49:18.432913+0000","last_peered":"2024-05-15T14:49:18.432913+0000","last_clean":"2024-05-15T14:49:18.432913+0000","last_became_active":"2024-05-15T14:28:37.941149+0000","last_became_peered":"2024-05-15T14:28:37.941149+0000","last_unstale":"2024-05-15T14:49:18.432913+0000","last_undegraded":"2024-05-15T14:49:18.432913+0000","last_fullsized":"2024-05-15T14:49:18.432913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:18.432781+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:18.432781+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.432781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:47:36.672014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11,"num_write":32,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.039657+0000","last_change":"2024-05-15T14:49:19.039683+0000","last_active":"2024-05-15T14:49:19.039657+0000","last_peered":"2024-05-15T14:49:19.039657+0000","last_clean":"2024-05-15T14:49:19.039657+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:49:19.039657+0000","last_undegraded":"2024-05-15T14:49:19.039657+0000","last_fullsized":"2024-05-15T14:49:19.039657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:19.039556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:19.039556+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.039556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:39.599575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.255292+0000","last_change":"2024-05-15T14:49:23.255319+0000","last_active":"2024-05-15T14:49:23.255292+0000","last_peered":"2024-05-15T14:49:23.255292+0000","last_clean":"2024-05-15T14:49:23.255292+0000","last_became_active":"2024-05-15T14:27:56.881083+0000","last_became_peered":"2024-05-15T14:27:56.881083+0000","last_unstale":"2024-05-15T14:49:23.255292+0000","last_undegraded":"2024-05-15T14:49:23.255292+0000","last_fullsized":"2024-05-15T14:49:23.255292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:23.255168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:23.255168+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.255168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:54:19.736551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"39'495","reported_seq":961,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.375580+0000","last_change":"2024-05-15T14:49:39.375634+0000","last_active":"2024-05-15T14:49:39.375580+0000","last_peered":"2024-05-15T14:49:39.375580+0000","last_clean":"2024-05-15T14:49:39.375580+0000","last_became_active":"2024-05-15T14:27:58.883886+0000","last_became_peered":"2024-05-15T14:27:58.883886+0000","last_unstale":"2024-05-15T14:49:39.375580+0000","last_undegraded":"2024-05-15T14:49:39.375580+0000","last_fullsized":"2024-05-15T14:49:39.375580+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'495","last_scrub_stamp":"2024-05-15T14:49:39.375484+0000","last_deep_scrub":"39'495","last_deep_scrub_stamp":"2024-05-15T14:49:39.375484+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.375484+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:01:02.159612+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1031,"num_read_kb":1287,"num_write":497,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1490,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.420978+0000","last_change":"2024-05-15T14:49:02.421002+0000","last_active":"2024-05-15T14:49:02.420978+0000","last_peered":"2024-05-15T14:49:02.420978+0000","last_clean":"2024-05-15T14:49:02.420978+0000","last_became_active":"2024-05-15T14:28:00.884315+0000","last_became_peered":"2024-05-15T14:28:00.884315+0000","last_unstale":"2024-05-15T14:49:02.420978+0000","last_undegraded":"2024-05-15T14:49:02.420978+0000","last_fullsized":"2024-05-15T14:49:02.420978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:02.420884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:02.420884+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.420884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:35:34.607185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"39'38","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.066817+0000","last_change":"2024-05-15T14:49:02.066854+0000","last_active":"2024-05-15T14:49:02.066817+0000","last_peered":"2024-05-15T14:49:02.066817+0000","last_clean":"2024-05-15T14:49:02.066817+0000","last_became_active":"2024-05-15T14:28:02.889093+0000","last_became_peered":"2024-05-15T14:28:02.889093+0000","last_unstale":"2024-05-15T14:49:02.066817+0000","last_undegraded":"2024-05-15T14:49:02.066817+0000","last_fullsized":"2024-05-15T14:49:02.066817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'38","last_scrub_stamp":"2024-05-15T14:49:02.066732+0000","last_deep_scrub":"39'38","last_deep_scrub_stamp":"2024-05-15T14:49:02.066732+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.066732+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:17:37.278158+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":151,"num_write":63,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.538178+0000","last_change":"2024-05-15T14:49:21.538178+0000","last_active":"2024-05-15T14:49:21.538178+0000","last_peered":"2024-05-15T14:49:21.538178+0000","last_clean":"2024-05-15T14:49:21.538178+0000","last_became_active":"2024-05-15T14:31:38.626777+0000","last_became_peered":"2024-05-15T14:31:38.626777+0000","last_unstale":"2024-05-15T14:49:21.538178+0000","last_undegraded":"2024-05-15T14:49:21.538178+0000","last_fullsized":"2024-05-15T14:49:21.538178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.538058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.538058+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.538058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:32:37.577496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'50","reported_seq":150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.304160+0000","last_change":"2024-05-15T14:49:24.304181+0000","last_active":"2024-05-15T14:49:24.304160+0000","last_peered":"2024-05-15T14:49:24.304160+0000","last_clean":"2024-05-15T14:49:24.304160+0000","last_became_active":"2024-05-15T14:27:52.846171+0000","last_became_peered":"2024-05-15T14:27:52.846171+0000","last_unstale":"2024-05-15T14:49:24.304160+0000","last_undegraded":"2024-05-15T14:49:24.304160+0000","last_fullsized":"2024-05-15T14:49:24.304160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'50","last_scrub_stamp":"2024-05-15T14:49:24.304084+0000","last_deep_scrub":"39'50","last_deep_scrub_stamp":"2024-05-15T14:49:24.304084+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.304084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:24.307977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":163,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.994668+0000","last_change":"2024-05-15T14:49:21.994695+0000","last_active":"2024-05-15T14:49:21.994668+0000","last_peered":"2024-05-15T14:49:21.994668+0000","last_clean":"2024-05-15T14:49:21.994668+0000","last_became_active":"2024-05-15T14:27:50.844741+0000","last_became_peered":"2024-05-15T14:27:50.844741+0000","last_unstale":"2024-05-15T14:49:21.994668+0000","last_undegraded":"2024-05-15T14:49:21.994668+0000","last_fullsized":"2024-05-15T14:49:21.994668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:21.994566+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:21.994566+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.994566+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:42.240091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":80,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.590372+0000","last_change":"2024-05-15T14:49:30.590397+0000","last_active":"2024-05-15T14:49:30.590372+0000","last_peered":"2024-05-15T14:49:30.590372+0000","last_clean":"2024-05-15T14:49:30.590372+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:49:30.590372+0000","last_undegraded":"2024-05-15T14:49:30.590372+0000","last_fullsized":"2024-05-15T14:49:30.590372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:30.590286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:30.590286+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.590286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:10:10.662867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.142539+0000","last_change":"2024-05-15T14:49:05.142566+0000","last_active":"2024-05-15T14:49:05.142539+0000","last_peered":"2024-05-15T14:49:05.142539+0000","last_clean":"2024-05-15T14:49:05.142539+0000","last_became_active":"2024-05-15T14:27:56.880842+0000","last_became_peered":"2024-05-15T14:27:56.880842+0000","last_unstale":"2024-05-15T14:49:05.142539+0000","last_undegraded":"2024-05-15T14:49:05.142539+0000","last_fullsized":"2024-05-15T14:49:05.142539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:05.142451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:05.142451+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.142451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:52.024230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"39'499","reported_seq":504335,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.043159+0000","last_change":"2024-05-15T14:49:08.043210+0000","last_active":"2024-05-15T14:49:08.043159+0000","last_peered":"2024-05-15T14:49:08.043159+0000","last_clean":"2024-05-15T14:49:08.043159+0000","last_became_active":"2024-05-15T14:27:58.882284+0000","last_became_peered":"2024-05-15T14:27:58.882284+0000","last_unstale":"2024-05-15T14:49:08.043159+0000","last_undegraded":"2024-05-15T14:49:08.043159+0000","last_fullsized":"2024-05-15T14:49:08.043159+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'499","last_scrub_stamp":"2024-05-15T14:49:08.043071+0000","last_deep_scrub":"39'499","last_deep_scrub_stamp":"2024-05-15T14:49:08.043071+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.043071+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:35:40.229372+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1259744,"num_read_kb":3777635,"num_write":703,"num_write_kb":2009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"39'927","reported_seq":1381,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.919023+0000","last_change":"2024-05-15T14:49:06.919050+0000","last_active":"2024-05-15T14:49:06.919023+0000","last_peered":"2024-05-15T14:49:06.919023+0000","last_clean":"2024-05-15T14:49:06.919023+0000","last_became_active":"2024-05-15T14:28:00.891484+0000","last_became_peered":"2024-05-15T14:28:00.891484+0000","last_unstale":"2024-05-15T14:49:06.919023+0000","last_undegraded":"2024-05-15T14:49:06.919023+0000","last_fullsized":"2024-05-15T14:49:06.919023+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:06.918936+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:06.918936+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.918936+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:24.880073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"39'19","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.637621+0000","last_change":"2024-05-15T14:49:04.637650+0000","last_active":"2024-05-15T14:49:04.637621+0000","last_peered":"2024-05-15T14:49:04.637621+0000","last_clean":"2024-05-15T14:49:04.637621+0000","last_became_active":"2024-05-15T14:28:02.891380+0000","last_became_peered":"2024-05-15T14:28:02.891380+0000","last_unstale":"2024-05-15T14:49:04.637621+0000","last_undegraded":"2024-05-15T14:49:04.637621+0000","last_fullsized":"2024-05-15T14:49:04.637621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'19","last_scrub_stamp":"2024-05-15T14:49:04.637527+0000","last_deep_scrub":"39'19","last_deep_scrub_stamp":"2024-05-15T14:49:04.637527+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.637527+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:27.567433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":35,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.375203+0000","last_change":"2024-05-15T14:31:16.594082+0000","last_active":"2024-05-15T14:49:03.375203+0000","last_peered":"2024-05-15T14:49:03.375203+0000","last_clean":"2024-05-15T14:49:03.375203+0000","last_became_active":"2024-05-15T14:31:16.593811+0000","last_became_peered":"2024-05-15T14:31:16.593811+0000","last_unstale":"2024-05-15T14:49:03.375203+0000","last_undegraded":"2024-05-15T14:49:03.375203+0000","last_fullsized":"2024-05-15T14:49:03.375203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"39'18","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.480417+0000","last_change":"2024-05-15T14:49:19.480444+0000","last_active":"2024-05-15T14:49:19.480417+0000","last_peered":"2024-05-15T14:49:19.480417+0000","last_clean":"2024-05-15T14:49:19.480417+0000","last_became_active":"2024-05-15T14:28:37.942459+0000","last_became_peered":"2024-05-15T14:28:37.942459+0000","last_unstale":"2024-05-15T14:49:19.480417+0000","last_undegraded":"2024-05-15T14:49:19.480417+0000","last_fullsized":"2024-05-15T14:49:19.480417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:19.480325+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:19.480325+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.480325+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:55:42.780117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"39'10","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.604755+0000","last_change":"2024-05-15T14:49:31.604755+0000","last_active":"2024-05-15T14:49:31.604755+0000","last_peered":"2024-05-15T14:49:31.604755+0000","last_clean":"2024-05-15T14:49:31.604755+0000","last_became_active":"2024-05-15T14:27:50.854248+0000","last_became_peered":"2024-05-15T14:27:50.854248+0000","last_unstale":"2024-05-15T14:49:31.604755+0000","last_undegraded":"2024-05-15T14:49:31.604755+0000","last_fullsized":"2024-05-15T14:49:31.604755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:31.604587+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:31.604587+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.604587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:37:28.855030+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":50,"num_write_kb":8823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.070481+0000","last_change":"2024-05-15T14:49:18.070481+0000","last_active":"2024-05-15T14:49:18.070481+0000","last_peered":"2024-05-15T14:49:18.070481+0000","last_clean":"2024-05-15T14:49:18.070481+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:49:18.070481+0000","last_undegraded":"2024-05-15T14:49:18.070481+0000","last_fullsized":"2024-05-15T14:49:18.070481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:18.070336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:18.070336+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.070336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:11.212528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'2","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.264379+0000","last_change":"2024-05-15T14:49:16.264411+0000","last_active":"2024-05-15T14:49:16.264379+0000","last_peered":"2024-05-15T14:49:16.264379+0000","last_clean":"2024-05-15T14:49:16.264379+0000","last_became_active":"2024-05-15T14:27:56.875993+0000","last_became_peered":"2024-05-15T14:27:56.875993+0000","last_unstale":"2024-05-15T14:49:16.264379+0000","last_undegraded":"2024-05-15T14:49:16.264379+0000","last_fullsized":"2024-05-15T14:49:16.264379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:16.264296+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:16.264296+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.264296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:36.509821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"39'231","reported_seq":398,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.406389+0000","last_change":"2024-05-15T14:49:04.406424+0000","last_active":"2024-05-15T14:49:04.406389+0000","last_peered":"2024-05-15T14:49:04.406389+0000","last_clean":"2024-05-15T14:49:04.406389+0000","last_became_active":"2024-05-15T14:27:58.885090+0000","last_became_peered":"2024-05-15T14:27:58.885090+0000","last_unstale":"2024-05-15T14:49:04.406389+0000","last_undegraded":"2024-05-15T14:49:04.406389+0000","last_fullsized":"2024-05-15T14:49:04.406389+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'231","last_scrub_stamp":"2024-05-15T14:49:04.406300+0000","last_deep_scrub":"39'231","last_deep_scrub_stamp":"2024-05-15T14:49:04.406300+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.406300+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:24.352331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"39'927","reported_seq":1454,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.655551+0000","last_change":"2024-05-15T14:49:05.655578+0000","last_active":"2024-05-15T14:49:05.655551+0000","last_peered":"2024-05-15T14:49:05.655551+0000","last_clean":"2024-05-15T14:49:05.655551+0000","last_became_active":"2024-05-15T14:28:00.884286+0000","last_became_peered":"2024-05-15T14:28:00.884286+0000","last_unstale":"2024-05-15T14:49:05.655551+0000","last_undegraded":"2024-05-15T14:49:05.655551+0000","last_fullsized":"2024-05-15T14:49:05.655551+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:05.655463+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:05.655463+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.655463+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:39.495556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"39'25","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.065980+0000","last_change":"2024-05-15T14:49:05.066012+0000","last_active":"2024-05-15T14:49:05.065980+0000","last_peered":"2024-05-15T14:49:05.065980+0000","last_clean":"2024-05-15T14:49:05.065980+0000","last_became_active":"2024-05-15T14:28:02.891822+0000","last_became_peered":"2024-05-15T14:28:02.891822+0000","last_unstale":"2024-05-15T14:49:05.065980+0000","last_undegraded":"2024-05-15T14:49:05.065980+0000","last_fullsized":"2024-05-15T14:49:05.065980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:05.065867+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:05.065867+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.065867+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:26.544217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.509853+0000","last_change":"2024-05-15T14:31:16.596256+0000","last_active":"2024-05-15T14:49:01.509853+0000","last_peered":"2024-05-15T14:49:01.509853+0000","last_clean":"2024-05-15T14:49:01.509853+0000","last_became_active":"2024-05-15T14:31:16.595913+0000","last_became_peered":"2024-05-15T14:31:16.595913+0000","last_unstale":"2024-05-15T14:49:01.509853+0000","last_undegraded":"2024-05-15T14:49:01.509853+0000","last_fullsized":"2024-05-15T14:49:01.509853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"39'16","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.233902+0000","last_change":"2024-05-15T14:49:21.233931+0000","last_active":"2024-05-15T14:49:21.233902+0000","last_peered":"2024-05-15T14:49:21.233902+0000","last_clean":"2024-05-15T14:49:21.233902+0000","last_became_active":"2024-05-15T14:27:52.848087+0000","last_became_peered":"2024-05-15T14:27:52.848087+0000","last_unstale":"2024-05-15T14:49:21.233902+0000","last_undegraded":"2024-05-15T14:49:21.233902+0000","last_fullsized":"2024-05-15T14:49:21.233902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:21.233814+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:21.233814+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.233814+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:29.301182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.296444+0000","last_change":"2024-05-15T14:49:34.296502+0000","last_active":"2024-05-15T14:49:34.296444+0000","last_peered":"2024-05-15T14:49:34.296444+0000","last_clean":"2024-05-15T14:49:34.296444+0000","last_became_active":"2024-05-15T14:27:50.840365+0000","last_became_peered":"2024-05-15T14:27:50.840365+0000","last_unstale":"2024-05-15T14:49:34.296444+0000","last_undegraded":"2024-05-15T14:49:34.296444+0000","last_fullsized":"2024-05-15T14:49:34.296444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:34.296338+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:34.296338+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.296338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:11:24.652627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.107230+0000","last_change":"2024-05-15T14:49:13.107230+0000","last_active":"2024-05-15T14:49:13.107230+0000","last_peered":"2024-05-15T14:49:13.107230+0000","last_clean":"2024-05-15T14:49:13.107230+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:49:13.107230+0000","last_undegraded":"2024-05-15T14:49:13.107230+0000","last_fullsized":"2024-05-15T14:49:13.107230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:13.107116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:13.107116+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.107116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:12:26.464097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"39'13","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.677394+0000","last_change":"2024-05-15T14:49:26.677454+0000","last_active":"2024-05-15T14:49:26.677394+0000","last_peered":"2024-05-15T14:49:26.677394+0000","last_clean":"2024-05-15T14:49:26.677394+0000","last_became_active":"2024-05-15T14:27:56.875166+0000","last_became_peered":"2024-05-15T14:27:56.875166+0000","last_unstale":"2024-05-15T14:49:26.677394+0000","last_undegraded":"2024-05-15T14:49:26.677394+0000","last_fullsized":"2024-05-15T14:49:26.677394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'13","last_scrub_stamp":"2024-05-15T14:49:26.677273+0000","last_deep_scrub":"39'13","last_deep_scrub_stamp":"2024-05-15T14:49:26.677273+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.677273+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:10:53.095293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'555","reported_seq":988,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.631535+0000","last_change":"2024-05-15T14:49:24.631581+0000","last_active":"2024-05-15T14:49:24.631535+0000","last_peered":"2024-05-15T14:49:24.631535+0000","last_clean":"2024-05-15T14:49:24.631535+0000","last_became_active":"2024-05-15T14:27:58.881529+0000","last_became_peered":"2024-05-15T14:27:58.881529+0000","last_unstale":"2024-05-15T14:49:24.631535+0000","last_undegraded":"2024-05-15T14:49:24.631535+0000","last_fullsized":"2024-05-15T14:49:24.631535+0000","mapping_epoch":26,"log_start":"39'500","ondisk_log_start":"39'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'555","last_scrub_stamp":"2024-05-15T14:49:24.631445+0000","last_deep_scrub":"39'555","last_deep_scrub_stamp":"2024-05-15T14:49:24.631445+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.631445+0000","objects_scrubbed":10,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:03.208301+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":967,"num_read_kb":997,"num_write":702,"num_write_kb":2669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1242,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.611305+0000","last_change":"2024-05-15T14:49:03.611323+0000","last_active":"2024-05-15T14:49:03.611305+0000","last_peered":"2024-05-15T14:49:03.611305+0000","last_clean":"2024-05-15T14:49:03.611305+0000","last_became_active":"2024-05-15T14:28:00.890685+0000","last_became_peered":"2024-05-15T14:28:00.890685+0000","last_unstale":"2024-05-15T14:49:03.611305+0000","last_undegraded":"2024-05-15T14:49:03.611305+0000","last_fullsized":"2024-05-15T14:49:03.611305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:03.611229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:03.611229+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.611229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:17.594221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"39'29","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.911194+0000","last_change":"2024-05-15T14:49:07.911254+0000","last_active":"2024-05-15T14:49:07.911194+0000","last_peered":"2024-05-15T14:49:07.911194+0000","last_clean":"2024-05-15T14:49:07.911194+0000","last_became_active":"2024-05-15T14:28:02.893174+0000","last_became_peered":"2024-05-15T14:28:02.893174+0000","last_unstale":"2024-05-15T14:49:07.911194+0000","last_undegraded":"2024-05-15T14:49:07.911194+0000","last_fullsized":"2024-05-15T14:49:07.911194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'29","last_scrub_stamp":"2024-05-15T14:49:07.911100+0000","last_deep_scrub":"39'29","last_deep_scrub_stamp":"2024-05-15T14:49:07.911100+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.911100+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:49.443849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:00.116294+0000","last_change":"2024-05-15T14:31:16.593175+0000","last_active":"2024-05-15T14:49:00.116294+0000","last_peered":"2024-05-15T14:49:00.116294+0000","last_clean":"2024-05-15T14:49:00.116294+0000","last_became_active":"2024-05-15T14:31:16.592898+0000","last_became_peered":"2024-05-15T14:31:16.592898+0000","last_unstale":"2024-05-15T14:49:00.116294+0000","last_undegraded":"2024-05-15T14:49:00.116294+0000","last_fullsized":"2024-05-15T14:49:00.116294+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'27","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.138164+0000","last_change":"2024-05-15T14:49:09.138193+0000","last_active":"2024-05-15T14:49:09.138164+0000","last_peered":"2024-05-15T14:49:09.138164+0000","last_clean":"2024-05-15T14:49:09.138164+0000","last_became_active":"2024-05-15T14:28:02.892547+0000","last_became_peered":"2024-05-15T14:28:02.892547+0000","last_unstale":"2024-05-15T14:49:09.138164+0000","last_undegraded":"2024-05-15T14:49:09.138164+0000","last_fullsized":"2024-05-15T14:49:09.138164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'27","last_scrub_stamp":"2024-05-15T14:49:09.138074+0000","last_deep_scrub":"39'27","last_deep_scrub_stamp":"2024-05-15T14:49:09.138074+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.138074+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:32.875517+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":37,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"39'44","reported_seq":138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.351111+0000","last_change":"2024-05-15T14:49:28.351135+0000","last_active":"2024-05-15T14:49:28.351111+0000","last_peered":"2024-05-15T14:49:28.351111+0000","last_clean":"2024-05-15T14:49:28.351111+0000","last_became_active":"2024-05-15T14:27:52.842733+0000","last_became_peered":"2024-05-15T14:27:52.842733+0000","last_unstale":"2024-05-15T14:49:28.351111+0000","last_undegraded":"2024-05-15T14:49:28.351111+0000","last_fullsized":"2024-05-15T14:49:28.351111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'44","last_scrub_stamp":"2024-05-15T14:49:28.351022+0000","last_deep_scrub":"39'44","last_deep_scrub_stamp":"2024-05-15T14:49:28.351022+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.351022+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:04:01.452536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":143,"num_write":62,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"39'22","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.383276+0000","last_change":"2024-05-15T14:49:17.383276+0000","last_active":"2024-05-15T14:49:17.383276+0000","last_peered":"2024-05-15T14:49:17.383276+0000","last_clean":"2024-05-15T14:49:17.383276+0000","last_became_active":"2024-05-15T14:28:37.940961+0000","last_became_peered":"2024-05-15T14:28:37.940961+0000","last_unstale":"2024-05-15T14:49:17.383276+0000","last_undegraded":"2024-05-15T14:49:17.383276+0000","last_fullsized":"2024-05-15T14:49:17.383276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:17.383122+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:17.383122+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.383122+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:45:50.056980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":33493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"39'3","reported_seq":1018,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.065682+0000","last_change":"2024-05-15T14:49:03.065708+0000","last_active":"2024-05-15T14:49:03.065682+0000","last_peered":"2024-05-15T14:49:03.065682+0000","last_clean":"2024-05-15T14:49:03.065682+0000","last_became_active":"2024-05-15T14:27:56.879047+0000","last_became_peered":"2024-05-15T14:27:56.879047+0000","last_unstale":"2024-05-15T14:49:03.065682+0000","last_undegraded":"2024-05-15T14:49:03.065682+0000","last_fullsized":"2024-05-15T14:49:03.065682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-05-15T14:49:03.065616+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-05-15T14:49:03.065616+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.065616+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:21:36.534785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":959,"num_read_kb":959,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"39'708","reported_seq":1172,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.657931+0000","last_change":"2024-05-15T14:49:14.657970+0000","last_active":"2024-05-15T14:49:14.657931+0000","last_peered":"2024-05-15T14:49:14.657931+0000","last_clean":"2024-05-15T14:49:14.657931+0000","last_became_active":"2024-05-15T14:27:58.881703+0000","last_became_peered":"2024-05-15T14:27:58.881703+0000","last_unstale":"2024-05-15T14:49:14.657931+0000","last_undegraded":"2024-05-15T14:49:14.657931+0000","last_fullsized":"2024-05-15T14:49:14.657931+0000","mapping_epoch":26,"log_start":"39'600","ondisk_log_start":"39'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'708","last_scrub_stamp":"2024-05-15T14:49:14.657842+0000","last_deep_scrub":"39'708","last_deep_scrub_stamp":"2024-05-15T14:49:14.657842+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.657842+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:54:11.139225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1572,"num_read_kb":3606,"num_write":909,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.681406+0000","last_change":"2024-05-15T14:49:09.681429+0000","last_active":"2024-05-15T14:49:09.681406+0000","last_peered":"2024-05-15T14:49:09.681406+0000","last_clean":"2024-05-15T14:49:09.681406+0000","last_became_active":"2024-05-15T14:28:00.883811+0000","last_became_peered":"2024-05-15T14:28:00.883811+0000","last_unstale":"2024-05-15T14:49:09.681406+0000","last_undegraded":"2024-05-15T14:49:09.681406+0000","last_fullsized":"2024-05-15T14:49:09.681406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:09.681307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:09.681307+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.681307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:28:55.391390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.794785+0000","last_change":"2024-05-15T14:49:29.794813+0000","last_active":"2024-05-15T14:49:29.794785+0000","last_peered":"2024-05-15T14:49:29.794785+0000","last_clean":"2024-05-15T14:49:29.794785+0000","last_became_active":"2024-05-15T14:31:16.592053+0000","last_became_peered":"2024-05-15T14:31:16.592053+0000","last_unstale":"2024-05-15T14:49:29.794785+0000","last_undegraded":"2024-05-15T14:49:29.794785+0000","last_fullsized":"2024-05-15T14:49:29.794785+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:29.794676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:29.794676+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.794676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:06.215062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"39'30","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.665387+0000","last_change":"2024-05-15T14:49:08.665420+0000","last_active":"2024-05-15T14:49:08.665387+0000","last_peered":"2024-05-15T14:49:08.665387+0000","last_clean":"2024-05-15T14:49:08.665387+0000","last_became_active":"2024-05-15T14:28:02.894053+0000","last_became_peered":"2024-05-15T14:28:02.894053+0000","last_unstale":"2024-05-15T14:49:08.665387+0000","last_undegraded":"2024-05-15T14:49:08.665387+0000","last_fullsized":"2024-05-15T14:49:08.665387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2024-05-15T14:49:08.665299+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2024-05-15T14:49:08.665299+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.665299+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:32.897052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"39'12","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.079792+0000","last_change":"2024-05-15T14:49:09.079860+0000","last_active":"2024-05-15T14:49:09.079792+0000","last_peered":"2024-05-15T14:49:09.079792+0000","last_clean":"2024-05-15T14:49:09.079792+0000","last_became_active":"2024-05-15T14:27:52.849013+0000","last_became_peered":"2024-05-15T14:27:52.849013+0000","last_unstale":"2024-05-15T14:49:09.079792+0000","last_undegraded":"2024-05-15T14:49:09.079792+0000","last_fullsized":"2024-05-15T14:49:09.079792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:09.079673+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:09.079673+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.079673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:39.344389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"39'12","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.777868+0000","last_change":"2024-05-15T14:49:17.777868+0000","last_active":"2024-05-15T14:49:17.777868+0000","last_peered":"2024-05-15T14:49:17.777868+0000","last_clean":"2024-05-15T14:49:17.777868+0000","last_became_active":"2024-05-15T14:27:50.852755+0000","last_became_peered":"2024-05-15T14:27:50.852755+0000","last_unstale":"2024-05-15T14:49:17.777868+0000","last_undegraded":"2024-05-15T14:49:17.777868+0000","last_fullsized":"2024-05-15T14:49:17.777868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:17.777742+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:17.777742+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.777742+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:38.023267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.560193+0000","last_change":"2024-05-15T14:49:32.560261+0000","last_active":"2024-05-15T14:49:32.560193+0000","last_peered":"2024-05-15T14:49:32.560193+0000","last_clean":"2024-05-15T14:49:32.560193+0000","last_became_active":"2024-05-15T14:27:56.883312+0000","last_became_peered":"2024-05-15T14:27:56.883312+0000","last_unstale":"2024-05-15T14:49:32.560193+0000","last_undegraded":"2024-05-15T14:49:32.560193+0000","last_fullsized":"2024-05-15T14:49:32.560193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:32.560084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:32.560084+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.560084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:24:37.933782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'161","reported_seq":222595,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.128051+0000","last_change":"2024-05-15T14:49:12.128133+0000","last_active":"2024-05-15T14:49:12.128051+0000","last_peered":"2024-05-15T14:49:12.128051+0000","last_clean":"2024-05-15T14:49:12.128051+0000","last_became_active":"2024-05-15T14:27:58.884647+0000","last_became_peered":"2024-05-15T14:27:58.884647+0000","last_unstale":"2024-05-15T14:49:12.128051+0000","last_undegraded":"2024-05-15T14:49:12.128051+0000","last_fullsized":"2024-05-15T14:49:12.128051+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'161","last_scrub_stamp":"2024-05-15T14:49:12.127934+0000","last_deep_scrub":"39'161","last_deep_scrub_stamp":"2024-05-15T14:49:12.127934+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.127934+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:26.110927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555956,"num_read_kb":2334405,"num_write":176,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1536,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.933696+0000","last_change":"2024-05-15T14:49:05.933725+0000","last_active":"2024-05-15T14:49:05.933696+0000","last_peered":"2024-05-15T14:49:05.933696+0000","last_clean":"2024-05-15T14:49:05.933696+0000","last_became_active":"2024-05-15T14:28:00.888834+0000","last_became_peered":"2024-05-15T14:28:00.888834+0000","last_unstale":"2024-05-15T14:49:05.933696+0000","last_undegraded":"2024-05-15T14:49:05.933696+0000","last_fullsized":"2024-05-15T14:49:05.933696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:05.933598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:05.933598+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.933598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:25.879629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438355+0000","last_change":"2024-05-15T14:31:16.594403+0000","last_active":"2024-05-15T14:48:47.438355+0000","last_peered":"2024-05-15T14:48:47.438355+0000","last_clean":"2024-05-15T14:48:47.438355+0000","last_became_active":"2024-05-15T14:31:16.594114+0000","last_became_peered":"2024-05-15T14:31:16.594114+0000","last_unstale":"2024-05-15T14:48:47.438355+0000","last_undegraded":"2024-05-15T14:48:47.438355+0000","last_fullsized":"2024-05-15T14:48:47.438355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"39'28","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.039996+0000","last_change":"2024-05-15T14:49:01.040056+0000","last_active":"2024-05-15T14:49:01.039996+0000","last_peered":"2024-05-15T14:49:01.039996+0000","last_clean":"2024-05-15T14:49:01.039996+0000","last_became_active":"2024-05-15T14:28:02.890071+0000","last_became_peered":"2024-05-15T14:28:02.890071+0000","last_unstale":"2024-05-15T14:49:01.039996+0000","last_undegraded":"2024-05-15T14:49:01.039996+0000","last_fullsized":"2024-05-15T14:49:01.039996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'28","last_scrub_stamp":"2024-05-15T14:49:01.039894+0000","last_deep_scrub":"39'28","last_deep_scrub_stamp":"2024-05-15T14:49:01.039894+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.039894+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:14:43.778244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":114,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'10","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.642434+0000","last_change":"2024-05-15T14:49:27.642458+0000","last_active":"2024-05-15T14:49:27.642434+0000","last_peered":"2024-05-15T14:49:27.642434+0000","last_clean":"2024-05-15T14:49:27.642434+0000","last_became_active":"2024-05-15T14:27:52.851940+0000","last_became_peered":"2024-05-15T14:27:52.851940+0000","last_unstale":"2024-05-15T14:49:27.642434+0000","last_undegraded":"2024-05-15T14:49:27.642434+0000","last_fullsized":"2024-05-15T14:49:27.642434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-05-15T14:49:27.642334+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-05-15T14:49:27.642334+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.642334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:02:16.298347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"39'4","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.000032+0000","last_change":"2024-05-15T14:49:36.000032+0000","last_active":"2024-05-15T14:49:36.000032+0000","last_peered":"2024-05-15T14:49:36.000032+0000","last_clean":"2024-05-15T14:49:36.000032+0000","last_became_active":"2024-05-15T14:27:50.846362+0000","last_became_peered":"2024-05-15T14:27:50.846362+0000","last_unstale":"2024-05-15T14:49:36.000032+0000","last_undegraded":"2024-05-15T14:49:36.000032+0000","last_fullsized":"2024-05-15T14:49:36.000032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:35.999912+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:35.999912+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.999912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:52:36.947140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"39'12","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.777551+0000","last_change":"2024-05-15T14:49:18.777587+0000","last_active":"2024-05-15T14:49:18.777551+0000","last_peered":"2024-05-15T14:49:18.777551+0000","last_clean":"2024-05-15T14:49:18.777551+0000","last_became_active":"2024-05-15T14:27:56.877413+0000","last_became_peered":"2024-05-15T14:27:56.877413+0000","last_unstale":"2024-05-15T14:49:18.777551+0000","last_undegraded":"2024-05-15T14:49:18.777551+0000","last_fullsized":"2024-05-15T14:49:18.777551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:18.777443+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:18.777443+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.777443+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:34:58.968978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"39'253","reported_seq":481,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.642376+0000","last_change":"2024-05-15T14:49:15.642416+0000","last_active":"2024-05-15T14:49:15.642376+0000","last_peered":"2024-05-15T14:49:15.642376+0000","last_clean":"2024-05-15T14:49:15.642376+0000","last_became_active":"2024-05-15T14:27:58.881581+0000","last_became_peered":"2024-05-15T14:27:58.881581+0000","last_unstale":"2024-05-15T14:49:15.642376+0000","last_undegraded":"2024-05-15T14:49:15.642376+0000","last_fullsized":"2024-05-15T14:49:15.642376+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'253","last_scrub_stamp":"2024-05-15T14:49:15.642282+0000","last_deep_scrub":"39'253","last_deep_scrub_stamp":"2024-05-15T14:49:15.642282+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.642282+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:15.646174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":391,"num_write":224,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.139014+0000","last_change":"2024-05-15T14:49:22.139037+0000","last_active":"2024-05-15T14:49:22.139014+0000","last_peered":"2024-05-15T14:49:22.139014+0000","last_clean":"2024-05-15T14:49:22.139014+0000","last_became_active":"2024-05-15T14:28:00.887738+0000","last_became_peered":"2024-05-15T14:28:00.887738+0000","last_unstale":"2024-05-15T14:49:22.139014+0000","last_undegraded":"2024-05-15T14:49:22.139014+0000","last_fullsized":"2024-05-15T14:49:22.139014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.138922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.138922+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.138922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:46.513303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:47.438376+0000","last_change":"2024-05-15T14:31:16.591389+0000","last_active":"2024-05-15T14:48:47.438376+0000","last_peered":"2024-05-15T14:48:47.438376+0000","last_clean":"2024-05-15T14:48:47.438376+0000","last_became_active":"2024-05-15T14:31:16.590502+0000","last_became_peered":"2024-05-15T14:31:16.590502+0000","last_unstale":"2024-05-15T14:48:47.438376+0000","last_undegraded":"2024-05-15T14:48:47.438376+0000","last_fullsized":"2024-05-15T14:48:47.438376+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'26","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.018451+0000","last_change":"2024-05-15T14:49:12.018496+0000","last_active":"2024-05-15T14:49:12.018451+0000","last_peered":"2024-05-15T14:49:12.018451+0000","last_clean":"2024-05-15T14:49:12.018451+0000","last_became_active":"2024-05-15T14:28:02.894280+0000","last_became_peered":"2024-05-15T14:28:02.894280+0000","last_unstale":"2024-05-15T14:49:12.018451+0000","last_undegraded":"2024-05-15T14:49:12.018451+0000","last_fullsized":"2024-05-15T14:49:12.018451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:12.018320+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:12.018320+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.018320+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:32.578339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"39'66","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.686963+0000","last_change":"2024-05-15T14:49:22.686990+0000","last_active":"2024-05-15T14:49:22.686963+0000","last_peered":"2024-05-15T14:49:22.686963+0000","last_clean":"2024-05-15T14:49:22.686963+0000","last_became_active":"2024-05-15T14:27:52.862259+0000","last_became_peered":"2024-05-15T14:27:52.862259+0000","last_unstale":"2024-05-15T14:49:22.686963+0000","last_undegraded":"2024-05-15T14:49:22.686963+0000","last_fullsized":"2024-05-15T14:49:22.686963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'66","last_scrub_stamp":"2024-05-15T14:49:22.686866+0000","last_deep_scrub":"39'66","last_deep_scrub_stamp":"2024-05-15T14:49:22.686866+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.686866+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:37:07.060211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":205,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"39'8","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:35.306500+0000","last_change":"2024-05-15T14:49:35.306500+0000","last_active":"2024-05-15T14:49:35.306500+0000","last_peered":"2024-05-15T14:49:35.306500+0000","last_clean":"2024-05-15T14:49:35.306500+0000","last_became_active":"2024-05-15T14:27:50.843223+0000","last_became_peered":"2024-05-15T14:27:50.843223+0000","last_unstale":"2024-05-15T14:49:35.306500+0000","last_undegraded":"2024-05-15T14:49:35.306500+0000","last_fullsized":"2024-05-15T14:49:35.306500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:35.306360+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:35.306360+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.306360+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:11:01.724379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"39'10","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.155423+0000","last_change":"2024-05-15T14:49:03.155458+0000","last_active":"2024-05-15T14:49:03.155423+0000","last_peered":"2024-05-15T14:49:03.155423+0000","last_clean":"2024-05-15T14:49:03.155423+0000","last_became_active":"2024-05-15T14:27:56.879589+0000","last_became_peered":"2024-05-15T14:27:56.879589+0000","last_unstale":"2024-05-15T14:49:03.155423+0000","last_undegraded":"2024-05-15T14:49:03.155423+0000","last_fullsized":"2024-05-15T14:49:03.155423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:03.155336+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:03.155336+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.155336+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:22:33.777606+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"39'205","reported_seq":411,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.563563+0000","last_change":"2024-05-15T14:49:26.563595+0000","last_active":"2024-05-15T14:49:26.563563+0000","last_peered":"2024-05-15T14:49:26.563563+0000","last_clean":"2024-05-15T14:49:26.563563+0000","last_became_active":"2024-05-15T14:27:58.884831+0000","last_became_peered":"2024-05-15T14:27:58.884831+0000","last_unstale":"2024-05-15T14:49:26.563563+0000","last_undegraded":"2024-05-15T14:49:26.563563+0000","last_fullsized":"2024-05-15T14:49:26.563563+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'205","last_scrub_stamp":"2024-05-15T14:49:26.563476+0000","last_deep_scrub":"39'205","last_deep_scrub_stamp":"2024-05-15T14:49:26.563476+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.563476+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:09.388395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":326,"num_write":178,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.071622+0000","last_change":"2024-05-15T14:49:04.071645+0000","last_active":"2024-05-15T14:49:04.071622+0000","last_peered":"2024-05-15T14:49:04.071622+0000","last_clean":"2024-05-15T14:49:04.071622+0000","last_became_active":"2024-05-15T14:28:00.887513+0000","last_became_peered":"2024-05-15T14:28:00.887513+0000","last_unstale":"2024-05-15T14:49:04.071622+0000","last_undegraded":"2024-05-15T14:49:04.071622+0000","last_fullsized":"2024-05-15T14:49:04.071622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.071548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.071548+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.071548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:45.604297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:47:37.424000+0000","last_change":"2024-05-15T14:31:16.594526+0000","last_active":"2024-05-15T14:47:37.424000+0000","last_peered":"2024-05-15T14:47:37.424000+0000","last_clean":"2024-05-15T14:47:37.424000+0000","last_became_active":"2024-05-15T14:31:16.594193+0000","last_became_peered":"2024-05-15T14:31:16.594193+0000","last_unstale":"2024-05-15T14:47:37.424000+0000","last_undegraded":"2024-05-15T14:47:37.424000+0000","last_fullsized":"2024-05-15T14:47:37.424000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"39'20","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.064388+0000","last_change":"2024-05-15T14:49:08.064433+0000","last_active":"2024-05-15T14:49:08.064388+0000","last_peered":"2024-05-15T14:49:08.064388+0000","last_clean":"2024-05-15T14:49:08.064388+0000","last_became_active":"2024-05-15T14:27:52.847609+0000","last_became_peered":"2024-05-15T14:27:52.847609+0000","last_unstale":"2024-05-15T14:49:08.064388+0000","last_undegraded":"2024-05-15T14:49:08.064388+0000","last_fullsized":"2024-05-15T14:49:08.064388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:08.064289+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:08.064289+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.064289+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:12:50.814001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":78,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"39'12","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.523168+0000","last_change":"2024-05-15T14:49:33.523168+0000","last_active":"2024-05-15T14:49:33.523168+0000","last_peered":"2024-05-15T14:49:33.523168+0000","last_clean":"2024-05-15T14:49:33.523168+0000","last_became_active":"2024-05-15T14:27:50.850524+0000","last_became_peered":"2024-05-15T14:27:50.850524+0000","last_unstale":"2024-05-15T14:49:33.523168+0000","last_undegraded":"2024-05-15T14:49:33.523168+0000","last_fullsized":"2024-05-15T14:49:33.523168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:33.523047+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:33.523047+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.523047+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:24.290735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":18802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"39'13","reported_seq":161,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.291424+0000","last_change":"2024-05-15T14:49:25.291460+0000","last_active":"2024-05-15T14:49:25.291424+0000","last_peered":"2024-05-15T14:49:25.291424+0000","last_clean":"2024-05-15T14:49:25.291424+0000","last_became_active":"2024-05-15T14:27:56.881789+0000","last_became_peered":"2024-05-15T14:27:56.881789+0000","last_unstale":"2024-05-15T14:49:25.291424+0000","last_undegraded":"2024-05-15T14:49:25.291424+0000","last_fullsized":"2024-05-15T14:49:25.291424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'13","last_scrub_stamp":"2024-05-15T14:49:25.291330+0000","last_deep_scrub":"39'13","last_deep_scrub_stamp":"2024-05-15T14:49:25.291330+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.291330+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:27:19.346883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":182,"num_write":22,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"39'280","reported_seq":577,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.045043+0000","last_change":"2024-05-15T14:49:12.045140+0000","last_active":"2024-05-15T14:49:12.045043+0000","last_peered":"2024-05-15T14:49:12.045043+0000","last_clean":"2024-05-15T14:49:12.045043+0000","last_became_active":"2024-05-15T14:27:58.887134+0000","last_became_peered":"2024-05-15T14:27:58.887134+0000","last_unstale":"2024-05-15T14:49:12.045043+0000","last_undegraded":"2024-05-15T14:49:12.045043+0000","last_fullsized":"2024-05-15T14:49:12.045043+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'280","last_scrub_stamp":"2024-05-15T14:49:12.044936+0000","last_deep_scrub":"39'280","last_deep_scrub_stamp":"2024-05-15T14:49:12.044936+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.044936+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:41.078456+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":462,"num_write":228,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.950191+0000","last_change":"2024-05-15T14:49:08.950216+0000","last_active":"2024-05-15T14:49:08.950191+0000","last_peered":"2024-05-15T14:49:08.950191+0000","last_clean":"2024-05-15T14:49:08.950191+0000","last_became_active":"2024-05-15T14:28:00.885174+0000","last_became_peered":"2024-05-15T14:28:00.885174+0000","last_unstale":"2024-05-15T14:49:08.950191+0000","last_undegraded":"2024-05-15T14:49:08.950191+0000","last_fullsized":"2024-05-15T14:49:08.950191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:08.950089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:08.950089+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.950089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:33.324469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"39'31","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.650844+0000","last_change":"2024-05-15T14:49:16.650875+0000","last_active":"2024-05-15T14:49:16.650844+0000","last_peered":"2024-05-15T14:49:16.650844+0000","last_clean":"2024-05-15T14:49:16.650844+0000","last_became_active":"2024-05-15T14:28:02.894515+0000","last_became_peered":"2024-05-15T14:28:02.894515+0000","last_unstale":"2024-05-15T14:49:16.650844+0000","last_undegraded":"2024-05-15T14:49:16.650844+0000","last_fullsized":"2024-05-15T14:49:16.650844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:16.650739+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:16.650739+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.650739+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:27:10.706293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.555585+0000","last_change":"2024-05-15T14:49:38.555640+0000","last_active":"2024-05-15T14:49:38.555585+0000","last_peered":"2024-05-15T14:49:38.555585+0000","last_clean":"2024-05-15T14:49:38.555585+0000","last_became_active":"2024-05-15T14:31:16.589442+0000","last_became_peered":"2024-05-15T14:31:16.589442+0000","last_unstale":"2024-05-15T14:49:38.555585+0000","last_undegraded":"2024-05-15T14:49:38.555585+0000","last_fullsized":"2024-05-15T14:49:38.555585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:38.555483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:38.555483+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.555483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:52:39.502711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"39'56","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.280889+0000","last_change":"2024-05-15T14:49:26.280917+0000","last_active":"2024-05-15T14:49:26.280889+0000","last_peered":"2024-05-15T14:49:26.280889+0000","last_clean":"2024-05-15T14:49:26.280889+0000","last_became_active":"2024-05-15T14:27:52.845557+0000","last_became_peered":"2024-05-15T14:27:52.845557+0000","last_unstale":"2024-05-15T14:49:26.280889+0000","last_undegraded":"2024-05-15T14:49:26.280889+0000","last_fullsized":"2024-05-15T14:49:26.280889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'56","last_scrub_stamp":"2024-05-15T14:49:26.280780+0000","last_deep_scrub":"39'56","last_deep_scrub_stamp":"2024-05-15T14:49:26.280780+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.280780+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:28.590318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":171,"num_write":80,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"39'10","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.899755+0000","last_change":"2024-05-15T14:49:24.899755+0000","last_active":"2024-05-15T14:49:24.899755+0000","last_peered":"2024-05-15T14:49:24.899755+0000","last_clean":"2024-05-15T14:49:24.899755+0000","last_became_active":"2024-05-15T14:27:50.850175+0000","last_became_peered":"2024-05-15T14:27:50.850175+0000","last_unstale":"2024-05-15T14:49:24.899755+0000","last_undegraded":"2024-05-15T14:49:24.899755+0000","last_fullsized":"2024-05-15T14:49:24.899755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:24.899631+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:24.899631+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.899631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:58.739724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.146706+0000","last_change":"2024-05-15T14:49:04.146740+0000","last_active":"2024-05-15T14:49:04.146706+0000","last_peered":"2024-05-15T14:49:04.146706+0000","last_clean":"2024-05-15T14:49:04.146706+0000","last_became_active":"2024-05-15T14:27:56.879634+0000","last_became_peered":"2024-05-15T14:27:56.879634+0000","last_unstale":"2024-05-15T14:49:04.146706+0000","last_undegraded":"2024-05-15T14:49:04.146706+0000","last_fullsized":"2024-05-15T14:49:04.146706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.146612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.146612+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.146612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:07.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"39'510","reported_seq":1267,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.911817+0000","last_change":"2024-05-15T14:49:11.911862+0000","last_active":"2024-05-15T14:49:11.911817+0000","last_peered":"2024-05-15T14:49:11.911817+0000","last_clean":"2024-05-15T14:49:11.911817+0000","last_became_active":"2024-05-15T14:27:58.887144+0000","last_became_peered":"2024-05-15T14:27:58.887144+0000","last_unstale":"2024-05-15T14:49:11.911817+0000","last_undegraded":"2024-05-15T14:49:11.911817+0000","last_fullsized":"2024-05-15T14:49:11.911817+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'510","last_scrub_stamp":"2024-05-15T14:49:11.911710+0000","last_deep_scrub":"39'510","last_deep_scrub_stamp":"2024-05-15T14:49:11.911710+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.911710+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:26:29.857106+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1003,"num_read_kb":910,"num_write":675,"num_write_kb":1754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.013369+0000","last_change":"2024-05-15T14:49:16.013393+0000","last_active":"2024-05-15T14:49:16.013369+0000","last_peered":"2024-05-15T14:49:16.013369+0000","last_clean":"2024-05-15T14:49:16.013369+0000","last_became_active":"2024-05-15T14:28:00.891343+0000","last_became_peered":"2024-05-15T14:28:00.891343+0000","last_unstale":"2024-05-15T14:49:16.013369+0000","last_undegraded":"2024-05-15T14:49:16.013369+0000","last_fullsized":"2024-05-15T14:49:16.013369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:16.013268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:16.013268+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.013268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:40.387649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"39'31","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.109805+0000","last_change":"2024-05-15T14:49:25.109828+0000","last_active":"2024-05-15T14:49:25.109805+0000","last_peered":"2024-05-15T14:49:25.109805+0000","last_clean":"2024-05-15T14:49:25.109805+0000","last_became_active":"2024-05-15T14:28:02.889940+0000","last_became_peered":"2024-05-15T14:28:02.889940+0000","last_unstale":"2024-05-15T14:49:25.109805+0000","last_undegraded":"2024-05-15T14:49:25.109805+0000","last_fullsized":"2024-05-15T14:49:25.109805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:25.109684+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:25.109684+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.109684+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:45.669703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":111,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.263616+0000","last_change":"2024-05-15T14:49:38.263643+0000","last_active":"2024-05-15T14:49:38.263616+0000","last_peered":"2024-05-15T14:49:38.263616+0000","last_clean":"2024-05-15T14:49:38.263616+0000","last_became_active":"2024-05-15T14:31:16.590270+0000","last_became_peered":"2024-05-15T14:31:16.590270+0000","last_unstale":"2024-05-15T14:49:38.263616+0000","last_undegraded":"2024-05-15T14:49:38.263616+0000","last_fullsized":"2024-05-15T14:49:38.263616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:38.263509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:38.263509+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.263509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:35.074087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'14","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.643317+0000","last_change":"2024-05-15T14:49:18.643350+0000","last_active":"2024-05-15T14:49:18.643317+0000","last_peered":"2024-05-15T14:49:18.643317+0000","last_clean":"2024-05-15T14:49:18.643317+0000","last_became_active":"2024-05-15T14:27:52.861459+0000","last_became_peered":"2024-05-15T14:27:52.861459+0000","last_unstale":"2024-05-15T14:49:18.643317+0000","last_undegraded":"2024-05-15T14:49:18.643317+0000","last_fullsized":"2024-05-15T14:49:18.643317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:18.643228+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:18.643228+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.643228+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:21.768562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"39'12","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.265644+0000","last_change":"2024-05-15T14:49:24.265672+0000","last_active":"2024-05-15T14:49:24.265644+0000","last_peered":"2024-05-15T14:49:24.265644+0000","last_clean":"2024-05-15T14:49:24.265644+0000","last_became_active":"2024-05-15T14:27:50.836343+0000","last_became_peered":"2024-05-15T14:27:50.836343+0000","last_unstale":"2024-05-15T14:49:24.265644+0000","last_undegraded":"2024-05-15T14:49:24.265644+0000","last_fullsized":"2024-05-15T14:49:24.265644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:24.265555+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:24.265555+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.265555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:29:09.975638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.203034+0000","last_change":"2024-05-15T14:49:18.203061+0000","last_active":"2024-05-15T14:49:18.203034+0000","last_peered":"2024-05-15T14:49:18.203034+0000","last_clean":"2024-05-15T14:49:18.203034+0000","last_became_active":"2024-05-15T14:27:56.876994+0000","last_became_peered":"2024-05-15T14:27:56.876994+0000","last_unstale":"2024-05-15T14:49:18.203034+0000","last_undegraded":"2024-05-15T14:49:18.203034+0000","last_fullsized":"2024-05-15T14:49:18.203034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:18.202940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:18.202940+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.202940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:30.386529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"39'256","reported_seq":489,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:42.425963+0000","last_change":"2024-05-15T14:49:42.426000+0000","last_active":"2024-05-15T14:49:42.425963+0000","last_peered":"2024-05-15T14:49:42.425963+0000","last_clean":"2024-05-15T14:49:42.425963+0000","last_became_active":"2024-05-15T14:27:58.876807+0000","last_became_peered":"2024-05-15T14:27:58.876807+0000","last_unstale":"2024-05-15T14:49:42.425963+0000","last_undegraded":"2024-05-15T14:49:42.425963+0000","last_fullsized":"2024-05-15T14:49:42.425963+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'256","last_scrub_stamp":"2024-05-15T14:49:42.425862+0000","last_deep_scrub":"39'256","last_deep_scrub_stamp":"2024-05-15T14:49:42.425862+0000","last_clean_scrub_stamp":"2024-05-15T14:49:42.425862+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:30:55.530832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":396,"num_write":226,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.078333+0000","last_change":"2024-05-15T14:49:14.078360+0000","last_active":"2024-05-15T14:49:14.078333+0000","last_peered":"2024-05-15T14:49:14.078333+0000","last_clean":"2024-05-15T14:49:14.078333+0000","last_became_active":"2024-05-15T14:28:00.891181+0000","last_became_peered":"2024-05-15T14:28:00.891181+0000","last_unstale":"2024-05-15T14:49:14.078333+0000","last_undegraded":"2024-05-15T14:49:14.078333+0000","last_fullsized":"2024-05-15T14:49:14.078333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:14.078232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:14.078232+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.078232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:32.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"39'31","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.950712+0000","last_change":"2024-05-15T14:49:05.950748+0000","last_active":"2024-05-15T14:49:05.950712+0000","last_peered":"2024-05-15T14:49:05.950712+0000","last_clean":"2024-05-15T14:49:05.950712+0000","last_became_active":"2024-05-15T14:28:02.889976+0000","last_became_peered":"2024-05-15T14:28:02.889976+0000","last_unstale":"2024-05-15T14:49:05.950712+0000","last_undegraded":"2024-05-15T14:49:05.950712+0000","last_fullsized":"2024-05-15T14:49:05.950712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:05.950622+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:05.950622+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.950622+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:32.800900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:40.543395+0000","last_change":"2024-05-15T14:49:40.543421+0000","last_active":"2024-05-15T14:49:40.543395+0000","last_peered":"2024-05-15T14:49:40.543395+0000","last_clean":"2024-05-15T14:49:40.543395+0000","last_became_active":"2024-05-15T14:31:16.591739+0000","last_became_peered":"2024-05-15T14:31:16.591739+0000","last_unstale":"2024-05-15T14:49:40.543395+0000","last_undegraded":"2024-05-15T14:49:40.543395+0000","last_fullsized":"2024-05-15T14:49:40.543395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:40.543304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:40.543304+0000","last_clean_scrub_stamp":"2024-05-15T14:49:40.543304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:11:30.899593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1c","version":"39'60","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.335021+0000","last_change":"2024-05-15T14:49:08.335055+0000","last_active":"2024-05-15T14:49:08.335021+0000","last_peered":"2024-05-15T14:49:08.335021+0000","last_clean":"2024-05-15T14:49:08.335021+0000","last_became_active":"2024-05-15T14:27:52.838558+0000","last_became_peered":"2024-05-15T14:27:52.838558+0000","last_unstale":"2024-05-15T14:49:08.335021+0000","last_undegraded":"2024-05-15T14:49:08.335021+0000","last_fullsized":"2024-05-15T14:49:08.335021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'60","last_scrub_stamp":"2024-05-15T14:49:08.334922+0000","last_deep_scrub":"39'60","last_deep_scrub_stamp":"2024-05-15T14:49:08.334922+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.334922+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:42:26.393241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":198,"num_write":84,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"39'14","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.276654+0000","last_change":"2024-05-15T14:49:32.276681+0000","last_active":"2024-05-15T14:49:32.276654+0000","last_peered":"2024-05-15T14:49:32.276654+0000","last_clean":"2024-05-15T14:49:32.276654+0000","last_became_active":"2024-05-15T14:27:50.833741+0000","last_became_peered":"2024-05-15T14:27:50.833741+0000","last_unstale":"2024-05-15T14:49:32.276654+0000","last_undegraded":"2024-05-15T14:49:32.276654+0000","last_fullsized":"2024-05-15T14:49:32.276654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:32.276549+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:32.276549+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.276549+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:29.087127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20,"num_write":62,"num_write_kb":15860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"39'4","reported_seq":287,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.052843+0000","last_change":"2024-05-15T14:49:04.052897+0000","last_active":"2024-05-15T14:49:04.052843+0000","last_peered":"2024-05-15T14:49:04.052843+0000","last_clean":"2024-05-15T14:49:04.052843+0000","last_became_active":"2024-05-15T14:27:56.883663+0000","last_became_peered":"2024-05-15T14:27:56.883663+0000","last_unstale":"2024-05-15T14:49:04.052843+0000","last_undegraded":"2024-05-15T14:49:04.052843+0000","last_fullsized":"2024-05-15T14:49:04.052843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:04.052742+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:04.052742+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.052742+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:00.238835+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2211,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":456,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"39'296","reported_seq":661,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.316930+0000","last_change":"2024-05-15T14:49:32.316972+0000","last_active":"2024-05-15T14:49:32.316930+0000","last_peered":"2024-05-15T14:49:32.316930+0000","last_clean":"2024-05-15T14:49:32.316930+0000","last_became_active":"2024-05-15T14:27:58.880510+0000","last_became_peered":"2024-05-15T14:27:58.880510+0000","last_unstale":"2024-05-15T14:49:32.316930+0000","last_undegraded":"2024-05-15T14:49:32.316930+0000","last_fullsized":"2024-05-15T14:49:32.316930+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'296","last_scrub_stamp":"2024-05-15T14:49:32.316840+0000","last_deep_scrub":"39'296","last_deep_scrub_stamp":"2024-05-15T14:49:32.316840+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.316840+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:34.626378+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":979,"num_read_kb":1295,"num_write":324,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2476,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'927","reported_seq":2566,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.113120+0000","last_change":"2024-05-15T14:49:07.113188+0000","last_active":"2024-05-15T14:49:07.113120+0000","last_peered":"2024-05-15T14:49:07.113120+0000","last_clean":"2024-05-15T14:49:07.113120+0000","last_became_active":"2024-05-15T14:28:00.885293+0000","last_became_peered":"2024-05-15T14:28:00.885293+0000","last_unstale":"2024-05-15T14:49:07.113120+0000","last_undegraded":"2024-05-15T14:49:07.113120+0000","last_fullsized":"2024-05-15T14:49:07.113120+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:07.113019+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:07.113019+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.113019+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:38:04.929797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"39'25","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.887862+0000","last_change":"2024-05-15T14:49:06.887889+0000","last_active":"2024-05-15T14:49:06.887862+0000","last_peered":"2024-05-15T14:49:06.887862+0000","last_clean":"2024-05-15T14:49:06.887862+0000","last_became_active":"2024-05-15T14:28:02.892984+0000","last_became_peered":"2024-05-15T14:28:02.892984+0000","last_unstale":"2024-05-15T14:49:06.887862+0000","last_undegraded":"2024-05-15T14:49:06.887862+0000","last_fullsized":"2024-05-15T14:49:06.887862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:06.887772+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:06.887772+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.887772+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:33.315561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":37,"num_write":54,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.239115+0000","last_change":"2024-05-15T14:49:39.239143+0000","last_active":"2024-05-15T14:49:39.239115+0000","last_peered":"2024-05-15T14:49:39.239115+0000","last_clean":"2024-05-15T14:49:39.239115+0000","last_became_active":"2024-05-15T14:31:16.594019+0000","last_became_peered":"2024-05-15T14:31:16.594019+0000","last_unstale":"2024-05-15T14:49:39.239115+0000","last_undegraded":"2024-05-15T14:49:39.239115+0000","last_fullsized":"2024-05-15T14:49:39.239115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:39.238992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:39.238992+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.238992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:37:29.703568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"39'52","reported_seq":150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.336418+0000","last_change":"2024-05-15T14:49:08.336446+0000","last_active":"2024-05-15T14:49:08.336418+0000","last_peered":"2024-05-15T14:49:08.336418+0000","last_clean":"2024-05-15T14:49:08.336418+0000","last_became_active":"2024-05-15T14:27:52.854479+0000","last_became_peered":"2024-05-15T14:27:52.854479+0000","last_unstale":"2024-05-15T14:49:08.336418+0000","last_undegraded":"2024-05-15T14:49:08.336418+0000","last_fullsized":"2024-05-15T14:49:08.336418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'52","last_scrub_stamp":"2024-05-15T14:49:08.336317+0000","last_deep_scrub":"39'52","last_deep_scrub_stamp":"2024-05-15T14:49:08.336317+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.336317+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:26.297455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":157,"num_write":72,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"39'14","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.024594+0000","last_change":"2024-05-15T14:49:33.024621+0000","last_active":"2024-05-15T14:49:33.024594+0000","last_peered":"2024-05-15T14:49:33.024594+0000","last_clean":"2024-05-15T14:49:33.024594+0000","last_became_active":"2024-05-15T14:27:50.840771+0000","last_became_peered":"2024-05-15T14:27:50.840771+0000","last_unstale":"2024-05-15T14:49:33.024594+0000","last_undegraded":"2024-05-15T14:49:33.024594+0000","last_fullsized":"2024-05-15T14:49:33.024594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:33.024498+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:33.024498+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.024498+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:12:24.618493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.797856+0000","last_change":"2024-05-15T14:49:16.797903+0000","last_active":"2024-05-15T14:49:16.797856+0000","last_peered":"2024-05-15T14:49:16.797856+0000","last_clean":"2024-05-15T14:49:16.797856+0000","last_became_active":"2024-05-15T14:27:56.877367+0000","last_became_peered":"2024-05-15T14:27:56.877367+0000","last_unstale":"2024-05-15T14:49:16.797856+0000","last_undegraded":"2024-05-15T14:49:16.797856+0000","last_fullsized":"2024-05-15T14:49:16.797856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:16.797749+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:16.797749+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.797749+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:40.177618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":101,"num_read_kb":87,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"39'422","reported_seq":23003,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.092516+0000","last_change":"2024-05-15T14:49:38.092567+0000","last_active":"2024-05-15T14:49:38.092516+0000","last_peered":"2024-05-15T14:49:38.092516+0000","last_clean":"2024-05-15T14:49:38.092516+0000","last_became_active":"2024-05-15T14:27:58.882139+0000","last_became_peered":"2024-05-15T14:27:58.882139+0000","last_unstale":"2024-05-15T14:49:38.092516+0000","last_undegraded":"2024-05-15T14:49:38.092516+0000","last_fullsized":"2024-05-15T14:49:38.092516+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'422","last_scrub_stamp":"2024-05-15T14:49:38.092422+0000","last_deep_scrub":"39'422","last_deep_scrub_stamp":"2024-05-15T14:49:38.092422+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.092422+0000","objects_scrubbed":11,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:33:17.727919+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56371,"num_read_kb":194199,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.130778+0000","last_change":"2024-05-15T14:49:07.130805+0000","last_active":"2024-05-15T14:49:07.130778+0000","last_peered":"2024-05-15T14:49:07.130778+0000","last_clean":"2024-05-15T14:49:07.130778+0000","last_became_active":"2024-05-15T14:28:00.885872+0000","last_became_peered":"2024-05-15T14:28:00.885872+0000","last_unstale":"2024-05-15T14:49:07.130778+0000","last_undegraded":"2024-05-15T14:49:07.130778+0000","last_fullsized":"2024-05-15T14:49:07.130778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.130678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.130678+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.130678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:00.272870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"39'21","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.516894+0000","last_change":"2024-05-15T14:49:37.516922+0000","last_active":"2024-05-15T14:49:37.516894+0000","last_peered":"2024-05-15T14:49:37.516894+0000","last_clean":"2024-05-15T14:49:37.516894+0000","last_became_active":"2024-05-15T14:28:02.896293+0000","last_became_peered":"2024-05-15T14:28:02.896293+0000","last_unstale":"2024-05-15T14:49:37.516894+0000","last_undegraded":"2024-05-15T14:49:37.516894+0000","last_fullsized":"2024-05-15T14:49:37.516894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'21","last_scrub_stamp":"2024-05-15T14:49:37.516796+0000","last_deep_scrub":"39'21","last_deep_scrub_stamp":"2024-05-15T14:49:37.516796+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.516796+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:52.753921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:48:12.533094+0000","last_change":"2024-05-15T14:31:16.594407+0000","last_active":"2024-05-15T14:48:12.533094+0000","last_peered":"2024-05-15T14:48:12.533094+0000","last_clean":"2024-05-15T14:48:12.533094+0000","last_became_active":"2024-05-15T14:31:16.594144+0000","last_became_peered":"2024-05-15T14:31:16.594144+0000","last_unstale":"2024-05-15T14:48:12.533094+0000","last_undegraded":"2024-05-15T14:48:12.533094+0000","last_fullsized":"2024-05-15T14:48:12.533094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:31:15.566465+0000","last_clean_scrub_stamp":"2024-05-15T14:31:15.566465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"39'56","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.317080+0000","last_change":"2024-05-15T14:49:10.317106+0000","last_active":"2024-05-15T14:49:10.317080+0000","last_peered":"2024-05-15T14:49:10.317080+0000","last_clean":"2024-05-15T14:49:10.317080+0000","last_became_active":"2024-05-15T14:27:52.854517+0000","last_became_peered":"2024-05-15T14:27:52.854517+0000","last_unstale":"2024-05-15T14:49:10.317080+0000","last_undegraded":"2024-05-15T14:49:10.317080+0000","last_fullsized":"2024-05-15T14:49:10.317080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'56","last_scrub_stamp":"2024-05-15T14:49:10.316960+0000","last_deep_scrub":"39'56","last_deep_scrub_stamp":"2024-05-15T14:49:10.316960+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.316960+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:31.795310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":183,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"39'16","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.034206+0000","last_change":"2024-05-15T14:49:32.034233+0000","last_active":"2024-05-15T14:49:32.034206+0000","last_peered":"2024-05-15T14:49:32.034206+0000","last_clean":"2024-05-15T14:49:32.034206+0000","last_became_active":"2024-05-15T14:27:50.839960+0000","last_became_peered":"2024-05-15T14:27:50.839960+0000","last_unstale":"2024-05-15T14:49:32.034206+0000","last_undegraded":"2024-05-15T14:49:32.034206+0000","last_fullsized":"2024-05-15T14:49:32.034206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:32.034114+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:32.034114+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.034114+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:10:40.340523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"39'2","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.048974+0000","last_change":"2024-05-15T14:49:28.049023+0000","last_active":"2024-05-15T14:49:28.048974+0000","last_peered":"2024-05-15T14:49:28.048974+0000","last_clean":"2024-05-15T14:49:28.048974+0000","last_became_active":"2024-05-15T14:27:56.883267+0000","last_became_peered":"2024-05-15T14:27:56.883267+0000","last_unstale":"2024-05-15T14:49:28.048974+0000","last_undegraded":"2024-05-15T14:49:28.048974+0000","last_fullsized":"2024-05-15T14:49:28.048974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:28.048878+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:28.048878+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.048878+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:10:08.121459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"39'224","reported_seq":434,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.331797+0000","last_change":"2024-05-15T14:49:29.331844+0000","last_active":"2024-05-15T14:49:29.331797+0000","last_peered":"2024-05-15T14:49:29.331797+0000","last_clean":"2024-05-15T14:49:29.331797+0000","last_became_active":"2024-05-15T14:27:58.882239+0000","last_became_peered":"2024-05-15T14:27:58.882239+0000","last_unstale":"2024-05-15T14:49:29.331797+0000","last_undegraded":"2024-05-15T14:49:29.331797+0000","last_fullsized":"2024-05-15T14:49:29.331797+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'224","last_scrub_stamp":"2024-05-15T14:49:29.331696+0000","last_deep_scrub":"39'224","last_deep_scrub_stamp":"2024-05-15T14:49:29.331696+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.331696+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:20.337088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":346,"num_read_kb":338,"num_write":194,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.140247+0000","last_change":"2024-05-15T14:49:11.140271+0000","last_active":"2024-05-15T14:49:11.140247+0000","last_peered":"2024-05-15T14:49:11.140247+0000","last_clean":"2024-05-15T14:49:11.140247+0000","last_became_active":"2024-05-15T14:28:00.886898+0000","last_became_peered":"2024-05-15T14:28:00.886898+0000","last_unstale":"2024-05-15T14:49:11.140247+0000","last_undegraded":"2024-05-15T14:49:11.140247+0000","last_fullsized":"2024-05-15T14:49:11.140247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:11.140161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:11.140161+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.140161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:21:44.609330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"39'13","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.596345+0000","last_change":"2024-05-15T14:49:02.596392+0000","last_active":"2024-05-15T14:49:02.596345+0000","last_peered":"2024-05-15T14:49:02.596345+0000","last_clean":"2024-05-15T14:49:02.596345+0000","last_became_active":"2024-05-15T14:28:02.890595+0000","last_became_peered":"2024-05-15T14:28:02.890595+0000","last_unstale":"2024-05-15T14:49:02.596345+0000","last_undegraded":"2024-05-15T14:49:02.596345+0000","last_fullsized":"2024-05-15T14:49:02.596345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'13","last_scrub_stamp":"2024-05-15T14:49:02.596237+0000","last_deep_scrub":"39'13","last_deep_scrub_stamp":"2024-05-15T14:49:02.596237+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.596237+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:22.841762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.789419+0000","last_change":"2024-05-15T14:49:32.789448+0000","last_active":"2024-05-15T14:49:32.789419+0000","last_peered":"2024-05-15T14:49:32.789419+0000","last_clean":"2024-05-15T14:49:32.789419+0000","last_became_active":"2024-05-15T14:31:16.597207+0000","last_became_peered":"2024-05-15T14:31:16.597207+0000","last_unstale":"2024-05-15T14:49:32.789419+0000","last_undegraded":"2024-05-15T14:49:32.789419+0000","last_fullsized":"2024-05-15T14:49:32.789419+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:32.789325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:32.789325+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.789325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:04:05.890839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"39'94","reported_seq":218,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.686057+0000","last_change":"2024-05-15T14:49:23.686057+0000","last_active":"2024-05-15T14:49:23.686057+0000","last_peered":"2024-05-15T14:49:23.686057+0000","last_clean":"2024-05-15T14:49:23.686057+0000","last_became_active":"2024-05-15T14:27:52.852536+0000","last_became_peered":"2024-05-15T14:27:52.852536+0000","last_unstale":"2024-05-15T14:49:23.686057+0000","last_undegraded":"2024-05-15T14:49:23.686057+0000","last_fullsized":"2024-05-15T14:49:23.686057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2024-05-15T14:49:23.685948+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2024-05-15T14:49:23.685948+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.685948+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:20.496527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":296,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"39'22","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.384404+0000","last_change":"2024-05-15T14:49:37.384430+0000","last_active":"2024-05-15T14:49:37.384404+0000","last_peered":"2024-05-15T14:49:37.384404+0000","last_clean":"2024-05-15T14:49:37.384404+0000","last_became_active":"2024-05-15T14:27:50.847850+0000","last_became_peered":"2024-05-15T14:27:50.847850+0000","last_unstale":"2024-05-15T14:49:37.384404+0000","last_undegraded":"2024-05-15T14:49:37.384404+0000","last_fullsized":"2024-05-15T14:49:37.384404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:37.384314+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:37.384314+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.384314+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:10.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":44,"num_write":110,"num_write_kb":26471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"39'4","reported_seq":1320,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.188745+0000","last_change":"2024-05-15T14:49:20.188745+0000","last_active":"2024-05-15T14:49:20.188745+0000","last_peered":"2024-05-15T14:49:20.188745+0000","last_clean":"2024-05-15T14:49:20.188745+0000","last_became_active":"2024-05-15T14:27:56.879092+0000","last_became_peered":"2024-05-15T14:27:56.879092+0000","last_unstale":"2024-05-15T14:49:20.188745+0000","last_undegraded":"2024-05-15T14:49:20.188745+0000","last_fullsized":"2024-05-15T14:49:20.188745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:20.188613+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:20.188613+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.188613+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:54.028706+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1596,"num_read_kb":1594,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'235","reported_seq":404,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.658410+0000","last_change":"2024-05-15T14:49:10.658453+0000","last_active":"2024-05-15T14:49:10.658410+0000","last_peered":"2024-05-15T14:49:10.658410+0000","last_clean":"2024-05-15T14:49:10.658410+0000","last_became_active":"2024-05-15T14:27:58.882703+0000","last_became_peered":"2024-05-15T14:27:58.882703+0000","last_unstale":"2024-05-15T14:49:10.658410+0000","last_undegraded":"2024-05-15T14:49:10.658410+0000","last_fullsized":"2024-05-15T14:49:10.658410+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'235","last_scrub_stamp":"2024-05-15T14:49:10.658310+0000","last_deep_scrub":"39'235","last_deep_scrub_stamp":"2024-05-15T14:49:10.658310+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.658310+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:47.078696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":469,"num_write":437,"num_write_kb":1979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.387544+0000","last_change":"2024-05-15T14:49:06.387569+0000","last_active":"2024-05-15T14:49:06.387544+0000","last_peered":"2024-05-15T14:49:06.387544+0000","last_clean":"2024-05-15T14:49:06.387544+0000","last_became_active":"2024-05-15T14:28:00.884499+0000","last_became_peered":"2024-05-15T14:28:00.884499+0000","last_unstale":"2024-05-15T14:49:06.387544+0000","last_undegraded":"2024-05-15T14:49:06.387544+0000","last_fullsized":"2024-05-15T14:49:06.387544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.387416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.387416+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.387416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:35.420936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"39'19","reported_seq":62,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.861398+0000","last_change":"2024-05-15T14:49:10.861426+0000","last_active":"2024-05-15T14:49:10.861398+0000","last_peered":"2024-05-15T14:49:10.861398+0000","last_clean":"2024-05-15T14:49:10.861398+0000","last_became_active":"2024-05-15T14:28:02.895999+0000","last_became_peered":"2024-05-15T14:28:02.895999+0000","last_unstale":"2024-05-15T14:49:10.861398+0000","last_undegraded":"2024-05-15T14:49:10.861398+0000","last_fullsized":"2024-05-15T14:49:10.861398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'19","last_scrub_stamp":"2024-05-15T14:49:10.861308+0000","last_deep_scrub":"39'19","last_deep_scrub_stamp":"2024-05-15T14:49:10.861308+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.861308+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:20:05.506912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:41.575225+0000","last_change":"2024-05-15T14:49:41.575248+0000","last_active":"2024-05-15T14:49:41.575225+0000","last_peered":"2024-05-15T14:49:41.575225+0000","last_clean":"2024-05-15T14:49:41.575225+0000","last_became_active":"2024-05-15T14:31:16.593126+0000","last_became_peered":"2024-05-15T14:31:16.593126+0000","last_unstale":"2024-05-15T14:49:41.575225+0000","last_undegraded":"2024-05-15T14:49:41.575225+0000","last_fullsized":"2024-05-15T14:49:41.575225+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:41.575140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:41.575140+0000","last_clean_scrub_stamp":"2024-05-15T14:49:41.575140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:24.595555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.304348+0000","last_change":"2024-05-15T14:49:29.304348+0000","last_active":"2024-05-15T14:49:29.304348+0000","last_peered":"2024-05-15T14:49:29.304348+0000","last_clean":"2024-05-15T14:49:29.304348+0000","last_became_active":"2024-05-15T14:27:52.844112+0000","last_became_peered":"2024-05-15T14:27:52.844112+0000","last_unstale":"2024-05-15T14:49:29.304348+0000","last_undegraded":"2024-05-15T14:49:29.304348+0000","last_fullsized":"2024-05-15T14:49:29.304348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:29.304230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:29.304230+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.304230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:54:25.785614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"39'20","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.343644+0000","last_change":"2024-05-15T14:49:36.343669+0000","last_active":"2024-05-15T14:49:36.343644+0000","last_peered":"2024-05-15T14:49:36.343644+0000","last_clean":"2024-05-15T14:49:36.343644+0000","last_became_active":"2024-05-15T14:27:50.843701+0000","last_became_peered":"2024-05-15T14:27:50.843701+0000","last_unstale":"2024-05-15T14:49:36.343644+0000","last_undegraded":"2024-05-15T14:49:36.343644+0000","last_fullsized":"2024-05-15T14:49:36.343644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:36.343529+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:36.343529+0000","last_clean_scrub_stamp":"2024-05-15T14:49:36.343529+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:02:24.999543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":100,"num_write_kb":23517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.095887+0000","last_change":"2024-05-15T14:49:02.095906+0000","last_active":"2024-05-15T14:49:02.095887+0000","last_peered":"2024-05-15T14:49:02.095887+0000","last_clean":"2024-05-15T14:49:02.095887+0000","last_became_active":"2024-05-15T14:27:56.883534+0000","last_became_peered":"2024-05-15T14:27:56.883534+0000","last_unstale":"2024-05-15T14:49:02.095887+0000","last_undegraded":"2024-05-15T14:49:02.095887+0000","last_fullsized":"2024-05-15T14:49:02.095887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:02.095799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:02.095799+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.095799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:14:42.041400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"39'327","reported_seq":542,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.407498+0000","last_change":"2024-05-15T14:49:03.407537+0000","last_active":"2024-05-15T14:49:03.407498+0000","last_peered":"2024-05-15T14:49:03.407498+0000","last_clean":"2024-05-15T14:49:03.407498+0000","last_became_active":"2024-05-15T14:27:58.885479+0000","last_became_peered":"2024-05-15T14:27:58.885479+0000","last_unstale":"2024-05-15T14:49:03.407498+0000","last_undegraded":"2024-05-15T14:49:03.407498+0000","last_fullsized":"2024-05-15T14:49:03.407498+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'327","last_scrub_stamp":"2024-05-15T14:49:03.407417+0000","last_deep_scrub":"39'327","last_deep_scrub_stamp":"2024-05-15T14:49:03.407417+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.407417+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:33.672132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":606,"num_write":518,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.127126+0000","last_change":"2024-05-15T14:49:10.127153+0000","last_active":"2024-05-15T14:49:10.127126+0000","last_peered":"2024-05-15T14:49:10.127126+0000","last_clean":"2024-05-15T14:49:10.127126+0000","last_became_active":"2024-05-15T14:28:00.885171+0000","last_became_peered":"2024-05-15T14:28:00.885171+0000","last_unstale":"2024-05-15T14:49:10.127126+0000","last_undegraded":"2024-05-15T14:49:10.127126+0000","last_fullsized":"2024-05-15T14:49:10.127126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:10.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:10.127026+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:33.506895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'29","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:35.312586+0000","last_change":"2024-05-15T14:49:35.312640+0000","last_active":"2024-05-15T14:49:35.312586+0000","last_peered":"2024-05-15T14:49:35.312586+0000","last_clean":"2024-05-15T14:49:35.312586+0000","last_became_active":"2024-05-15T14:28:02.888247+0000","last_became_peered":"2024-05-15T14:28:02.888247+0000","last_unstale":"2024-05-15T14:49:35.312586+0000","last_undegraded":"2024-05-15T14:49:35.312586+0000","last_fullsized":"2024-05-15T14:49:35.312586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'29","last_scrub_stamp":"2024-05-15T14:49:35.312474+0000","last_deep_scrub":"39'29","last_deep_scrub_stamp":"2024-05-15T14:49:35.312474+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.312474+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:26.317866+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":30,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"39'16","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.075052+0000","last_change":"2024-05-15T14:49:11.075052+0000","last_active":"2024-05-15T14:49:11.075052+0000","last_peered":"2024-05-15T14:49:11.075052+0000","last_clean":"2024-05-15T14:49:11.075052+0000","last_became_active":"2024-05-15T14:27:52.844292+0000","last_became_peered":"2024-05-15T14:27:52.844292+0000","last_unstale":"2024-05-15T14:49:11.075052+0000","last_undegraded":"2024-05-15T14:49:11.075052+0000","last_fullsized":"2024-05-15T14:49:11.075052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:11.074913+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:11.074913+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.074913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:37.502702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"39'20","reported_seq":108,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.149154+0000","last_change":"2024-05-15T14:49:19.149192+0000","last_active":"2024-05-15T14:49:19.149154+0000","last_peered":"2024-05-15T14:49:19.149154+0000","last_clean":"2024-05-15T14:49:19.149154+0000","last_became_active":"2024-05-15T14:27:50.853042+0000","last_became_peered":"2024-05-15T14:27:50.853042+0000","last_unstale":"2024-05-15T14:49:19.149154+0000","last_undegraded":"2024-05-15T14:49:19.149154+0000","last_fullsized":"2024-05-15T14:49:19.149154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:19.149063+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:19.149063+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.149063+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:12.578395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":35,"num_write":92,"num_write_kb":30554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"39'20","reported_seq":122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.060054+0000","last_change":"2024-05-15T14:49:15.060054+0000","last_active":"2024-05-15T14:49:15.060054+0000","last_peered":"2024-05-15T14:49:15.060054+0000","last_clean":"2024-05-15T14:49:15.060054+0000","last_became_active":"2024-05-15T14:27:52.840716+0000","last_became_peered":"2024-05-15T14:27:52.840716+0000","last_unstale":"2024-05-15T14:49:15.060054+0000","last_undegraded":"2024-05-15T14:49:15.060054+0000","last_fullsized":"2024-05-15T14:49:15.060054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:15.059932+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:15.059932+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.059932+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:56.592681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"39'16","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.508457+0000","last_change":"2024-05-15T14:49:20.508498+0000","last_active":"2024-05-15T14:49:20.508457+0000","last_peered":"2024-05-15T14:49:20.508457+0000","last_clean":"2024-05-15T14:49:20.508457+0000","last_became_active":"2024-05-15T14:28:38.450578+0000","last_became_peered":"2024-05-15T14:28:38.450578+0000","last_unstale":"2024-05-15T14:49:20.508457+0000","last_undegraded":"2024-05-15T14:49:20.508457+0000","last_fullsized":"2024-05-15T14:49:20.508457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.508362+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.508362+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.508362+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:16.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"39'26","reported_seq":120,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.072811+0000","last_change":"2024-05-15T14:49:15.072811+0000","last_active":"2024-05-15T14:49:15.072811+0000","last_peered":"2024-05-15T14:49:15.072811+0000","last_clean":"2024-05-15T14:49:15.072811+0000","last_became_active":"2024-05-15T14:27:52.841192+0000","last_became_peered":"2024-05-15T14:27:52.841192+0000","last_unstale":"2024-05-15T14:49:15.072811+0000","last_undegraded":"2024-05-15T14:49:15.072811+0000","last_fullsized":"2024-05-15T14:49:15.072811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.072647+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.072647+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.072647+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:35.318172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":93,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"39'18","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:40.039150+0000","last_change":"2024-05-15T14:49:40.039173+0000","last_active":"2024-05-15T14:49:40.039150+0000","last_peered":"2024-05-15T14:49:40.039150+0000","last_clean":"2024-05-15T14:49:40.039150+0000","last_became_active":"2024-05-15T14:28:38.450592+0000","last_became_peered":"2024-05-15T14:28:38.450592+0000","last_unstale":"2024-05-15T14:49:40.039150+0000","last_undegraded":"2024-05-15T14:49:40.039150+0000","last_fullsized":"2024-05-15T14:49:40.039150+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:40.039043+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:40.039043+0000","last_clean_scrub_stamp":"2024-05-15T14:49:40.039043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:25:12.969205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"39'72","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.078305+0000","last_change":"2024-05-15T14:49:39.078330+0000","last_active":"2024-05-15T14:49:39.078305+0000","last_peered":"2024-05-15T14:49:39.078305+0000","last_clean":"2024-05-15T14:49:39.078305+0000","last_became_active":"2024-05-15T14:28:37.941389+0000","last_became_peered":"2024-05-15T14:28:37.941389+0000","last_unstale":"2024-05-15T14:49:39.078305+0000","last_undegraded":"2024-05-15T14:49:39.078305+0000","last_fullsized":"2024-05-15T14:49:39.078305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'72","last_scrub_stamp":"2024-05-15T14:49:39.078206+0000","last_deep_scrub":"39'72","last_deep_scrub_stamp":"2024-05-15T14:49:39.078206+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.078206+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:22.098621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":236,"num_write":102,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"39'18","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.286967+0000","last_change":"2024-05-15T14:49:28.286997+0000","last_active":"2024-05-15T14:49:28.286967+0000","last_peered":"2024-05-15T14:49:28.286967+0000","last_clean":"2024-05-15T14:49:28.286967+0000","last_became_active":"2024-05-15T14:27:50.848763+0000","last_became_peered":"2024-05-15T14:27:50.848763+0000","last_unstale":"2024-05-15T14:49:28.286967+0000","last_undegraded":"2024-05-15T14:49:28.286967+0000","last_fullsized":"2024-05-15T14:49:28.286967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:28.286874+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:28.286874+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.286874+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:26:29.553520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":82,"num_write_kb":24675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"39'82","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.667759+0000","last_change":"2024-05-15T14:49:21.667789+0000","last_active":"2024-05-15T14:49:21.667759+0000","last_peered":"2024-05-15T14:49:21.667759+0000","last_clean":"2024-05-15T14:49:21.667759+0000","last_became_active":"2024-05-15T14:27:52.851068+0000","last_became_peered":"2024-05-15T14:27:52.851068+0000","last_unstale":"2024-05-15T14:49:21.667759+0000","last_undegraded":"2024-05-15T14:49:21.667759+0000","last_fullsized":"2024-05-15T14:49:21.667759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'82","last_scrub_stamp":"2024-05-15T14:49:21.667665+0000","last_deep_scrub":"39'82","last_deep_scrub_stamp":"2024-05-15T14:49:21.667665+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.667665+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:27.464154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":322,"num_read_kb":258,"num_write":116,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"39'10","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:35.433702+0000","last_change":"2024-05-15T14:49:35.433727+0000","last_active":"2024-05-15T14:49:35.433702+0000","last_peered":"2024-05-15T14:49:35.433702+0000","last_clean":"2024-05-15T14:49:35.433702+0000","last_became_active":"2024-05-15T14:27:50.847042+0000","last_became_peered":"2024-05-15T14:27:50.847042+0000","last_unstale":"2024-05-15T14:49:35.433702+0000","last_undegraded":"2024-05-15T14:49:35.433702+0000","last_fullsized":"2024-05-15T14:49:35.433702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:35.433607+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:35.433607+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.433607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:59:47.232976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'66","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.314486+0000","last_change":"2024-05-15T14:49:31.314535+0000","last_active":"2024-05-15T14:49:31.314486+0000","last_peered":"2024-05-15T14:49:31.314486+0000","last_clean":"2024-05-15T14:49:31.314486+0000","last_became_active":"2024-05-15T14:27:52.846918+0000","last_became_peered":"2024-05-15T14:27:52.846918+0000","last_unstale":"2024-05-15T14:49:31.314486+0000","last_undegraded":"2024-05-15T14:49:31.314486+0000","last_fullsized":"2024-05-15T14:49:31.314486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'66","last_scrub_stamp":"2024-05-15T14:49:31.314369+0000","last_deep_scrub":"39'66","last_deep_scrub_stamp":"2024-05-15T14:49:31.314369+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.314369+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:27:25.369922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":226,"num_write":90,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.942571+0000","last_change":"2024-05-15T14:49:23.942571+0000","last_active":"2024-05-15T14:49:23.942571+0000","last_peered":"2024-05-15T14:49:23.942571+0000","last_clean":"2024-05-15T14:49:23.942571+0000","last_became_active":"2024-05-15T14:27:50.849910+0000","last_became_peered":"2024-05-15T14:27:50.849910+0000","last_unstale":"2024-05-15T14:49:23.942571+0000","last_undegraded":"2024-05-15T14:49:23.942571+0000","last_fullsized":"2024-05-15T14:49:23.942571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:23.942463+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:23.942463+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.942463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:46.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.650883+0000","last_change":"2024-05-15T14:49:20.650911+0000","last_active":"2024-05-15T14:49:20.650883+0000","last_peered":"2024-05-15T14:49:20.650883+0000","last_clean":"2024-05-15T14:49:20.650883+0000","last_became_active":"2024-05-15T14:27:52.862227+0000","last_became_peered":"2024-05-15T14:27:52.862227+0000","last_unstale":"2024-05-15T14:49:20.650883+0000","last_undegraded":"2024-05-15T14:49:20.650883+0000","last_fullsized":"2024-05-15T14:49:20.650883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-05-15T14:49:20.650774+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-05-15T14:49:20.650774+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.650774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:11.656167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"39'14","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.193934+0000","last_change":"2024-05-15T14:49:27.193934+0000","last_active":"2024-05-15T14:49:27.193934+0000","last_peered":"2024-05-15T14:49:27.193934+0000","last_clean":"2024-05-15T14:49:27.193934+0000","last_became_active":"2024-05-15T14:28:37.942198+0000","last_became_peered":"2024-05-15T14:28:37.942198+0000","last_unstale":"2024-05-15T14:49:27.193934+0000","last_undegraded":"2024-05-15T14:49:27.193934+0000","last_fullsized":"2024-05-15T14:49:27.193934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:27.193768+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:27.193768+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.193768+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:50.573637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"39'16","reported_seq":109,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.110507+0000","last_change":"2024-05-15T14:49:20.110542+0000","last_active":"2024-05-15T14:49:20.110507+0000","last_peered":"2024-05-15T14:49:20.110507+0000","last_clean":"2024-05-15T14:49:20.110507+0000","last_became_active":"2024-05-15T14:27:52.840941+0000","last_became_peered":"2024-05-15T14:27:52.840941+0000","last_unstale":"2024-05-15T14:49:20.110507+0000","last_undegraded":"2024-05-15T14:49:20.110507+0000","last_fullsized":"2024-05-15T14:49:20.110507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.110386+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.110386+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.110386+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:46.960664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"39'16","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.405845+0000","last_change":"2024-05-15T14:49:38.405874+0000","last_active":"2024-05-15T14:49:38.405845+0000","last_peered":"2024-05-15T14:49:38.405845+0000","last_clean":"2024-05-15T14:49:38.405845+0000","last_became_active":"2024-05-15T14:27:50.847998+0000","last_became_peered":"2024-05-15T14:27:50.847998+0000","last_unstale":"2024-05-15T14:49:38.405845+0000","last_undegraded":"2024-05-15T14:49:38.405845+0000","last_fullsized":"2024-05-15T14:49:38.405845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:38.405722+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:38.405722+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.405722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:52:51.105690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"39'8","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.150410+0000","last_change":"2024-05-15T14:49:20.150486+0000","last_active":"2024-05-15T14:49:20.150410+0000","last_peered":"2024-05-15T14:49:20.150410+0000","last_clean":"2024-05-15T14:49:20.150410+0000","last_became_active":"2024-05-15T14:27:52.852947+0000","last_became_peered":"2024-05-15T14:27:52.852947+0000","last_unstale":"2024-05-15T14:49:20.150410+0000","last_undegraded":"2024-05-15T14:49:20.150410+0000","last_fullsized":"2024-05-15T14:49:20.150410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:20.150300+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:20.150300+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.150300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:02.975219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"39'14","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.077621+0000","last_change":"2024-05-15T14:49:23.077621+0000","last_active":"2024-05-15T14:49:23.077621+0000","last_peered":"2024-05-15T14:49:23.077621+0000","last_clean":"2024-05-15T14:49:23.077621+0000","last_became_active":"2024-05-15T14:27:50.855927+0000","last_became_peered":"2024-05-15T14:27:50.855927+0000","last_unstale":"2024-05-15T14:49:23.077621+0000","last_undegraded":"2024-05-15T14:49:23.077621+0000","last_fullsized":"2024-05-15T14:49:23.077621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:23.077496+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:23.077496+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.077496+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:51.770946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24,"num_write":62,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"39'24","reported_seq":119,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.304690+0000","last_change":"2024-05-15T14:49:09.304727+0000","last_active":"2024-05-15T14:49:09.304690+0000","last_peered":"2024-05-15T14:49:09.304690+0000","last_clean":"2024-05-15T14:49:09.304690+0000","last_became_active":"2024-05-15T14:27:52.853857+0000","last_became_peered":"2024-05-15T14:27:52.853857+0000","last_unstale":"2024-05-15T14:49:09.304690+0000","last_undegraded":"2024-05-15T14:49:09.304690+0000","last_fullsized":"2024-05-15T14:49:09.304690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:09.304568+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:09.304568+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.304568+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:50.837317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":91,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"39'18","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.477199+0000","last_change":"2024-05-15T14:49:34.477253+0000","last_active":"2024-05-15T14:49:34.477199+0000","last_peered":"2024-05-15T14:49:34.477199+0000","last_clean":"2024-05-15T14:49:34.477199+0000","last_became_active":"2024-05-15T14:27:50.843874+0000","last_became_peered":"2024-05-15T14:27:50.843874+0000","last_unstale":"2024-05-15T14:49:34.477199+0000","last_undegraded":"2024-05-15T14:49:34.477199+0000","last_fullsized":"2024-05-15T14:49:34.477199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:34.477097+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:34.477097+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.477097+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:36:31.039320+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"39'58","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.314239+0000","last_change":"2024-05-15T14:49:09.314267+0000","last_active":"2024-05-15T14:49:09.314239+0000","last_peered":"2024-05-15T14:49:09.314239+0000","last_clean":"2024-05-15T14:49:09.314239+0000","last_became_active":"2024-05-15T14:27:52.847362+0000","last_became_peered":"2024-05-15T14:27:52.847362+0000","last_unstale":"2024-05-15T14:49:09.314239+0000","last_undegraded":"2024-05-15T14:49:09.314239+0000","last_fullsized":"2024-05-15T14:49:09.314239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'58","last_scrub_stamp":"2024-05-15T14:49:09.314142+0000","last_deep_scrub":"39'58","last_deep_scrub_stamp":"2024-05-15T14:49:09.314142+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.314142+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:37:44.576275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":172,"num_write":84,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"39'12","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.963884+0000","last_change":"2024-05-15T14:49:34.963913+0000","last_active":"2024-05-15T14:49:34.963884+0000","last_peered":"2024-05-15T14:49:34.963884+0000","last_clean":"2024-05-15T14:49:34.963884+0000","last_became_active":"2024-05-15T14:27:50.846291+0000","last_became_peered":"2024-05-15T14:27:50.846291+0000","last_unstale":"2024-05-15T14:49:34.963884+0000","last_undegraded":"2024-05-15T14:49:34.963884+0000","last_fullsized":"2024-05-15T14:49:34.963884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:34.963790+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:34.963790+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.963790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:02:03.080939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":14702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"39'74","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.277346+0000","last_change":"2024-05-15T14:49:23.277375+0000","last_active":"2024-05-15T14:49:23.277346+0000","last_peered":"2024-05-15T14:49:23.277346+0000","last_clean":"2024-05-15T14:49:23.277346+0000","last_became_active":"2024-05-15T14:27:52.848173+0000","last_became_peered":"2024-05-15T14:27:52.848173+0000","last_unstale":"2024-05-15T14:49:23.277346+0000","last_undegraded":"2024-05-15T14:49:23.277346+0000","last_fullsized":"2024-05-15T14:49:23.277346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2024-05-15T14:49:23.277252+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2024-05-15T14:49:23.277252+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.277252+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:34.025306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":248,"num_write":102,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.282473+0000","last_change":"2024-05-15T14:49:30.282500+0000","last_active":"2024-05-15T14:49:30.282473+0000","last_peered":"2024-05-15T14:49:30.282473+0000","last_clean":"2024-05-15T14:49:30.282473+0000","last_became_active":"2024-05-15T14:27:50.846782+0000","last_became_peered":"2024-05-15T14:27:50.846782+0000","last_unstale":"2024-05-15T14:49:30.282473+0000","last_undegraded":"2024-05-15T14:49:30.282473+0000","last_fullsized":"2024-05-15T14:49:30.282473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:30.282376+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:30.282376+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.282376+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:36.078865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"39'30","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.850454+0000","last_change":"2024-05-15T14:49:13.850479+0000","last_active":"2024-05-15T14:49:13.850454+0000","last_peered":"2024-05-15T14:49:13.850454+0000","last_clean":"2024-05-15T14:49:13.850454+0000","last_became_active":"2024-05-15T14:27:52.851642+0000","last_became_peered":"2024-05-15T14:27:52.851642+0000","last_unstale":"2024-05-15T14:49:13.850454+0000","last_undegraded":"2024-05-15T14:49:13.850454+0000","last_fullsized":"2024-05-15T14:49:13.850454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2024-05-15T14:49:13.850366+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2024-05-15T14:49:13.850366+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.850366+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:06.992558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":127,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"39'26","reported_seq":120,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.078023+0000","last_change":"2024-05-15T14:49:15.078070+0000","last_active":"2024-05-15T14:49:15.078023+0000","last_peered":"2024-05-15T14:49:15.078023+0000","last_clean":"2024-05-15T14:49:15.078023+0000","last_became_active":"2024-05-15T14:27:50.840467+0000","last_became_peered":"2024-05-15T14:27:50.840467+0000","last_unstale":"2024-05-15T14:49:15.078023+0000","last_undegraded":"2024-05-15T14:49:15.078023+0000","last_fullsized":"2024-05-15T14:49:15.078023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.077923+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.077923+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.077923+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:14.720369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"39'92","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.171104+0000","last_change":"2024-05-15T14:49:19.171130+0000","last_active":"2024-05-15T14:49:19.171104+0000","last_peered":"2024-05-15T14:49:19.171104+0000","last_clean":"2024-05-15T14:49:19.171104+0000","last_became_active":"2024-05-15T14:27:52.859926+0000","last_became_peered":"2024-05-15T14:27:52.859926+0000","last_unstale":"2024-05-15T14:49:19.171104+0000","last_undegraded":"2024-05-15T14:49:19.171104+0000","last_fullsized":"2024-05-15T14:49:19.171104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2024-05-15T14:49:19.171010+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2024-05-15T14:49:19.171010+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.171010+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:55.591396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":270,"num_write":132,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"39'24","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.583649+0000","last_change":"2024-05-15T14:49:34.583673+0000","last_active":"2024-05-15T14:49:34.583649+0000","last_peered":"2024-05-15T14:49:34.583649+0000","last_clean":"2024-05-15T14:49:34.583649+0000","last_became_active":"2024-05-15T14:27:50.849936+0000","last_became_peered":"2024-05-15T14:27:50.849936+0000","last_unstale":"2024-05-15T14:49:34.583649+0000","last_undegraded":"2024-05-15T14:49:34.583649+0000","last_fullsized":"2024-05-15T14:49:34.583649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:34.583559+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:34.583559+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.583559+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:10:42.889967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":112,"num_write_kb":36442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"39'62","reported_seq":171,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.630250+0000","last_change":"2024-05-15T14:49:19.630277+0000","last_active":"2024-05-15T14:49:19.630250+0000","last_peered":"2024-05-15T14:49:19.630250+0000","last_clean":"2024-05-15T14:49:19.630250+0000","last_became_active":"2024-05-15T14:27:52.856767+0000","last_became_peered":"2024-05-15T14:27:52.856767+0000","last_unstale":"2024-05-15T14:49:19.630250+0000","last_undegraded":"2024-05-15T14:49:19.630250+0000","last_fullsized":"2024-05-15T14:49:19.630250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'62","last_scrub_stamp":"2024-05-15T14:49:19.630152+0000","last_deep_scrub":"39'62","last_deep_scrub_stamp":"2024-05-15T14:49:19.630152+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.630152+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:26:20.896798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":205,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"39'18","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.338853+0000","last_change":"2024-05-15T14:49:07.338895+0000","last_active":"2024-05-15T14:49:07.338853+0000","last_peered":"2024-05-15T14:49:07.338853+0000","last_clean":"2024-05-15T14:49:07.338853+0000","last_became_active":"2024-05-15T14:27:50.842512+0000","last_became_peered":"2024-05-15T14:27:50.842512+0000","last_unstale":"2024-05-15T14:49:07.338853+0000","last_undegraded":"2024-05-15T14:49:07.338853+0000","last_fullsized":"2024-05-15T14:49:07.338853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:07.338747+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:07.338747+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.338747+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:29.168239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"39'56","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.881484+0000","last_change":"2024-05-15T14:49:12.881484+0000","last_active":"2024-05-15T14:49:12.881484+0000","last_peered":"2024-05-15T14:49:12.881484+0000","last_clean":"2024-05-15T14:49:12.881484+0000","last_became_active":"2024-05-15T14:27:52.854841+0000","last_became_peered":"2024-05-15T14:27:52.854841+0000","last_unstale":"2024-05-15T14:49:12.881484+0000","last_undegraded":"2024-05-15T14:49:12.881484+0000","last_fullsized":"2024-05-15T14:49:12.881484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'56","last_scrub_stamp":"2024-05-15T14:49:12.881296+0000","last_deep_scrub":"39'56","last_deep_scrub_stamp":"2024-05-15T14:49:12.881296+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.881296+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:54:16.688582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":78,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"39'20","reported_seq":109,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.025657+0000","last_change":"2024-05-15T14:49:29.025682+0000","last_active":"2024-05-15T14:49:29.025657+0000","last_peered":"2024-05-15T14:49:29.025657+0000","last_clean":"2024-05-15T14:49:29.025657+0000","last_became_active":"2024-05-15T14:27:50.848291+0000","last_became_peered":"2024-05-15T14:27:50.848291+0000","last_unstale":"2024-05-15T14:49:29.025657+0000","last_undegraded":"2024-05-15T14:49:29.025657+0000","last_fullsized":"2024-05-15T14:49:29.025657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:29.025562+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:29.025562+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.025562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:19.151530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":40,"num_write":100,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"39'18","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.007543+0000","last_change":"2024-05-15T14:49:34.007605+0000","last_active":"2024-05-15T14:49:34.007543+0000","last_peered":"2024-05-15T14:49:34.007543+0000","last_clean":"2024-05-15T14:49:34.007543+0000","last_became_active":"2024-05-15T14:27:50.842420+0000","last_became_peered":"2024-05-15T14:27:50.842420+0000","last_unstale":"2024-05-15T14:49:34.007543+0000","last_undegraded":"2024-05-15T14:49:34.007543+0000","last_fullsized":"2024-05-15T14:49:34.007543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:34.007442+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:34.007442+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.007442+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:58:51.376517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":90,"num_write_kb":20587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'14","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.204045+0000","last_change":"2024-05-15T14:49:18.204045+0000","last_active":"2024-05-15T14:49:18.204045+0000","last_peered":"2024-05-15T14:49:18.204045+0000","last_clean":"2024-05-15T14:49:18.204045+0000","last_became_active":"2024-05-15T14:27:52.853329+0000","last_became_peered":"2024-05-15T14:27:52.853329+0000","last_unstale":"2024-05-15T14:49:18.204045+0000","last_undegraded":"2024-05-15T14:49:18.204045+0000","last_fullsized":"2024-05-15T14:49:18.204045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:18.203851+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:18.203851+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.203851+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:29:03.913933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.971863+0000","last_change":"2024-05-15T14:49:20.971893+0000","last_active":"2024-05-15T14:49:20.971863+0000","last_peered":"2024-05-15T14:49:20.971863+0000","last_clean":"2024-05-15T14:49:20.971863+0000","last_became_active":"2024-05-15T14:27:50.839496+0000","last_became_peered":"2024-05-15T14:27:50.839496+0000","last_unstale":"2024-05-15T14:49:20.971863+0000","last_undegraded":"2024-05-15T14:49:20.971863+0000","last_fullsized":"2024-05-15T14:49:20.971863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.971755+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.971755+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.971755+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:44.351624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":17647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"39'70","reported_seq":195,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.109324+0000","last_change":"2024-05-15T14:49:18.109324+0000","last_active":"2024-05-15T14:49:18.109324+0000","last_peered":"2024-05-15T14:49:18.109324+0000","last_clean":"2024-05-15T14:49:18.109324+0000","last_became_active":"2024-05-15T14:27:52.851973+0000","last_became_peered":"2024-05-15T14:27:52.851973+0000","last_unstale":"2024-05-15T14:49:18.109324+0000","last_undegraded":"2024-05-15T14:49:18.109324+0000","last_fullsized":"2024-05-15T14:49:18.109324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'70","last_scrub_stamp":"2024-05-15T14:49:18.109179+0000","last_deep_scrub":"39'70","last_deep_scrub_stamp":"2024-05-15T14:49:18.109179+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.109179+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:59.326269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":234,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3423,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1381,"num_read_kb":1449,"num_write":1045,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":6846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11724,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":2162820,"num_read_kb":7062227,"num_write":12291,"num_write_kb":15784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30692,"num_omap_keys":82,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1949,"ondisk_log_size":1949,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":14929,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5671,"num_read_kb":6915,"num_write":192,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":29858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9598,"num_read_kb":7988,"num_write":3212,"num_write_kb":1308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2246,"ondisk_log_size":2246,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2611,"num_read_kb":1724,"num_write":4445,"num_write_kb":1235021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575114,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40588,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331252,"statfs":{"total":96636764160,"available":96595202048,"internally_reserved":0,"allocated":1118208,"data_stored":815108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575115,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":487424,"data_stored":221551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575114,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":536576,"data_stored":225223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575115,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":227462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575115,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45584,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326256,"statfs":{"total":96636764160,"available":96590086144,"internally_reserved":0,"allocated":532480,"data_stored":222205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575115,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":491520,"data_stored":224011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575115,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":222247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575116,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1118208,"data_stored":816897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":68,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:49:44.555 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.556 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.556 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.557 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.557 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.557 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.558 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.558 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.558 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.559 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.559 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.559 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.560 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.560 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.560 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.560 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.561 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2024-05-15T14:31:15.566465+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=31, tm_sec=15, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=14, tm_min=48, tm_sec=58, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T14:49:44.562 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T14:50:04.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T14:50:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-05-15T14:50:04.916 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-05-15T14:50:04.919 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":703,"stamp":"2024-05-15T14:50:04.792768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620444,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":2182158,"num_read_kb":7080366,"num_write":21294,"num_write_kb":1254163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30692,"num_omap_keys":82,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6401,"ondisk_log_size":6401,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285128,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":279859,"kb_avail":754689592,"statfs":{"total":773094113280,"available":772802142208,"internally_reserved":0,"allocated":5316608,"data_stored":2974704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":286576177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004306"},"pg_stats":[{"pgid":"3.3f","version":"39'26","reported_seq":120,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:35.537286+0000","last_change":"2024-05-15T14:49:35.537327+0000","last_active":"2024-05-15T14:49:35.537286+0000","last_peered":"2024-05-15T14:49:35.537286+0000","last_clean":"2024-05-15T14:49:35.537286+0000","last_became_active":"2024-05-15T14:27:50.849951+0000","last_became_peered":"2024-05-15T14:27:50.849951+0000","last_unstale":"2024-05-15T14:49:35.537286+0000","last_undegraded":"2024-05-15T14:49:35.537286+0000","last_fullsized":"2024-05-15T14:49:35.537286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:35.537148+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:35.537148+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.537148+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:12:27.131142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'2","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.065623+0000","last_change":"2024-05-15T14:49:16.065651+0000","last_active":"2024-05-15T14:49:16.065623+0000","last_peered":"2024-05-15T14:49:16.065623+0000","last_clean":"2024-05-15T14:49:16.065623+0000","last_became_active":"2024-05-15T14:27:52.843836+0000","last_became_peered":"2024-05-15T14:27:52.843836+0000","last_unstale":"2024-05-15T14:49:16.065623+0000","last_undegraded":"2024-05-15T14:49:16.065623+0000","last_fullsized":"2024-05-15T14:49:16.065623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:16.065521+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:16.065521+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.065521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:34:56.257057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"39'10","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.005891+0000","last_change":"2024-05-15T14:49:20.005922+0000","last_active":"2024-05-15T14:49:20.005891+0000","last_peered":"2024-05-15T14:49:20.005891+0000","last_clean":"2024-05-15T14:49:20.005891+0000","last_became_active":"2024-05-15T14:27:50.837321+0000","last_became_peered":"2024-05-15T14:27:50.837321+0000","last_unstale":"2024-05-15T14:49:20.005891+0000","last_undegraded":"2024-05-15T14:49:20.005891+0000","last_fullsized":"2024-05-15T14:49:20.005891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:20.005776+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:20.005776+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.005776+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:43.743219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":50,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"39'10","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.835870+0000","last_change":"2024-05-15T14:49:15.835898+0000","last_active":"2024-05-15T14:49:15.835870+0000","last_peered":"2024-05-15T14:49:15.835870+0000","last_clean":"2024-05-15T14:49:15.835870+0000","last_became_active":"2024-05-15T14:27:52.840977+0000","last_became_peered":"2024-05-15T14:27:52.840977+0000","last_unstale":"2024-05-15T14:49:15.835870+0000","last_undegraded":"2024-05-15T14:49:15.835870+0000","last_fullsized":"2024-05-15T14:49:15.835870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:15.835781+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:15.835781+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.835781+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:02:18.086441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"39'8","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.349003+0000","last_change":"2024-05-15T14:49:37.349033+0000","last_active":"2024-05-15T14:49:37.349003+0000","last_peered":"2024-05-15T14:49:37.349003+0000","last_clean":"2024-05-15T14:49:37.349003+0000","last_became_active":"2024-05-15T14:27:50.844989+0000","last_became_peered":"2024-05-15T14:27:50.844989+0000","last_unstale":"2024-05-15T14:49:37.349003+0000","last_undegraded":"2024-05-15T14:49:37.349003+0000","last_fullsized":"2024-05-15T14:49:37.349003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:37.348904+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:37.348904+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.348904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:06.760470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'24","reported_seq":133,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.243441+0000","last_change":"2024-05-15T14:49:17.243471+0000","last_active":"2024-05-15T14:49:17.243441+0000","last_peered":"2024-05-15T14:49:17.243441+0000","last_clean":"2024-05-15T14:49:17.243441+0000","last_became_active":"2024-05-15T14:27:52.850449+0000","last_became_peered":"2024-05-15T14:27:52.850449+0000","last_unstale":"2024-05-15T14:49:17.243441+0000","last_undegraded":"2024-05-15T14:49:17.243441+0000","last_fullsized":"2024-05-15T14:49:17.243441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:17.243328+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:17.243328+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.243328+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:31.226320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":101,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"39'22","reported_seq":113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.042820+0000","last_change":"2024-05-15T14:49:25.042820+0000","last_active":"2024-05-15T14:49:25.042820+0000","last_peered":"2024-05-15T14:49:25.042820+0000","last_clean":"2024-05-15T14:49:25.042820+0000","last_became_active":"2024-05-15T14:27:50.851846+0000","last_became_peered":"2024-05-15T14:27:50.851846+0000","last_unstale":"2024-05-15T14:49:25.042820+0000","last_undegraded":"2024-05-15T14:49:25.042820+0000","last_fullsized":"2024-05-15T14:49:25.042820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:25.042676+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:25.042676+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.042676+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:34.406768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":27630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"39'4","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.149849+0000","last_change":"2024-05-15T14:49:16.149877+0000","last_active":"2024-05-15T14:49:16.149849+0000","last_peered":"2024-05-15T14:49:16.149849+0000","last_clean":"2024-05-15T14:49:16.149849+0000","last_became_active":"2024-05-15T14:27:52.854481+0000","last_became_peered":"2024-05-15T14:27:52.854481+0000","last_unstale":"2024-05-15T14:49:16.149849+0000","last_undegraded":"2024-05-15T14:49:16.149849+0000","last_fullsized":"2024-05-15T14:49:16.149849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:16.149743+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:16.149743+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.149743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:32.252193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"39'8","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.737453+0000","last_change":"2024-05-15T14:49:19.737479+0000","last_active":"2024-05-15T14:49:19.737453+0000","last_peered":"2024-05-15T14:49:19.737453+0000","last_clean":"2024-05-15T14:49:19.737453+0000","last_became_active":"2024-05-15T14:27:50.851756+0000","last_became_peered":"2024-05-15T14:27:50.851756+0000","last_unstale":"2024-05-15T14:49:19.737453+0000","last_undegraded":"2024-05-15T14:49:19.737453+0000","last_fullsized":"2024-05-15T14:49:19.737453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:19.737363+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:19.737363+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.737363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:00.148124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14,"num_write":40,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"39'8","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.144299+0000","last_change":"2024-05-15T14:49:12.144299+0000","last_active":"2024-05-15T14:49:12.144299+0000","last_peered":"2024-05-15T14:49:12.144299+0000","last_clean":"2024-05-15T14:49:12.144299+0000","last_became_active":"2024-05-15T14:27:52.844904+0000","last_became_peered":"2024-05-15T14:27:52.844904+0000","last_unstale":"2024-05-15T14:49:12.144299+0000","last_undegraded":"2024-05-15T14:49:12.144299+0000","last_fullsized":"2024-05-15T14:49:12.144299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:12.144177+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:12.144177+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.144177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:07.442839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"39'8","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.050513+0000","last_change":"2024-05-15T14:49:37.050535+0000","last_active":"2024-05-15T14:49:37.050513+0000","last_peered":"2024-05-15T14:49:37.050513+0000","last_clean":"2024-05-15T14:49:37.050513+0000","last_became_active":"2024-05-15T14:27:50.847121+0000","last_became_peered":"2024-05-15T14:27:50.847121+0000","last_unstale":"2024-05-15T14:49:37.050513+0000","last_undegraded":"2024-05-15T14:49:37.050513+0000","last_fullsized":"2024-05-15T14:49:37.050513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:37.050420+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:37.050420+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.050420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:07:57.844151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":24,"num_write_kb":14074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'100","reported_seq":217,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.162647+0000","last_change":"2024-05-15T14:49:19.162673+0000","last_active":"2024-05-15T14:49:19.162647+0000","last_peered":"2024-05-15T14:49:19.162647+0000","last_clean":"2024-05-15T14:49:19.162647+0000","last_became_active":"2024-05-15T14:27:52.848482+0000","last_became_peered":"2024-05-15T14:27:52.848482+0000","last_unstale":"2024-05-15T14:49:19.162647+0000","last_undegraded":"2024-05-15T14:49:19.162647+0000","last_fullsized":"2024-05-15T14:49:19.162647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'100","last_scrub_stamp":"2024-05-15T14:49:19.162557+0000","last_deep_scrub":"39'100","last_deep_scrub_stamp":"2024-05-15T14:49:19.162557+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.162557+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:42.092463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":302,"num_write":142,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"39'10","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.668563+0000","last_change":"2024-05-15T14:49:23.668590+0000","last_active":"2024-05-15T14:49:23.668563+0000","last_peered":"2024-05-15T14:49:23.668563+0000","last_clean":"2024-05-15T14:49:23.668563+0000","last_became_active":"2024-05-15T14:27:50.852659+0000","last_became_peered":"2024-05-15T14:27:50.852659+0000","last_unstale":"2024-05-15T14:49:23.668563+0000","last_undegraded":"2024-05-15T14:49:23.668563+0000","last_fullsized":"2024-05-15T14:49:23.668563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:23.668477+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:23.668477+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.668477+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:47.900230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"39'10","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.057201+0000","last_change":"2024-05-15T14:49:21.057226+0000","last_active":"2024-05-15T14:49:21.057201+0000","last_peered":"2024-05-15T14:49:21.057201+0000","last_clean":"2024-05-15T14:49:21.057201+0000","last_became_active":"2024-05-15T14:27:52.839017+0000","last_became_peered":"2024-05-15T14:27:52.839017+0000","last_unstale":"2024-05-15T14:49:21.057201+0000","last_undegraded":"2024-05-15T14:49:21.057201+0000","last_fullsized":"2024-05-15T14:49:21.057201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:21.057108+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:21.057108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.057108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:45.288861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"39'14","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.585517+0000","last_change":"2024-05-15T14:49:29.585549+0000","last_active":"2024-05-15T14:49:29.585517+0000","last_peered":"2024-05-15T14:49:29.585517+0000","last_clean":"2024-05-15T14:49:29.585517+0000","last_became_active":"2024-05-15T14:27:50.854408+0000","last_became_peered":"2024-05-15T14:27:50.854408+0000","last_unstale":"2024-05-15T14:49:29.585517+0000","last_undegraded":"2024-05-15T14:49:29.585517+0000","last_fullsized":"2024-05-15T14:49:29.585517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:29.585423+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:29.585423+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.585423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:34:35.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25,"num_write":70,"num_write_kb":17643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"39'10","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.314704+0000","last_change":"2024-05-15T14:49:11.314730+0000","last_active":"2024-05-15T14:49:11.314704+0000","last_peered":"2024-05-15T14:49:11.314704+0000","last_clean":"2024-05-15T14:49:11.314704+0000","last_became_active":"2024-05-15T14:27:52.853688+0000","last_became_peered":"2024-05-15T14:27:52.853688+0000","last_unstale":"2024-05-15T14:49:11.314704+0000","last_undegraded":"2024-05-15T14:49:11.314704+0000","last_fullsized":"2024-05-15T14:49:11.314704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:11.314615+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:11.314615+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.314615+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:22:41.936884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"39'4","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.263543+0000","last_change":"2024-05-15T14:49:15.263569+0000","last_active":"2024-05-15T14:49:15.263543+0000","last_peered":"2024-05-15T14:49:15.263543+0000","last_clean":"2024-05-15T14:49:15.263543+0000","last_became_active":"2024-05-15T14:27:52.850532+0000","last_became_peered":"2024-05-15T14:27:52.850532+0000","last_unstale":"2024-05-15T14:49:15.263543+0000","last_undegraded":"2024-05-15T14:49:15.263543+0000","last_fullsized":"2024-05-15T14:49:15.263543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:15.263455+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:15.263455+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.263455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:13:18.960113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.605493+0000","last_change":"2024-05-15T14:49:25.605493+0000","last_active":"2024-05-15T14:49:25.605493+0000","last_peered":"2024-05-15T14:49:25.605493+0000","last_clean":"2024-05-15T14:49:25.605493+0000","last_became_active":"2024-05-15T14:27:50.852229+0000","last_became_peered":"2024-05-15T14:27:50.852229+0000","last_unstale":"2024-05-15T14:49:25.605493+0000","last_undegraded":"2024-05-15T14:49:25.605493+0000","last_fullsized":"2024-05-15T14:49:25.605493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:25.605325+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:25.605325+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.605325+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:54.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"39'34","reported_seq":138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.885289+0000","last_change":"2024-05-15T14:49:14.885338+0000","last_active":"2024-05-15T14:49:14.885289+0000","last_peered":"2024-05-15T14:49:14.885289+0000","last_clean":"2024-05-15T14:49:14.885289+0000","last_became_active":"2024-05-15T14:27:52.858331+0000","last_became_peered":"2024-05-15T14:27:52.858331+0000","last_unstale":"2024-05-15T14:49:14.885289+0000","last_undegraded":"2024-05-15T14:49:14.885289+0000","last_fullsized":"2024-05-15T14:49:14.885289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'34","last_scrub_stamp":"2024-05-15T14:49:14.885193+0000","last_deep_scrub":"39'34","last_deep_scrub_stamp":"2024-05-15T14:49:14.885193+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.885193+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:35.445212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":123,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"39'16","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.136706+0000","last_change":"2024-05-15T14:49:18.136706+0000","last_active":"2024-05-15T14:49:18.136706+0000","last_peered":"2024-05-15T14:49:18.136706+0000","last_clean":"2024-05-15T14:49:18.136706+0000","last_became_active":"2024-05-15T14:27:50.849526+0000","last_became_peered":"2024-05-15T14:27:50.849526+0000","last_unstale":"2024-05-15T14:49:18.136706+0000","last_undegraded":"2024-05-15T14:49:18.136706+0000","last_fullsized":"2024-05-15T14:49:18.136706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:18.136598+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:18.136598+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.136598+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:44.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"39'6","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.096856+0000","last_change":"2024-05-15T14:49:19.096881+0000","last_active":"2024-05-15T14:49:19.096856+0000","last_peered":"2024-05-15T14:49:19.096856+0000","last_clean":"2024-05-15T14:49:19.096856+0000","last_became_active":"2024-05-15T14:27:52.838137+0000","last_became_peered":"2024-05-15T14:27:52.838137+0000","last_unstale":"2024-05-15T14:49:19.096856+0000","last_undegraded":"2024-05-15T14:49:19.096856+0000","last_fullsized":"2024-05-15T14:49:19.096856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:19.096756+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:19.096756+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.096756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:17.238088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"39'14","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.099231+0000","last_change":"2024-05-15T14:49:17.099231+0000","last_active":"2024-05-15T14:49:17.099231+0000","last_peered":"2024-05-15T14:49:17.099231+0000","last_clean":"2024-05-15T14:49:17.099231+0000","last_became_active":"2024-05-15T14:27:50.842240+0000","last_became_peered":"2024-05-15T14:27:50.842240+0000","last_unstale":"2024-05-15T14:49:17.099231+0000","last_undegraded":"2024-05-15T14:49:17.099231+0000","last_fullsized":"2024-05-15T14:49:17.099231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:17.099108+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:17.099108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.099108+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:37.045139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":70,"num_write_kb":11769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"39'44","reported_seq":123,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.344978+0000","last_change":"2024-05-15T14:49:12.344978+0000","last_active":"2024-05-15T14:49:12.344978+0000","last_peered":"2024-05-15T14:49:12.344978+0000","last_clean":"2024-05-15T14:49:12.344978+0000","last_became_active":"2024-05-15T14:27:52.854742+0000","last_became_peered":"2024-05-15T14:27:52.854742+0000","last_unstale":"2024-05-15T14:49:12.344978+0000","last_undegraded":"2024-05-15T14:49:12.344978+0000","last_fullsized":"2024-05-15T14:49:12.344978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'44","last_scrub_stamp":"2024-05-15T14:49:12.344854+0000","last_deep_scrub":"39'44","last_deep_scrub_stamp":"2024-05-15T14:49:12.344854+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.344854+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:15.742018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":128,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.266743+0000","last_change":"2024-05-15T14:49:26.266743+0000","last_active":"2024-05-15T14:49:26.266743+0000","last_peered":"2024-05-15T14:49:26.266743+0000","last_clean":"2024-05-15T14:49:26.266743+0000","last_became_active":"2024-05-15T14:27:50.840405+0000","last_became_peered":"2024-05-15T14:27:50.840405+0000","last_unstale":"2024-05-15T14:49:26.266743+0000","last_undegraded":"2024-05-15T14:49:26.266743+0000","last_fullsized":"2024-05-15T14:49:26.266743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:26.266609+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:26.266609+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.266609+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:09.091528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'52","reported_seq":159,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.335892+0000","last_change":"2024-05-15T14:49:10.335892+0000","last_active":"2024-05-15T14:49:10.335892+0000","last_peered":"2024-05-15T14:49:10.335892+0000","last_clean":"2024-05-15T14:49:10.335892+0000","last_became_active":"2024-05-15T14:27:52.850696+0000","last_became_peered":"2024-05-15T14:27:52.850696+0000","last_unstale":"2024-05-15T14:49:10.335892+0000","last_undegraded":"2024-05-15T14:49:10.335892+0000","last_fullsized":"2024-05-15T14:49:10.335892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'52","last_scrub_stamp":"2024-05-15T14:49:10.335711+0000","last_deep_scrub":"39'52","last_deep_scrub_stamp":"2024-05-15T14:49:10.335711+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.335711+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:40:00.831370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":171,"num_write":72,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.453551+0000","last_change":"2024-05-15T14:49:39.453577+0000","last_active":"2024-05-15T14:49:39.453551+0000","last_peered":"2024-05-15T14:49:39.453551+0000","last_clean":"2024-05-15T14:49:39.453551+0000","last_became_active":"2024-05-15T14:27:50.848542+0000","last_became_peered":"2024-05-15T14:27:50.848542+0000","last_unstale":"2024-05-15T14:49:39.453551+0000","last_undegraded":"2024-05-15T14:49:39.453551+0000","last_fullsized":"2024-05-15T14:49:39.453551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:39.453468+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:39.453468+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.453468+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:11:42.493290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":70,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"39'28","reported_seq":126,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.311088+0000","last_change":"2024-05-15T14:49:12.311088+0000","last_active":"2024-05-15T14:49:12.311088+0000","last_peered":"2024-05-15T14:49:12.311088+0000","last_clean":"2024-05-15T14:49:12.311088+0000","last_became_active":"2024-05-15T14:27:52.861166+0000","last_became_peered":"2024-05-15T14:27:52.861166+0000","last_unstale":"2024-05-15T14:49:12.311088+0000","last_undegraded":"2024-05-15T14:49:12.311088+0000","last_fullsized":"2024-05-15T14:49:12.311088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'28","last_scrub_stamp":"2024-05-15T14:49:12.310979+0000","last_deep_scrub":"39'28","last_deep_scrub_stamp":"2024-05-15T14:49:12.310979+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.310979+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:05.453171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":102,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"39'14","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.252708+0000","last_change":"2024-05-15T14:49:33.252763+0000","last_active":"2024-05-15T14:49:33.252708+0000","last_peered":"2024-05-15T14:49:33.252708+0000","last_clean":"2024-05-15T14:49:33.252708+0000","last_became_active":"2024-05-15T14:27:50.837594+0000","last_became_peered":"2024-05-15T14:27:50.837594+0000","last_unstale":"2024-05-15T14:49:33.252708+0000","last_undegraded":"2024-05-15T14:49:33.252708+0000","last_fullsized":"2024-05-15T14:49:33.252708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:33.252596+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:33.252596+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.252596+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:37:23.717173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:44.367065+0000","last_change":"2024-05-15T14:49:44.367085+0000","last_active":"2024-05-15T14:49:44.367065+0000","last_peered":"2024-05-15T14:49:44.367065+0000","last_clean":"2024-05-15T14:49:44.367065+0000","last_became_active":"2024-05-15T14:31:16.589649+0000","last_became_peered":"2024-05-15T14:31:16.589649+0000","last_unstale":"2024-05-15T14:49:44.367065+0000","last_undegraded":"2024-05-15T14:49:44.367065+0000","last_fullsized":"2024-05-15T14:49:44.367065+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:44.366983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:44.366983+0000","last_clean_scrub_stamp":"2024-05-15T14:49:44.366983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:23:31.133097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"39'27","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.261871+0000","last_change":"2024-05-15T14:49:37.261871+0000","last_active":"2024-05-15T14:49:37.261871+0000","last_peered":"2024-05-15T14:49:37.261871+0000","last_clean":"2024-05-15T14:49:37.261871+0000","last_became_active":"2024-05-15T14:28:02.891340+0000","last_became_peered":"2024-05-15T14:28:02.891340+0000","last_unstale":"2024-05-15T14:49:37.261871+0000","last_undegraded":"2024-05-15T14:49:37.261871+0000","last_fullsized":"2024-05-15T14:49:37.261871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'27","last_scrub_stamp":"2024-05-15T14:49:37.261754+0000","last_deep_scrub":"39'27","last_deep_scrub_stamp":"2024-05-15T14:49:37.261754+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.261754+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:02:05.378903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":38,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"39'78","reported_seq":176,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.712014+0000","last_change":"2024-05-15T14:49:24.712050+0000","last_active":"2024-05-15T14:49:24.712014+0000","last_peered":"2024-05-15T14:49:24.712014+0000","last_clean":"2024-05-15T14:49:24.712014+0000","last_became_active":"2024-05-15T14:27:52.862960+0000","last_became_peered":"2024-05-15T14:27:52.862960+0000","last_unstale":"2024-05-15T14:49:24.712014+0000","last_undegraded":"2024-05-15T14:49:24.712014+0000","last_fullsized":"2024-05-15T14:49:24.712014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'78","last_scrub_stamp":"2024-05-15T14:49:24.711902+0000","last_deep_scrub":"39'78","last_deep_scrub_stamp":"2024-05-15T14:49:24.711902+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.711902+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:37:15.176478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":231,"num_write":112,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"39'4","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.629761+0000","last_change":"2024-05-15T14:49:33.629789+0000","last_active":"2024-05-15T14:49:33.629761+0000","last_peered":"2024-05-15T14:49:33.629761+0000","last_clean":"2024-05-15T14:49:33.629761+0000","last_became_active":"2024-05-15T14:27:50.849039+0000","last_became_peered":"2024-05-15T14:27:50.849039+0000","last_unstale":"2024-05-15T14:49:33.629761+0000","last_undegraded":"2024-05-15T14:49:33.629761+0000","last_fullsized":"2024-05-15T14:49:33.629761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:33.629654+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:33.629654+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.629654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:36.754988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.094982+0000","last_change":"2024-05-15T14:49:22.094982+0000","last_active":"2024-05-15T14:49:22.094982+0000","last_peered":"2024-05-15T14:49:22.094982+0000","last_clean":"2024-05-15T14:49:22.094982+0000","last_became_active":"2024-05-15T14:27:56.876559+0000","last_became_peered":"2024-05-15T14:27:56.876559+0000","last_unstale":"2024-05-15T14:49:22.094982+0000","last_undegraded":"2024-05-15T14:49:22.094982+0000","last_fullsized":"2024-05-15T14:49:22.094982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.094867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.094867+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.094867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:00.671723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"39'273","reported_seq":562,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.163273+0000","last_change":"2024-05-15T14:49:14.163273+0000","last_active":"2024-05-15T14:49:14.163273+0000","last_peered":"2024-05-15T14:49:14.163273+0000","last_clean":"2024-05-15T14:49:14.163273+0000","last_became_active":"2024-05-15T14:27:58.883983+0000","last_became_peered":"2024-05-15T14:27:58.883983+0000","last_unstale":"2024-05-15T14:49:14.163273+0000","last_undegraded":"2024-05-15T14:49:14.163273+0000","last_fullsized":"2024-05-15T14:49:14.163273+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'273","last_scrub_stamp":"2024-05-15T14:49:14.163129+0000","last_deep_scrub":"39'273","last_deep_scrub_stamp":"2024-05-15T14:49:14.163129+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.163129+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:48.003222+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":459,"num_read_kb":564,"num_write":244,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.906703+0000","last_change":"2024-05-15T14:49:07.906703+0000","last_active":"2024-05-15T14:49:07.906703+0000","last_peered":"2024-05-15T14:49:07.906703+0000","last_clean":"2024-05-15T14:49:07.906703+0000","last_became_active":"2024-05-15T14:28:00.887947+0000","last_became_peered":"2024-05-15T14:28:00.887947+0000","last_unstale":"2024-05-15T14:49:07.906703+0000","last_undegraded":"2024-05-15T14:49:07.906703+0000","last_fullsized":"2024-05-15T14:49:07.906703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.906558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.906558+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.906558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:01.335889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.171879+0000","last_change":"2024-05-15T14:49:28.171918+0000","last_active":"2024-05-15T14:49:28.171879+0000","last_peered":"2024-05-15T14:49:28.171879+0000","last_clean":"2024-05-15T14:49:28.171879+0000","last_became_active":"2024-05-15T14:31:16.588437+0000","last_became_peered":"2024-05-15T14:31:16.588437+0000","last_unstale":"2024-05-15T14:49:28.171879+0000","last_undegraded":"2024-05-15T14:49:28.171879+0000","last_fullsized":"2024-05-15T14:49:28.171879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:28.171777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:28.171777+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.171777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:48.417301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"39'110","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.919691+0000","last_change":"2024-05-15T14:49:04.919691+0000","last_active":"2024-05-15T14:49:04.919691+0000","last_peered":"2024-05-15T14:49:04.919691+0000","last_clean":"2024-05-15T14:49:04.919691+0000","last_became_active":"2024-05-15T14:28:02.890477+0000","last_became_peered":"2024-05-15T14:28:02.890477+0000","last_unstale":"2024-05-15T14:49:04.919691+0000","last_undegraded":"2024-05-15T14:49:04.919691+0000","last_fullsized":"2024-05-15T14:49:04.919691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'110","last_scrub_stamp":"2024-05-15T14:49:04.919526+0000","last_deep_scrub":"39'110","last_deep_scrub_stamp":"2024-05-15T14:49:04.919526+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.919526+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:33.953046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":252,"num_read_kb":241,"num_write":191,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"39'4","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.072115+0000","last_change":"2024-05-15T14:49:17.072115+0000","last_active":"2024-05-15T14:49:17.072115+0000","last_peered":"2024-05-15T14:49:17.072115+0000","last_clean":"2024-05-15T14:49:17.072115+0000","last_became_active":"2024-05-15T14:27:52.840847+0000","last_became_peered":"2024-05-15T14:27:52.840847+0000","last_unstale":"2024-05-15T14:49:17.072115+0000","last_undegraded":"2024-05-15T14:49:17.072115+0000","last_fullsized":"2024-05-15T14:49:17.072115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:17.071956+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:17.071956+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.071956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:47:57.482717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"39'18","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.325766+0000","last_change":"2024-05-15T14:49:38.325800+0000","last_active":"2024-05-15T14:49:38.325766+0000","last_peered":"2024-05-15T14:49:38.325766+0000","last_clean":"2024-05-15T14:49:38.325766+0000","last_became_active":"2024-05-15T14:27:50.845923+0000","last_became_peered":"2024-05-15T14:27:50.845923+0000","last_unstale":"2024-05-15T14:49:38.325766+0000","last_undegraded":"2024-05-15T14:49:38.325766+0000","last_fullsized":"2024-05-15T14:49:38.325766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:38.325661+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:38.325661+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.325661+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:34:44.505941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32,"num_write":82,"num_write_kb":27622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.626618+0000","last_change":"2024-05-15T14:49:28.626642+0000","last_active":"2024-05-15T14:49:28.626618+0000","last_peered":"2024-05-15T14:49:28.626618+0000","last_clean":"2024-05-15T14:49:28.626618+0000","last_became_active":"2024-05-15T14:27:56.876325+0000","last_became_peered":"2024-05-15T14:27:56.876325+0000","last_unstale":"2024-05-15T14:49:28.626618+0000","last_undegraded":"2024-05-15T14:49:28.626618+0000","last_fullsized":"2024-05-15T14:49:28.626618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:28.626528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:28.626528+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.626528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:29:58.038093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"39'146","reported_seq":269,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.354466+0000","last_change":"2024-05-15T14:49:07.354466+0000","last_active":"2024-05-15T14:49:07.354466+0000","last_peered":"2024-05-15T14:49:07.354466+0000","last_clean":"2024-05-15T14:49:07.354466+0000","last_became_active":"2024-05-15T14:27:58.883792+0000","last_became_peered":"2024-05-15T14:27:58.883792+0000","last_unstale":"2024-05-15T14:49:07.354466+0000","last_undegraded":"2024-05-15T14:49:07.354466+0000","last_fullsized":"2024-05-15T14:49:07.354466+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'146","last_scrub_stamp":"2024-05-15T14:49:07.354281+0000","last_deep_scrub":"39'146","last_deep_scrub_stamp":"2024-05-15T14:49:07.354281+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.354281+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:34.204559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":205,"num_write":143,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":356,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.321977+0000","last_change":"2024-05-15T14:49:33.321977+0000","last_active":"2024-05-15T14:49:33.321977+0000","last_peered":"2024-05-15T14:49:33.321977+0000","last_clean":"2024-05-15T14:49:33.321977+0000","last_became_active":"2024-05-15T14:28:00.885933+0000","last_became_peered":"2024-05-15T14:28:00.885933+0000","last_unstale":"2024-05-15T14:49:33.321977+0000","last_undegraded":"2024-05-15T14:49:33.321977+0000","last_fullsized":"2024-05-15T14:49:33.321977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:33.321832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:33.321832+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.321832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:36.447166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:48.401274+0000","last_change":"2024-05-15T14:49:48.401303+0000","last_active":"2024-05-15T14:49:48.401274+0000","last_peered":"2024-05-15T14:49:48.401274+0000","last_clean":"2024-05-15T14:49:48.401274+0000","last_became_active":"2024-05-15T14:31:16.594357+0000","last_became_peered":"2024-05-15T14:31:16.594357+0000","last_unstale":"2024-05-15T14:49:48.401274+0000","last_undegraded":"2024-05-15T14:49:48.401274+0000","last_fullsized":"2024-05-15T14:49:48.401274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:48.401169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:48.401169+0000","last_clean_scrub_stamp":"2024-05-15T14:49:48.401169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:45:00.244486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"39'17","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.157550+0000","last_change":"2024-05-15T14:49:13.157580+0000","last_active":"2024-05-15T14:49:13.157550+0000","last_peered":"2024-05-15T14:49:13.157550+0000","last_clean":"2024-05-15T14:49:13.157550+0000","last_became_active":"2024-05-15T14:28:02.892764+0000","last_became_peered":"2024-05-15T14:28:02.892764+0000","last_unstale":"2024-05-15T14:49:13.157550+0000","last_undegraded":"2024-05-15T14:49:13.157550+0000","last_fullsized":"2024-05-15T14:49:13.157550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'17","last_scrub_stamp":"2024-05-15T14:49:13.157460+0000","last_deep_scrub":"39'17","last_deep_scrub_stamp":"2024-05-15T14:49:13.157460+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.157460+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:36.087366+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"39'26","reported_seq":134,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.207780+0000","last_change":"2024-05-15T14:49:22.207780+0000","last_active":"2024-05-15T14:49:22.207780+0000","last_peered":"2024-05-15T14:49:22.207780+0000","last_clean":"2024-05-15T14:49:22.207780+0000","last_became_active":"2024-05-15T14:27:52.852883+0000","last_became_peered":"2024-05-15T14:27:52.852883+0000","last_unstale":"2024-05-15T14:49:22.207780+0000","last_undegraded":"2024-05-15T14:49:22.207780+0000","last_fullsized":"2024-05-15T14:49:22.207780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:22.207662+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:22.207662+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.207662+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:55.309176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"39'12","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.597982+0000","last_change":"2024-05-15T14:49:32.598006+0000","last_active":"2024-05-15T14:49:32.597982+0000","last_peered":"2024-05-15T14:49:32.597982+0000","last_clean":"2024-05-15T14:49:32.597982+0000","last_became_active":"2024-05-15T14:27:50.848412+0000","last_became_peered":"2024-05-15T14:27:50.848412+0000","last_unstale":"2024-05-15T14:49:32.597982+0000","last_undegraded":"2024-05-15T14:49:32.597982+0000","last_fullsized":"2024-05-15T14:49:32.597982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:32.597889+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:32.597889+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.597889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:34.907427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"39'17","reported_seq":708,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.623151+0000","last_change":"2024-05-15T14:49:30.623151+0000","last_active":"2024-05-15T14:49:30.623151+0000","last_peered":"2024-05-15T14:49:30.623151+0000","last_clean":"2024-05-15T14:49:30.623151+0000","last_became_active":"2024-05-15T14:27:56.877039+0000","last_became_peered":"2024-05-15T14:27:56.877039+0000","last_unstale":"2024-05-15T14:49:30.623151+0000","last_undegraded":"2024-05-15T14:49:30.623151+0000","last_fullsized":"2024-05-15T14:49:30.623151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'17","last_scrub_stamp":"2024-05-15T14:49:30.623009+0000","last_deep_scrub":"39'17","last_deep_scrub_stamp":"2024-05-15T14:49:30.623009+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.623009+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:53.407137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":635,"num_read_kb":635,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"39'249","reported_seq":420,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.388027+0000","last_change":"2024-05-15T14:49:14.388079+0000","last_active":"2024-05-15T14:49:14.388027+0000","last_peered":"2024-05-15T14:49:14.388027+0000","last_clean":"2024-05-15T14:49:14.388027+0000","last_became_active":"2024-05-15T14:27:58.887969+0000","last_became_peered":"2024-05-15T14:27:58.887969+0000","last_unstale":"2024-05-15T14:49:14.388027+0000","last_undegraded":"2024-05-15T14:49:14.388027+0000","last_fullsized":"2024-05-15T14:49:14.388027+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'249","last_scrub_stamp":"2024-05-15T14:49:14.387915+0000","last_deep_scrub":"39'249","last_deep_scrub_stamp":"2024-05-15T14:49:14.387915+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.387915+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:38:24.882431+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":351,"num_read_kb":343,"num_write":242,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'927","reported_seq":1443,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.918299+0000","last_change":"2024-05-15T14:49:03.918299+0000","last_active":"2024-05-15T14:49:03.918299+0000","last_peered":"2024-05-15T14:49:03.918299+0000","last_clean":"2024-05-15T14:49:03.918299+0000","last_became_active":"2024-05-15T14:28:00.892864+0000","last_became_peered":"2024-05-15T14:28:00.892864+0000","last_unstale":"2024-05-15T14:49:03.918299+0000","last_undegraded":"2024-05-15T14:49:03.918299+0000","last_fullsized":"2024-05-15T14:49:03.918299+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:03.918163+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:03.918163+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.918163+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:03.560609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:43.410994+0000","last_change":"2024-05-15T14:49:43.411021+0000","last_active":"2024-05-15T14:49:43.410994+0000","last_peered":"2024-05-15T14:49:43.410994+0000","last_clean":"2024-05-15T14:49:43.410994+0000","last_became_active":"2024-05-15T14:31:16.583997+0000","last_became_peered":"2024-05-15T14:31:16.583997+0000","last_unstale":"2024-05-15T14:49:43.410994+0000","last_undegraded":"2024-05-15T14:49:43.410994+0000","last_fullsized":"2024-05-15T14:49:43.410994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:43.410896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:43.410896+0000","last_clean_scrub_stamp":"2024-05-15T14:49:43.410896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:42:19.300015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"39'31","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.348341+0000","last_change":"2024-05-15T14:49:34.348404+0000","last_active":"2024-05-15T14:49:34.348341+0000","last_peered":"2024-05-15T14:49:34.348341+0000","last_clean":"2024-05-15T14:49:34.348341+0000","last_became_active":"2024-05-15T14:28:02.887257+0000","last_became_peered":"2024-05-15T14:28:02.887257+0000","last_unstale":"2024-05-15T14:49:34.348341+0000","last_undegraded":"2024-05-15T14:49:34.348341+0000","last_fullsized":"2024-05-15T14:49:34.348341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:34.348219+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:34.348219+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.348219+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:10:42.654627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":53,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"39'24","reported_seq":118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.698770+0000","last_change":"2024-05-15T14:49:25.698770+0000","last_active":"2024-05-15T14:49:25.698770+0000","last_peered":"2024-05-15T14:49:25.698770+0000","last_clean":"2024-05-15T14:49:25.698770+0000","last_became_active":"2024-05-15T14:27:52.851979+0000","last_became_peered":"2024-05-15T14:27:52.851979+0000","last_unstale":"2024-05-15T14:49:25.698770+0000","last_undegraded":"2024-05-15T14:49:25.698770+0000","last_fullsized":"2024-05-15T14:49:25.698770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:25.698643+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:25.698643+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.698643+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:11:16.054932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":90,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"39'6","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.054924+0000","last_change":"2024-05-15T14:49:16.054952+0000","last_active":"2024-05-15T14:49:16.054924+0000","last_peered":"2024-05-15T14:49:16.054924+0000","last_clean":"2024-05-15T14:49:16.054924+0000","last_became_active":"2024-05-15T14:27:50.840772+0000","last_became_peered":"2024-05-15T14:27:50.840772+0000","last_unstale":"2024-05-15T14:49:16.054924+0000","last_undegraded":"2024-05-15T14:49:16.054924+0000","last_fullsized":"2024-05-15T14:49:16.054924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:16.054831+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:16.054831+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.054831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:32.603698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":30,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.037640+0000","last_change":"2024-05-15T14:49:24.037640+0000","last_active":"2024-05-15T14:49:24.037640+0000","last_peered":"2024-05-15T14:49:24.037640+0000","last_clean":"2024-05-15T14:49:24.037640+0000","last_became_active":"2024-05-15T14:27:56.877825+0000","last_became_peered":"2024-05-15T14:27:56.877825+0000","last_unstale":"2024-05-15T14:49:24.037640+0000","last_undegraded":"2024-05-15T14:49:24.037640+0000","last_fullsized":"2024-05-15T14:49:24.037640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:24.037485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:24.037485+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.037485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:06.862404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"39'280","reported_seq":23298,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.882459+0000","last_change":"2024-05-15T14:49:09.882459+0000","last_active":"2024-05-15T14:49:09.882459+0000","last_peered":"2024-05-15T14:49:09.882459+0000","last_clean":"2024-05-15T14:49:09.882459+0000","last_became_active":"2024-05-15T14:27:58.887424+0000","last_became_peered":"2024-05-15T14:27:58.887424+0000","last_unstale":"2024-05-15T14:49:09.882459+0000","last_undegraded":"2024-05-15T14:49:09.882459+0000","last_fullsized":"2024-05-15T14:49:09.882459+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'280","last_scrub_stamp":"2024-05-15T14:49:09.882332+0000","last_deep_scrub":"39'280","last_deep_scrub_stamp":"2024-05-15T14:49:09.882332+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.882332+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:27.843470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57546,"num_read_kb":170986,"num_write":274,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'927","reported_seq":2608,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.662712+0000","last_change":"2024-05-15T14:49:06.662741+0000","last_active":"2024-05-15T14:49:06.662712+0000","last_peered":"2024-05-15T14:49:06.662712+0000","last_clean":"2024-05-15T14:49:06.662712+0000","last_became_active":"2024-05-15T14:28:00.887493+0000","last_became_peered":"2024-05-15T14:28:00.887493+0000","last_unstale":"2024-05-15T14:49:06.662712+0000","last_undegraded":"2024-05-15T14:49:06.662712+0000","last_fullsized":"2024-05-15T14:49:06.662712+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:06.662621+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:06.662621+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.662621+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:14.729989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:43.486546+0000","last_change":"2024-05-15T14:49:43.486572+0000","last_active":"2024-05-15T14:49:43.486546+0000","last_peered":"2024-05-15T14:49:43.486546+0000","last_clean":"2024-05-15T14:49:43.486546+0000","last_became_active":"2024-05-15T14:31:16.591945+0000","last_became_peered":"2024-05-15T14:31:16.591945+0000","last_unstale":"2024-05-15T14:49:43.486546+0000","last_undegraded":"2024-05-15T14:49:43.486546+0000","last_fullsized":"2024-05-15T14:49:43.486546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:43.486457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:43.486457+0000","last_clean_scrub_stamp":"2024-05-15T14:49:43.486457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:36:40.048681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"39'16","reported_seq":106,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.074781+0000","last_change":"2024-05-15T14:49:14.074781+0000","last_active":"2024-05-15T14:49:14.074781+0000","last_peered":"2024-05-15T14:49:14.074781+0000","last_clean":"2024-05-15T14:49:14.074781+0000","last_became_active":"2024-05-15T14:27:52.842056+0000","last_became_peered":"2024-05-15T14:27:52.842056+0000","last_unstale":"2024-05-15T14:49:14.074781+0000","last_undegraded":"2024-05-15T14:49:14.074781+0000","last_fullsized":"2024-05-15T14:49:14.074781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:14.074605+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:14.074605+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.074605+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:37.454474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.581647+0000","last_change":"2024-05-15T14:49:27.581673+0000","last_active":"2024-05-15T14:49:27.581647+0000","last_peered":"2024-05-15T14:49:27.581647+0000","last_clean":"2024-05-15T14:49:27.581647+0000","last_became_active":"2024-05-15T14:27:50.849981+0000","last_became_peered":"2024-05-15T14:27:50.849981+0000","last_unstale":"2024-05-15T14:49:27.581647+0000","last_undegraded":"2024-05-15T14:49:27.581647+0000","last_fullsized":"2024-05-15T14:49:27.581647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:27.581552+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:27.581552+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.581552+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:36.945643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":80,"num_write_kb":23526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"39'2","reported_seq":139,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.696222+0000","last_change":"2024-05-15T14:49:20.696222+0000","last_active":"2024-05-15T14:49:20.696222+0000","last_peered":"2024-05-15T14:49:20.696222+0000","last_clean":"2024-05-15T14:49:20.696222+0000","last_became_active":"2024-05-15T14:27:56.878269+0000","last_became_peered":"2024-05-15T14:27:56.878269+0000","last_unstale":"2024-05-15T14:49:20.696222+0000","last_undegraded":"2024-05-15T14:49:20.696222+0000","last_fullsized":"2024-05-15T14:49:20.696222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:20.696101+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:20.696101+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.696101+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:01.913190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":160,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"39'436","reported_seq":757,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.984753+0000","last_change":"2024-05-15T14:49:10.984753+0000","last_active":"2024-05-15T14:49:10.984753+0000","last_peered":"2024-05-15T14:49:10.984753+0000","last_clean":"2024-05-15T14:49:10.984753+0000","last_became_active":"2024-05-15T14:27:58.883546+0000","last_became_peered":"2024-05-15T14:27:58.883546+0000","last_unstale":"2024-05-15T14:49:10.984753+0000","last_undegraded":"2024-05-15T14:49:10.984753+0000","last_fullsized":"2024-05-15T14:49:10.984753+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'436","last_scrub_stamp":"2024-05-15T14:49:10.984585+0000","last_deep_scrub":"39'436","last_deep_scrub_stamp":"2024-05-15T14:49:10.984585+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.984585+0000","objects_scrubbed":10,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:04.126776+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":668,"num_read_kb":656,"num_write":402,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.927586+0000","last_change":"2024-05-15T14:49:25.927614+0000","last_active":"2024-05-15T14:49:25.927586+0000","last_peered":"2024-05-15T14:49:25.927586+0000","last_clean":"2024-05-15T14:49:25.927586+0000","last_became_active":"2024-05-15T14:28:00.891863+0000","last_became_peered":"2024-05-15T14:28:00.891863+0000","last_unstale":"2024-05-15T14:49:25.927586+0000","last_undegraded":"2024-05-15T14:49:25.927586+0000","last_fullsized":"2024-05-15T14:49:25.927586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:25.927479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:25.927479+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.927479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:33.994847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"39'26","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.857505+0000","last_change":"2024-05-15T14:49:02.857570+0000","last_active":"2024-05-15T14:49:02.857505+0000","last_peered":"2024-05-15T14:49:02.857505+0000","last_clean":"2024-05-15T14:49:02.857505+0000","last_became_active":"2024-05-15T14:28:02.890450+0000","last_became_peered":"2024-05-15T14:28:02.890450+0000","last_unstale":"2024-05-15T14:49:02.857505+0000","last_undegraded":"2024-05-15T14:49:02.857505+0000","last_fullsized":"2024-05-15T14:49:02.857505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:02.857396+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:02.857396+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.857396+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:42.403406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.822963+0000","last_change":"2024-05-15T14:49:31.822963+0000","last_active":"2024-05-15T14:49:31.822963+0000","last_peered":"2024-05-15T14:49:31.822963+0000","last_clean":"2024-05-15T14:49:31.822963+0000","last_became_active":"2024-05-15T14:31:16.596344+0000","last_became_peered":"2024-05-15T14:31:16.596344+0000","last_unstale":"2024-05-15T14:49:31.822963+0000","last_undegraded":"2024-05-15T14:49:31.822963+0000","last_fullsized":"2024-05-15T14:49:31.822963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:31.822794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:31.822794+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.822794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:35.207732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'6","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.270195+0000","last_change":"2024-05-15T14:49:14.270195+0000","last_active":"2024-05-15T14:49:14.270195+0000","last_peered":"2024-05-15T14:49:14.270195+0000","last_clean":"2024-05-15T14:49:14.270195+0000","last_became_active":"2024-05-15T14:27:52.861131+0000","last_became_peered":"2024-05-15T14:27:52.861131+0000","last_unstale":"2024-05-15T14:49:14.270195+0000","last_undegraded":"2024-05-15T14:49:14.270195+0000","last_fullsized":"2024-05-15T14:49:14.270195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'6","last_scrub_stamp":"2024-05-15T14:49:14.270082+0000","last_deep_scrub":"39'6","last_deep_scrub_stamp":"2024-05-15T14:49:14.270082+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.270082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:38.007525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"39'10","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.623310+0000","last_change":"2024-05-15T14:49:31.623337+0000","last_active":"2024-05-15T14:49:31.623310+0000","last_peered":"2024-05-15T14:49:31.623310+0000","last_clean":"2024-05-15T14:49:31.623310+0000","last_became_active":"2024-05-15T14:27:50.847875+0000","last_became_peered":"2024-05-15T14:27:50.847875+0000","last_unstale":"2024-05-15T14:49:31.623310+0000","last_undegraded":"2024-05-15T14:49:31.623310+0000","last_fullsized":"2024-05-15T14:49:31.623310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:31.623219+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:31.623219+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.623219+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:21.749187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":11761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"39'2","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.405677+0000","last_change":"2024-05-15T14:49:01.405677+0000","last_active":"2024-05-15T14:49:01.405677+0000","last_peered":"2024-05-15T14:49:01.405677+0000","last_clean":"2024-05-15T14:49:01.405677+0000","last_became_active":"2024-05-15T14:27:56.881088+0000","last_became_peered":"2024-05-15T14:27:56.881088+0000","last_unstale":"2024-05-15T14:49:01.405677+0000","last_undegraded":"2024-05-15T14:49:01.405677+0000","last_fullsized":"2024-05-15T14:49:01.405677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:01.405573+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:01.405573+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.405573+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:12:23.625819+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"39'629","reported_seq":1024,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.696175+0000","last_change":"2024-05-15T14:49:11.696218+0000","last_active":"2024-05-15T14:49:11.696175+0000","last_peered":"2024-05-15T14:49:11.696175+0000","last_clean":"2024-05-15T14:49:11.696175+0000","last_became_active":"2024-05-15T14:27:58.882302+0000","last_became_peered":"2024-05-15T14:27:58.882302+0000","last_unstale":"2024-05-15T14:49:11.696175+0000","last_undegraded":"2024-05-15T14:49:11.696175+0000","last_fullsized":"2024-05-15T14:49:11.696175+0000","mapping_epoch":26,"log_start":"39'598","ondisk_log_start":"39'598","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'629","last_scrub_stamp":"2024-05-15T14:49:11.696077+0000","last_deep_scrub":"39'629","last_deep_scrub_stamp":"2024-05-15T14:49:11.696077+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.696077+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":598,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:39:54.520996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1288,"num_read_kb":3202,"num_write":806,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.705697+0000","last_change":"2024-05-15T14:49:07.705697+0000","last_active":"2024-05-15T14:49:07.705697+0000","last_peered":"2024-05-15T14:49:07.705697+0000","last_clean":"2024-05-15T14:49:07.705697+0000","last_became_active":"2024-05-15T14:28:00.887335+0000","last_became_peered":"2024-05-15T14:28:00.887335+0000","last_unstale":"2024-05-15T14:49:07.705697+0000","last_undegraded":"2024-05-15T14:49:07.705697+0000","last_fullsized":"2024-05-15T14:49:07.705697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.705526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.705526+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.705526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:23.807975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"39'16","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.142730+0000","last_change":"2024-05-15T14:49:24.142774+0000","last_active":"2024-05-15T14:49:24.142730+0000","last_peered":"2024-05-15T14:49:24.142730+0000","last_clean":"2024-05-15T14:49:24.142730+0000","last_became_active":"2024-05-15T14:28:02.889193+0000","last_became_peered":"2024-05-15T14:28:02.889193+0000","last_unstale":"2024-05-15T14:49:24.142730+0000","last_undegraded":"2024-05-15T14:49:24.142730+0000","last_fullsized":"2024-05-15T14:49:24.142730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:24.142625+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:24.142625+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.142625+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:17.284817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:41.018489+0000","last_change":"2024-05-15T14:49:41.018513+0000","last_active":"2024-05-15T14:49:41.018489+0000","last_peered":"2024-05-15T14:49:41.018489+0000","last_clean":"2024-05-15T14:49:41.018489+0000","last_became_active":"2024-05-15T14:31:16.590510+0000","last_became_peered":"2024-05-15T14:31:16.590510+0000","last_unstale":"2024-05-15T14:49:41.018489+0000","last_undegraded":"2024-05-15T14:49:41.018489+0000","last_fullsized":"2024-05-15T14:49:41.018489+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:41.018393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:41.018393+0000","last_clean_scrub_stamp":"2024-05-15T14:49:41.018393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:34:47.194760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"39'64","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.096871+0000","last_change":"2024-05-15T14:49:06.096871+0000","last_active":"2024-05-15T14:49:06.096871+0000","last_peered":"2024-05-15T14:49:06.096871+0000","last_clean":"2024-05-15T14:49:06.096871+0000","last_became_active":"2024-05-15T14:27:52.861183+0000","last_became_peered":"2024-05-15T14:27:52.861183+0000","last_unstale":"2024-05-15T14:49:06.096871+0000","last_undegraded":"2024-05-15T14:49:06.096871+0000","last_fullsized":"2024-05-15T14:49:06.096871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'64","last_scrub_stamp":"2024-05-15T14:49:06.096747+0000","last_deep_scrub":"39'64","last_deep_scrub_stamp":"2024-05-15T14:49:06.096747+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.096747+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:53:33.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":194,"num_write":90,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"39'4","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.700206+0000","last_change":"2024-05-15T14:49:21.700263+0000","last_active":"2024-05-15T14:49:21.700206+0000","last_peered":"2024-05-15T14:49:21.700206+0000","last_clean":"2024-05-15T14:49:21.700206+0000","last_became_active":"2024-05-15T14:27:50.852376+0000","last_became_peered":"2024-05-15T14:27:50.852376+0000","last_unstale":"2024-05-15T14:49:21.700206+0000","last_undegraded":"2024-05-15T14:49:21.700206+0000","last_fullsized":"2024-05-15T14:49:21.700206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:21.700108+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:21.700108+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.700108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:19.841440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.442355+0000","last_change":"2024-05-15T14:49:02.442381+0000","last_active":"2024-05-15T14:49:02.442355+0000","last_peered":"2024-05-15T14:49:02.442355+0000","last_clean":"2024-05-15T14:49:02.442355+0000","last_became_active":"2024-05-15T14:27:56.881701+0000","last_became_peered":"2024-05-15T14:27:56.881701+0000","last_unstale":"2024-05-15T14:49:02.442355+0000","last_undegraded":"2024-05-15T14:49:02.442355+0000","last_fullsized":"2024-05-15T14:49:02.442355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:02.442283+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:02.442283+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.442283+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:35:32.123039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"39'443","reported_seq":816,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.498970+0000","last_change":"2024-05-15T14:49:36.498970+0000","last_active":"2024-05-15T14:49:36.498970+0000","last_peered":"2024-05-15T14:49:36.498970+0000","last_clean":"2024-05-15T14:49:36.498970+0000","last_became_active":"2024-05-15T14:27:58.885487+0000","last_became_peered":"2024-05-15T14:27:58.885487+0000","last_unstale":"2024-05-15T14:49:36.498970+0000","last_undegraded":"2024-05-15T14:49:36.498970+0000","last_fullsized":"2024-05-15T14:49:36.498970+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'443","last_scrub_stamp":"2024-05-15T14:49:36.498817+0000","last_deep_scrub":"39'443","last_deep_scrub_stamp":"2024-05-15T14:49:36.498817+0000","last_clean_scrub_stamp":"2024-05-15T14:49:36.498817+0000","objects_scrubbed":9,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:58:53.867892+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":878,"num_read_kb":1340,"num_write":447,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"39'927","reported_seq":1557,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.091914+0000","last_change":"2024-05-15T14:49:03.091914+0000","last_active":"2024-05-15T14:49:03.091914+0000","last_peered":"2024-05-15T14:49:03.091914+0000","last_clean":"2024-05-15T14:49:03.091914+0000","last_became_active":"2024-05-15T14:28:00.892897+0000","last_became_peered":"2024-05-15T14:28:00.892897+0000","last_unstale":"2024-05-15T14:49:03.091914+0000","last_undegraded":"2024-05-15T14:49:03.091914+0000","last_fullsized":"2024-05-15T14:49:03.091914+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:03.091775+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:03.091775+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.091775+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:21:11.950686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"39'14","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:40.380485+0000","last_change":"2024-05-15T14:49:40.380485+0000","last_active":"2024-05-15T14:49:40.380485+0000","last_peered":"2024-05-15T14:49:40.380485+0000","last_clean":"2024-05-15T14:49:40.380485+0000","last_became_active":"2024-05-15T14:28:02.894071+0000","last_became_peered":"2024-05-15T14:28:02.894071+0000","last_unstale":"2024-05-15T14:49:40.380485+0000","last_undegraded":"2024-05-15T14:49:40.380485+0000","last_fullsized":"2024-05-15T14:49:40.380485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:40.380339+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:40.380339+0000","last_clean_scrub_stamp":"2024-05-15T14:49:40.380339+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:37:37.630782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:42.050391+0000","last_change":"2024-05-15T14:49:42.050428+0000","last_active":"2024-05-15T14:49:42.050391+0000","last_peered":"2024-05-15T14:49:42.050391+0000","last_clean":"2024-05-15T14:49:42.050391+0000","last_became_active":"2024-05-15T14:31:16.591166+0000","last_became_peered":"2024-05-15T14:31:16.591166+0000","last_unstale":"2024-05-15T14:49:42.050391+0000","last_undegraded":"2024-05-15T14:49:42.050391+0000","last_fullsized":"2024-05-15T14:49:42.050391+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:42.050294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:42.050294+0000","last_clean_scrub_stamp":"2024-05-15T14:49:42.050294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:34:48.230574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'114","reported_seq":215,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.173130+0000","last_change":"2024-05-15T14:49:17.173165+0000","last_active":"2024-05-15T14:49:17.173130+0000","last_peered":"2024-05-15T14:49:17.173130+0000","last_clean":"2024-05-15T14:49:17.173130+0000","last_became_active":"2024-05-15T14:27:52.859814+0000","last_became_peered":"2024-05-15T14:27:52.859814+0000","last_unstale":"2024-05-15T14:49:17.173130+0000","last_undegraded":"2024-05-15T14:49:17.173130+0000","last_fullsized":"2024-05-15T14:49:17.173130+0000","mapping_epoch":20,"log_start":"39'100","ondisk_log_start":"39'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'114","last_scrub_stamp":"2024-05-15T14:49:17.173033+0000","last_deep_scrub":"39'114","last_deep_scrub_stamp":"2024-05-15T14:49:17.173033+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.173033+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:41.404786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":332,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"39'12","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.088317+0000","last_change":"2024-05-15T14:49:27.088368+0000","last_active":"2024-05-15T14:49:27.088317+0000","last_peered":"2024-05-15T14:49:27.088317+0000","last_clean":"2024-05-15T14:49:27.088317+0000","last_became_active":"2024-05-15T14:27:50.849548+0000","last_became_peered":"2024-05-15T14:27:50.849548+0000","last_unstale":"2024-05-15T14:49:27.088317+0000","last_undegraded":"2024-05-15T14:49:27.088317+0000","last_fullsized":"2024-05-15T14:49:27.088317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:27.088207+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:27.088207+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.088207+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:10:32.723805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"39'7","reported_seq":658,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.339142+0000","last_change":"2024-05-15T14:49:13.339142+0000","last_active":"2024-05-15T14:49:13.339142+0000","last_peered":"2024-05-15T14:49:13.339142+0000","last_clean":"2024-05-15T14:49:13.339142+0000","last_became_active":"2024-05-15T14:27:56.871644+0000","last_became_peered":"2024-05-15T14:27:56.871644+0000","last_unstale":"2024-05-15T14:49:13.339142+0000","last_undegraded":"2024-05-15T14:49:13.339142+0000","last_fullsized":"2024-05-15T14:49:13.339142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'7","last_scrub_stamp":"2024-05-15T14:49:13.339007+0000","last_deep_scrub":"39'7","last_deep_scrub_stamp":"2024-05-15T14:49:13.339007+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.339007+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:00.220785+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1126,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":148,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'288","reported_seq":591,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.281357+0000","last_change":"2024-05-15T14:49:27.281357+0000","last_active":"2024-05-15T14:49:27.281357+0000","last_peered":"2024-05-15T14:49:27.281357+0000","last_clean":"2024-05-15T14:49:27.281357+0000","last_became_active":"2024-05-15T14:27:58.880926+0000","last_became_peered":"2024-05-15T14:27:58.880926+0000","last_unstale":"2024-05-15T14:49:27.281357+0000","last_undegraded":"2024-05-15T14:49:27.281357+0000","last_fullsized":"2024-05-15T14:49:27.281357+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'288","last_scrub_stamp":"2024-05-15T14:49:27.281226+0000","last_deep_scrub":"39'288","last_deep_scrub_stamp":"2024-05-15T14:49:27.281226+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.281226+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:30.406560+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":467,"num_write":232,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.429665+0000","last_change":"2024-05-15T14:49:16.429665+0000","last_active":"2024-05-15T14:49:16.429665+0000","last_peered":"2024-05-15T14:49:16.429665+0000","last_clean":"2024-05-15T14:49:16.429665+0000","last_became_active":"2024-05-15T14:28:00.886359+0000","last_became_peered":"2024-05-15T14:28:00.886359+0000","last_unstale":"2024-05-15T14:49:16.429665+0000","last_undegraded":"2024-05-15T14:49:16.429665+0000","last_fullsized":"2024-05-15T14:49:16.429665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:16.429548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:16.429548+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.429548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:12:59.179260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"39'30","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.830637+0000","last_change":"2024-05-15T14:49:28.830637+0000","last_active":"2024-05-15T14:49:28.830637+0000","last_peered":"2024-05-15T14:49:28.830637+0000","last_clean":"2024-05-15T14:49:28.830637+0000","last_became_active":"2024-05-15T14:28:02.892287+0000","last_became_peered":"2024-05-15T14:28:02.892287+0000","last_unstale":"2024-05-15T14:49:28.830637+0000","last_undegraded":"2024-05-15T14:49:28.830637+0000","last_fullsized":"2024-05-15T14:49:28.830637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2024-05-15T14:49:28.830499+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2024-05-15T14:49:28.830499+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.830499+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:07.407355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":39,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:45.403863+0000","last_change":"2024-05-15T14:49:45.403863+0000","last_active":"2024-05-15T14:49:45.403863+0000","last_peered":"2024-05-15T14:49:45.403863+0000","last_clean":"2024-05-15T14:49:45.403863+0000","last_became_active":"2024-05-15T14:31:16.590227+0000","last_became_peered":"2024-05-15T14:31:16.590227+0000","last_unstale":"2024-05-15T14:49:45.403863+0000","last_undegraded":"2024-05-15T14:49:45.403863+0000","last_fullsized":"2024-05-15T14:49:45.403863+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:45.403726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:45.403726+0000","last_clean_scrub_stamp":"2024-05-15T14:49:45.403726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:58.342592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"34'6","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.285333+0000","last_change":"2024-05-15T14:49:13.285358+0000","last_active":"2024-05-15T14:49:13.285333+0000","last_peered":"2024-05-15T14:49:13.285333+0000","last_clean":"2024-05-15T14:49:13.285333+0000","last_became_active":"2024-05-15T14:27:52.851589+0000","last_became_peered":"2024-05-15T14:27:52.851589+0000","last_unstale":"2024-05-15T14:49:13.285333+0000","last_undegraded":"2024-05-15T14:49:13.285333+0000","last_fullsized":"2024-05-15T14:49:13.285333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-05-15T14:49:13.285211+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-05-15T14:49:13.285211+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.285211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:33.845230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"39'14","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:41.406982+0000","last_change":"2024-05-15T14:49:41.407038+0000","last_active":"2024-05-15T14:49:41.406982+0000","last_peered":"2024-05-15T14:49:41.406982+0000","last_clean":"2024-05-15T14:49:41.406982+0000","last_became_active":"2024-05-15T14:27:50.850389+0000","last_became_peered":"2024-05-15T14:27:50.850389+0000","last_unstale":"2024-05-15T14:49:41.406982+0000","last_undegraded":"2024-05-15T14:49:41.406982+0000","last_fullsized":"2024-05-15T14:49:41.406982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:41.406870+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:41.406870+0000","last_clean_scrub_stamp":"2024-05-15T14:49:41.406870+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:42:12.288745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":19,"num_write":54,"num_write_kb":19955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"39'2","reported_seq":82,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.375023+0000","last_change":"2024-05-15T14:49:05.375068+0000","last_active":"2024-05-15T14:49:05.375023+0000","last_peered":"2024-05-15T14:49:05.375023+0000","last_clean":"2024-05-15T14:49:05.375023+0000","last_became_active":"2024-05-15T14:27:56.876626+0000","last_became_peered":"2024-05-15T14:27:56.876626+0000","last_unstale":"2024-05-15T14:49:05.375023+0000","last_undegraded":"2024-05-15T14:49:05.375023+0000","last_fullsized":"2024-05-15T14:49:05.375023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:05.374887+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:05.374887+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.374887+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:18:12.646630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"39'370","reported_seq":605,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.358051+0000","last_change":"2024-05-15T14:49:05.358132+0000","last_active":"2024-05-15T14:49:05.358051+0000","last_peered":"2024-05-15T14:49:05.358051+0000","last_clean":"2024-05-15T14:49:05.358051+0000","last_became_active":"2024-05-15T14:27:58.885156+0000","last_became_peered":"2024-05-15T14:27:58.885156+0000","last_unstale":"2024-05-15T14:49:05.358051+0000","last_undegraded":"2024-05-15T14:49:05.358051+0000","last_fullsized":"2024-05-15T14:49:05.358051+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'370","last_scrub_stamp":"2024-05-15T14:49:05.357940+0000","last_deep_scrub":"39'370","last_deep_scrub_stamp":"2024-05-15T14:49:05.357940+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.357940+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:31.785729+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":666,"num_write":563,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.155853+0000","last_change":"2024-05-15T14:49:08.155879+0000","last_active":"2024-05-15T14:49:08.155853+0000","last_peered":"2024-05-15T14:49:08.155853+0000","last_clean":"2024-05-15T14:49:08.155853+0000","last_became_active":"2024-05-15T14:28:00.885582+0000","last_became_peered":"2024-05-15T14:28:00.885582+0000","last_unstale":"2024-05-15T14:49:08.155853+0000","last_undegraded":"2024-05-15T14:49:08.155853+0000","last_fullsized":"2024-05-15T14:49:08.155853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:08.155739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:08.155739+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.155739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:28.715758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"39'25","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.644201+0000","last_change":"2024-05-15T14:49:01.644201+0000","last_active":"2024-05-15T14:49:01.644201+0000","last_peered":"2024-05-15T14:49:01.644201+0000","last_clean":"2024-05-15T14:49:01.644201+0000","last_became_active":"2024-05-15T14:28:02.891419+0000","last_became_peered":"2024-05-15T14:28:02.891419+0000","last_unstale":"2024-05-15T14:49:01.644201+0000","last_undegraded":"2024-05-15T14:49:01.644201+0000","last_fullsized":"2024-05-15T14:49:01.644201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:01.644062+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:01.644062+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.644062+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:25.023932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.833931+0000","last_change":"2024-05-15T14:49:30.833954+0000","last_active":"2024-05-15T14:49:30.833931+0000","last_peered":"2024-05-15T14:49:30.833931+0000","last_clean":"2024-05-15T14:49:30.833931+0000","last_became_active":"2024-05-15T14:31:16.593942+0000","last_became_peered":"2024-05-15T14:31:16.593942+0000","last_unstale":"2024-05-15T14:49:30.833931+0000","last_undegraded":"2024-05-15T14:49:30.833931+0000","last_fullsized":"2024-05-15T14:49:30.833931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:30.833823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:30.833823+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.833823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:53:00.396380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'62","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.353713+0000","last_change":"2024-05-15T14:49:11.353752+0000","last_active":"2024-05-15T14:49:11.353713+0000","last_peered":"2024-05-15T14:49:11.353713+0000","last_clean":"2024-05-15T14:49:11.353713+0000","last_became_active":"2024-05-15T14:27:52.853828+0000","last_became_peered":"2024-05-15T14:27:52.853828+0000","last_unstale":"2024-05-15T14:49:11.353713+0000","last_undegraded":"2024-05-15T14:49:11.353713+0000","last_fullsized":"2024-05-15T14:49:11.353713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'62","last_scrub_stamp":"2024-05-15T14:49:11.353622+0000","last_deep_scrub":"39'62","last_deep_scrub_stamp":"2024-05-15T14:49:11.353622+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.353622+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:09.197152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":210,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"39'10","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.123271+0000","last_change":"2024-05-15T14:49:14.123271+0000","last_active":"2024-05-15T14:49:14.123271+0000","last_peered":"2024-05-15T14:49:14.123271+0000","last_clean":"2024-05-15T14:49:14.123271+0000","last_became_active":"2024-05-15T14:27:50.838561+0000","last_became_peered":"2024-05-15T14:27:50.838561+0000","last_unstale":"2024-05-15T14:49:14.123271+0000","last_undegraded":"2024-05-15T14:49:14.123271+0000","last_fullsized":"2024-05-15T14:49:14.123271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:14.123131+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:14.123131+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.123131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:55.813793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.101861+0000","last_change":"2024-05-15T14:49:06.101896+0000","last_active":"2024-05-15T14:49:06.101861+0000","last_peered":"2024-05-15T14:49:06.101861+0000","last_clean":"2024-05-15T14:49:06.101861+0000","last_became_active":"2024-05-15T14:27:56.884903+0000","last_became_peered":"2024-05-15T14:27:56.884903+0000","last_unstale":"2024-05-15T14:49:06.101861+0000","last_undegraded":"2024-05-15T14:49:06.101861+0000","last_fullsized":"2024-05-15T14:49:06.101861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.101757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.101757+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.101757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:12:19.458737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"39'350","reported_seq":622,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.403780+0000","last_change":"2024-05-15T14:49:04.403823+0000","last_active":"2024-05-15T14:49:04.403780+0000","last_peered":"2024-05-15T14:49:04.403780+0000","last_clean":"2024-05-15T14:49:04.403780+0000","last_became_active":"2024-05-15T14:27:58.876221+0000","last_became_peered":"2024-05-15T14:27:58.876221+0000","last_unstale":"2024-05-15T14:49:04.403780+0000","last_undegraded":"2024-05-15T14:49:04.403780+0000","last_fullsized":"2024-05-15T14:49:04.403780+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'350","last_scrub_stamp":"2024-05-15T14:49:04.403697+0000","last_deep_scrub":"39'350","last_deep_scrub_stamp":"2024-05-15T14:49:04.403697+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.403697+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:59:21.647975+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":528,"num_write":320,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'927","reported_seq":1409,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.391534+0000","last_change":"2024-05-15T14:49:15.391565+0000","last_active":"2024-05-15T14:49:15.391534+0000","last_peered":"2024-05-15T14:49:15.391534+0000","last_clean":"2024-05-15T14:49:15.391534+0000","last_became_active":"2024-05-15T14:28:00.884042+0000","last_became_peered":"2024-05-15T14:28:00.884042+0000","last_unstale":"2024-05-15T14:49:15.391534+0000","last_undegraded":"2024-05-15T14:49:15.391534+0000","last_fullsized":"2024-05-15T14:49:15.391534+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:15.391447+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:15.391447+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.391447+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:52:07.864522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"39'23","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.892920+0000","last_change":"2024-05-15T14:49:26.892950+0000","last_active":"2024-05-15T14:49:26.892920+0000","last_peered":"2024-05-15T14:49:26.892920+0000","last_clean":"2024-05-15T14:49:26.892920+0000","last_became_active":"2024-05-15T14:28:02.888602+0000","last_became_peered":"2024-05-15T14:28:02.888602+0000","last_unstale":"2024-05-15T14:49:26.892920+0000","last_undegraded":"2024-05-15T14:49:26.892920+0000","last_fullsized":"2024-05-15T14:49:26.892920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'23","last_scrub_stamp":"2024-05-15T14:49:26.892788+0000","last_deep_scrub":"39'23","last_deep_scrub_stamp":"2024-05-15T14:49:26.892788+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.892788+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:42.995238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.509745+0000","last_change":"2024-05-15T14:49:39.509745+0000","last_active":"2024-05-15T14:49:39.509745+0000","last_peered":"2024-05-15T14:49:39.509745+0000","last_clean":"2024-05-15T14:49:39.509745+0000","last_became_active":"2024-05-15T14:31:16.591677+0000","last_became_peered":"2024-05-15T14:31:16.591677+0000","last_unstale":"2024-05-15T14:49:39.509745+0000","last_undegraded":"2024-05-15T14:49:39.509745+0000","last_fullsized":"2024-05-15T14:49:39.509745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:39.509600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:39.509600+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.509600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:37:29.974176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'72","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.318322+0000","last_change":"2024-05-15T14:49:30.318355+0000","last_active":"2024-05-15T14:49:30.318322+0000","last_peered":"2024-05-15T14:49:30.318322+0000","last_clean":"2024-05-15T14:49:30.318322+0000","last_became_active":"2024-05-15T14:27:52.844221+0000","last_became_peered":"2024-05-15T14:27:52.844221+0000","last_unstale":"2024-05-15T14:49:30.318322+0000","last_undegraded":"2024-05-15T14:49:30.318322+0000","last_fullsized":"2024-05-15T14:49:30.318322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'72","last_scrub_stamp":"2024-05-15T14:49:30.318216+0000","last_deep_scrub":"39'72","last_deep_scrub_stamp":"2024-05-15T14:49:30.318216+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.318216+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:30.322108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":255,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"39'18","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.303503+0000","last_change":"2024-05-15T14:49:27.303503+0000","last_active":"2024-05-15T14:49:27.303503+0000","last_peered":"2024-05-15T14:49:27.303503+0000","last_clean":"2024-05-15T14:49:27.303503+0000","last_became_active":"2024-05-15T14:27:50.846927+0000","last_became_peered":"2024-05-15T14:27:50.846927+0000","last_unstale":"2024-05-15T14:49:27.303503+0000","last_undegraded":"2024-05-15T14:49:27.303503+0000","last_fullsized":"2024-05-15T14:49:27.303503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:27.303383+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:27.303383+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.303383+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:30.688321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":82,"num_write_kb":24687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'8","reported_seq":814,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.094573+0000","last_change":"2024-05-15T14:49:26.094607+0000","last_active":"2024-05-15T14:49:26.094573+0000","last_peered":"2024-05-15T14:49:26.094573+0000","last_clean":"2024-05-15T14:49:26.094573+0000","last_became_active":"2024-05-15T14:27:56.882055+0000","last_became_peered":"2024-05-15T14:27:56.882055+0000","last_unstale":"2024-05-15T14:49:26.094573+0000","last_undegraded":"2024-05-15T14:49:26.094573+0000","last_fullsized":"2024-05-15T14:49:26.094573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:26.094482+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:26.094482+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.094482+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:02.156212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2261,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1075,"num_read_kb":1818,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"39'236","reported_seq":398,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.677996+0000","last_change":"2024-05-15T14:49:17.678035+0000","last_active":"2024-05-15T14:49:17.677996+0000","last_peered":"2024-05-15T14:49:17.677996+0000","last_clean":"2024-05-15T14:49:17.677996+0000","last_became_active":"2024-05-15T14:27:58.878514+0000","last_became_peered":"2024-05-15T14:27:58.878514+0000","last_unstale":"2024-05-15T14:49:17.677996+0000","last_undegraded":"2024-05-15T14:49:17.677996+0000","last_fullsized":"2024-05-15T14:49:17.677996+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'236","last_scrub_stamp":"2024-05-15T14:49:17.677899+0000","last_deep_scrub":"39'236","last_deep_scrub_stamp":"2024-05-15T14:49:17.677899+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.677899+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:19.987437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":332,"num_write":230,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'927","reported_seq":1441,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.122473+0000","last_change":"2024-05-15T14:49:23.122522+0000","last_active":"2024-05-15T14:49:23.122473+0000","last_peered":"2024-05-15T14:49:23.122473+0000","last_clean":"2024-05-15T14:49:23.122473+0000","last_became_active":"2024-05-15T14:28:00.891535+0000","last_became_peered":"2024-05-15T14:28:00.891535+0000","last_unstale":"2024-05-15T14:49:23.122473+0000","last_undegraded":"2024-05-15T14:49:23.122473+0000","last_fullsized":"2024-05-15T14:49:23.122473+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:23.122375+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:23.122375+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.122375+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:20.965906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"39'19","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.276780+0000","last_change":"2024-05-15T14:49:36.276820+0000","last_active":"2024-05-15T14:49:36.276780+0000","last_peered":"2024-05-15T14:49:36.276780+0000","last_clean":"2024-05-15T14:49:36.276780+0000","last_became_active":"2024-05-15T14:28:02.889039+0000","last_became_peered":"2024-05-15T14:28:02.889039+0000","last_unstale":"2024-05-15T14:49:36.276780+0000","last_undegraded":"2024-05-15T14:49:36.276780+0000","last_fullsized":"2024-05-15T14:49:36.276780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'19","last_scrub_stamp":"2024-05-15T14:49:36.276654+0000","last_deep_scrub":"39'19","last_deep_scrub_stamp":"2024-05-15T14:49:36.276654+0000","last_clean_scrub_stamp":"2024-05-15T14:49:36.276654+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:42.073143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:46.359236+0000","last_change":"2024-05-15T14:49:46.359236+0000","last_active":"2024-05-15T14:49:46.359236+0000","last_peered":"2024-05-15T14:49:46.359236+0000","last_clean":"2024-05-15T14:49:46.359236+0000","last_became_active":"2024-05-15T14:31:16.593216+0000","last_became_peered":"2024-05-15T14:31:16.593216+0000","last_unstale":"2024-05-15T14:49:46.359236+0000","last_undegraded":"2024-05-15T14:49:46.359236+0000","last_fullsized":"2024-05-15T14:49:46.359236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:46.359096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:46.359096+0000","last_clean_scrub_stamp":"2024-05-15T14:49:46.359096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:39:25.055489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'24","reported_seq":127,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.074672+0000","last_change":"2024-05-15T14:49:05.074702+0000","last_active":"2024-05-15T14:49:05.074672+0000","last_peered":"2024-05-15T14:49:05.074672+0000","last_clean":"2024-05-15T14:49:05.074672+0000","last_became_active":"2024-05-15T14:27:52.854963+0000","last_became_peered":"2024-05-15T14:27:52.854963+0000","last_unstale":"2024-05-15T14:49:05.074672+0000","last_undegraded":"2024-05-15T14:49:05.074672+0000","last_fullsized":"2024-05-15T14:49:05.074672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:05.074578+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:05.074578+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.074578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:32:21.114015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"39'14","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.399633+0000","last_change":"2024-05-15T14:49:36.399660+0000","last_active":"2024-05-15T14:49:36.399633+0000","last_peered":"2024-05-15T14:49:36.399633+0000","last_clean":"2024-05-15T14:49:36.399633+0000","last_became_active":"2024-05-15T14:27:50.847163+0000","last_became_peered":"2024-05-15T14:27:50.847163+0000","last_unstale":"2024-05-15T14:49:36.399633+0000","last_undegraded":"2024-05-15T14:49:36.399633+0000","last_fullsized":"2024-05-15T14:49:36.399633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:36.399538+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:36.399538+0000","last_clean_scrub_stamp":"2024-05-15T14:49:36.399538+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:55:23.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":70,"num_write_kb":17645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.263987+0000","last_change":"2024-05-15T14:49:22.264039+0000","last_active":"2024-05-15T14:49:22.263987+0000","last_peered":"2024-05-15T14:49:22.263987+0000","last_clean":"2024-05-15T14:49:22.263987+0000","last_became_active":"2024-05-15T14:27:56.879526+0000","last_became_peered":"2024-05-15T14:27:56.879526+0000","last_unstale":"2024-05-15T14:49:22.263987+0000","last_undegraded":"2024-05-15T14:49:22.263987+0000","last_fullsized":"2024-05-15T14:49:22.263987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.263889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.263889+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.263889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:36.466384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"39'416","reported_seq":710,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.057957+0000","last_change":"2024-05-15T14:49:13.058004+0000","last_active":"2024-05-15T14:49:13.057957+0000","last_peered":"2024-05-15T14:49:13.057957+0000","last_clean":"2024-05-15T14:49:13.057957+0000","last_became_active":"2024-05-15T14:27:58.882886+0000","last_became_peered":"2024-05-15T14:27:58.882886+0000","last_unstale":"2024-05-15T14:49:13.057957+0000","last_undegraded":"2024-05-15T14:49:13.057957+0000","last_fullsized":"2024-05-15T14:49:13.057957+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'416","last_scrub_stamp":"2024-05-15T14:49:13.057869+0000","last_deep_scrub":"39'416","last_deep_scrub_stamp":"2024-05-15T14:49:13.057869+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.057869+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:36.795312+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":660,"num_read_kb":650,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20716,"num_omap_keys":50,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.111476+0000","last_change":"2024-05-15T14:49:09.111501+0000","last_active":"2024-05-15T14:49:09.111476+0000","last_peered":"2024-05-15T14:49:09.111476+0000","last_clean":"2024-05-15T14:49:09.111476+0000","last_became_active":"2024-05-15T14:28:00.885434+0000","last_became_peered":"2024-05-15T14:28:00.885434+0000","last_unstale":"2024-05-15T14:49:09.111476+0000","last_undegraded":"2024-05-15T14:49:09.111476+0000","last_fullsized":"2024-05-15T14:49:09.111476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:09.111389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:09.111389+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.111389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:45:41.785247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"39'18","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.844612+0000","last_change":"2024-05-15T14:49:27.844638+0000","last_active":"2024-05-15T14:49:27.844612+0000","last_peered":"2024-05-15T14:49:27.844612+0000","last_clean":"2024-05-15T14:49:27.844612+0000","last_became_active":"2024-05-15T14:28:02.889918+0000","last_became_peered":"2024-05-15T14:28:02.889918+0000","last_unstale":"2024-05-15T14:49:27.844612+0000","last_undegraded":"2024-05-15T14:49:27.844612+0000","last_fullsized":"2024-05-15T14:49:27.844612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:27.844524+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:27.844524+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.844524+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:52.076277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:47.402702+0000","last_change":"2024-05-15T14:49:47.402730+0000","last_active":"2024-05-15T14:49:47.402702+0000","last_peered":"2024-05-15T14:49:47.402702+0000","last_clean":"2024-05-15T14:49:47.402702+0000","last_became_active":"2024-05-15T14:31:16.593813+0000","last_became_peered":"2024-05-15T14:31:16.593813+0000","last_unstale":"2024-05-15T14:49:47.402702+0000","last_undegraded":"2024-05-15T14:49:47.402702+0000","last_fullsized":"2024-05-15T14:49:47.402702+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:47.402592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:47.402592+0000","last_clean_scrub_stamp":"2024-05-15T14:49:47.402592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:36.510058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'64","reported_seq":193,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.154976+0000","last_change":"2024-05-15T14:49:10.155001+0000","last_active":"2024-05-15T14:49:10.154976+0000","last_peered":"2024-05-15T14:49:10.154976+0000","last_clean":"2024-05-15T14:49:10.154976+0000","last_became_active":"2024-05-15T14:27:52.846508+0000","last_became_peered":"2024-05-15T14:27:52.846508+0000","last_unstale":"2024-05-15T14:49:10.154976+0000","last_undegraded":"2024-05-15T14:49:10.154976+0000","last_fullsized":"2024-05-15T14:49:10.154976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'64","last_scrub_stamp":"2024-05-15T14:49:10.154883+0000","last_deep_scrub":"39'64","last_deep_scrub_stamp":"2024-05-15T14:49:10.154883+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.154883+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:47:28.394116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":231,"num_write":88,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"39'74","reported_seq":169,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.587864+0000","last_change":"2024-05-15T14:49:28.587864+0000","last_active":"2024-05-15T14:49:28.587864+0000","last_peered":"2024-05-15T14:49:28.587864+0000","last_clean":"2024-05-15T14:49:28.587864+0000","last_became_active":"2024-05-15T14:27:43.805472+0000","last_became_peered":"2024-05-15T14:27:43.805472+0000","last_unstale":"2024-05-15T14:49:28.587864+0000","last_undegraded":"2024-05-15T14:49:28.587864+0000","last_fullsized":"2024-05-15T14:49:28.587864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2024-05-15T14:49:28.587714+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2024-05-15T14:49:28.587714+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.587714+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:04.649444+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.016557+0000","last_change":"2024-05-15T14:49:30.016580+0000","last_active":"2024-05-15T14:49:30.016557+0000","last_peered":"2024-05-15T14:49:30.016557+0000","last_clean":"2024-05-15T14:49:30.016557+0000","last_became_active":"2024-05-15T14:27:44.808620+0000","last_became_peered":"2024-05-15T14:27:44.808620+0000","last_unstale":"2024-05-15T14:49:30.016557+0000","last_undegraded":"2024-05-15T14:49:30.016557+0000","last_fullsized":"2024-05-15T14:49:30.016557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:30.016466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:30.016466+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.016466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:32.326004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"39'26","reported_seq":121,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:40.454187+0000","last_change":"2024-05-15T14:49:40.454217+0000","last_active":"2024-05-15T14:49:40.454187+0000","last_peered":"2024-05-15T14:49:40.454187+0000","last_clean":"2024-05-15T14:49:40.454187+0000","last_became_active":"2024-05-15T14:27:50.849731+0000","last_became_peered":"2024-05-15T14:27:50.849731+0000","last_unstale":"2024-05-15T14:49:40.454187+0000","last_undegraded":"2024-05-15T14:49:40.454187+0000","last_fullsized":"2024-05-15T14:49:40.454187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:40.454087+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:40.454087+0000","last_clean_scrub_stamp":"2024-05-15T14:49:40.454087+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:47:16.424071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":50,"num_write":130,"num_write_kb":35292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.696735+0000","last_change":"2024-05-15T14:49:22.696760+0000","last_active":"2024-05-15T14:49:22.696735+0000","last_peered":"2024-05-15T14:49:22.696735+0000","last_clean":"2024-05-15T14:49:22.696735+0000","last_became_active":"2024-05-15T14:27:56.878611+0000","last_became_peered":"2024-05-15T14:27:56.878611+0000","last_unstale":"2024-05-15T14:49:22.696735+0000","last_undegraded":"2024-05-15T14:49:22.696735+0000","last_fullsized":"2024-05-15T14:49:22.696735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.696623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.696623+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.696623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:38.799072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"39'354","reported_seq":3199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.975561+0000","last_change":"2024-05-15T14:49:09.975561+0000","last_active":"2024-05-15T14:49:09.975561+0000","last_peered":"2024-05-15T14:49:09.975561+0000","last_clean":"2024-05-15T14:49:09.975561+0000","last_became_active":"2024-05-15T14:27:58.884237+0000","last_became_peered":"2024-05-15T14:27:58.884237+0000","last_unstale":"2024-05-15T14:49:09.975561+0000","last_undegraded":"2024-05-15T14:49:09.975561+0000","last_fullsized":"2024-05-15T14:49:09.975561+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'354","last_scrub_stamp":"2024-05-15T14:49:09.975429+0000","last_deep_scrub":"39'354","last_deep_scrub_stamp":"2024-05-15T14:49:09.975429+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.975429+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:07.818959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":8049,"num_read_kb":5529,"num_write":261,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2876,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.100873+0000","last_change":"2024-05-15T14:49:06.100873+0000","last_active":"2024-05-15T14:49:06.100873+0000","last_peered":"2024-05-15T14:49:06.100873+0000","last_clean":"2024-05-15T14:49:06.100873+0000","last_became_active":"2024-05-15T14:28:00.886539+0000","last_became_peered":"2024-05-15T14:28:00.886539+0000","last_unstale":"2024-05-15T14:49:06.100873+0000","last_undegraded":"2024-05-15T14:49:06.100873+0000","last_fullsized":"2024-05-15T14:49:06.100873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.100716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.100716+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.100716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:03.944246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"39'22","reported_seq":72,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.146255+0000","last_change":"2024-05-15T14:49:26.146255+0000","last_active":"2024-05-15T14:49:26.146255+0000","last_peered":"2024-05-15T14:49:26.146255+0000","last_clean":"2024-05-15T14:49:26.146255+0000","last_became_active":"2024-05-15T14:28:02.892076+0000","last_became_peered":"2024-05-15T14:28:02.892076+0000","last_unstale":"2024-05-15T14:49:26.146255+0000","last_undegraded":"2024-05-15T14:49:26.146255+0000","last_fullsized":"2024-05-15T14:49:26.146255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:26.146097+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:26.146097+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.146097+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:49.883540+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.b","version":"39'3","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:44.481387+0000","last_change":"2024-05-15T14:49:44.481432+0000","last_active":"2024-05-15T14:49:44.481387+0000","last_peered":"2024-05-15T14:49:44.481387+0000","last_clean":"2024-05-15T14:49:44.481387+0000","last_became_active":"2024-05-15T14:31:16.592325+0000","last_became_peered":"2024-05-15T14:31:16.592325+0000","last_unstale":"2024-05-15T14:49:44.481387+0000","last_undegraded":"2024-05-15T14:49:44.481387+0000","last_fullsized":"2024-05-15T14:49:44.481387+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-05-15T14:49:44.481259+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-05-15T14:49:44.481259+0000","last_clean_scrub_stamp":"2024-05-15T14:49:44.481259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:59:56.280628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'26","reported_seq":141,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.181514+0000","last_change":"2024-05-15T14:49:15.181514+0000","last_active":"2024-05-15T14:49:15.181514+0000","last_peered":"2024-05-15T14:49:15.181514+0000","last_clean":"2024-05-15T14:49:15.181514+0000","last_became_active":"2024-05-15T14:27:52.858631+0000","last_became_peered":"2024-05-15T14:27:52.858631+0000","last_unstale":"2024-05-15T14:49:15.181514+0000","last_undegraded":"2024-05-15T14:49:15.181514+0000","last_fullsized":"2024-05-15T14:49:15.181514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.181369+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.181369+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.181369+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:23.248736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.598516+0000","last_change":"2024-05-15T14:49:29.598516+0000","last_active":"2024-05-15T14:49:29.598516+0000","last_peered":"2024-05-15T14:49:29.598516+0000","last_clean":"2024-05-15T14:49:29.598516+0000","last_became_active":"2024-05-15T14:27:44.809888+0000","last_became_peered":"2024-05-15T14:27:44.809888+0000","last_unstale":"2024-05-15T14:49:29.598516+0000","last_undegraded":"2024-05-15T14:49:29.598516+0000","last_fullsized":"2024-05-15T14:49:29.598516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:29.598393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:29.598393+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.598393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:10:35.233991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'9","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.246523+0000","last_change":"2024-05-15T14:49:31.246550+0000","last_active":"2024-05-15T14:49:31.246523+0000","last_peered":"2024-05-15T14:49:31.246523+0000","last_clean":"2024-05-15T14:49:31.246523+0000","last_became_active":"2024-05-15T14:27:50.833509+0000","last_became_peered":"2024-05-15T14:27:50.833509+0000","last_unstale":"2024-05-15T14:49:31.246523+0000","last_undegraded":"2024-05-15T14:49:31.246523+0000","last_fullsized":"2024-05-15T14:49:31.246523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'9","last_scrub_stamp":"2024-05-15T14:49:31.246424+0000","last_deep_scrub":"39'9","last_deep_scrub_stamp":"2024-05-15T14:49:31.246424+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.246424+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:37:15.619769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":37,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.092794+0000","last_change":"2024-05-15T14:49:20.092794+0000","last_active":"2024-05-15T14:49:20.092794+0000","last_peered":"2024-05-15T14:49:20.092794+0000","last_clean":"2024-05-15T14:49:20.092794+0000","last_became_active":"2024-05-15T14:27:56.876526+0000","last_became_peered":"2024-05-15T14:27:56.876526+0000","last_unstale":"2024-05-15T14:49:20.092794+0000","last_undegraded":"2024-05-15T14:49:20.092794+0000","last_fullsized":"2024-05-15T14:49:20.092794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:20.092624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:20.092624+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.092624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:36.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"39'1105","reported_seq":2239,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.104318+0000","last_change":"2024-05-15T14:49:10.104373+0000","last_active":"2024-05-15T14:49:10.104318+0000","last_peered":"2024-05-15T14:49:10.104318+0000","last_clean":"2024-05-15T14:49:10.104318+0000","last_became_active":"2024-05-15T14:27:58.887083+0000","last_became_peered":"2024-05-15T14:27:58.887083+0000","last_unstale":"2024-05-15T14:49:10.104318+0000","last_undegraded":"2024-05-15T14:49:10.104318+0000","last_fullsized":"2024-05-15T14:49:10.104318+0000","mapping_epoch":26,"log_start":"39'1000","ondisk_log_start":"39'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'1105","last_scrub_stamp":"2024-05-15T14:49:10.104218+0000","last_deep_scrub":"39'1105","last_deep_scrub_stamp":"2024-05-15T14:49:10.104218+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.104218+0000","objects_scrubbed":11,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:30.050249+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1728,"num_read_kb":1712,"num_write":408,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.957705+0000","last_change":"2024-05-15T14:49:04.957756+0000","last_active":"2024-05-15T14:49:04.957705+0000","last_peered":"2024-05-15T14:49:04.957705+0000","last_clean":"2024-05-15T14:49:04.957705+0000","last_became_active":"2024-05-15T14:28:00.890321+0000","last_became_peered":"2024-05-15T14:28:00.890321+0000","last_unstale":"2024-05-15T14:49:04.957705+0000","last_undegraded":"2024-05-15T14:49:04.957705+0000","last_fullsized":"2024-05-15T14:49:04.957705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.957607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.957607+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.957607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:35.222322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"39'20","reported_seq":71,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.124836+0000","last_change":"2024-05-15T14:49:01.124836+0000","last_active":"2024-05-15T14:49:01.124836+0000","last_peered":"2024-05-15T14:49:01.124836+0000","last_clean":"2024-05-15T14:49:01.124836+0000","last_became_active":"2024-05-15T14:28:02.883249+0000","last_became_peered":"2024-05-15T14:28:02.883249+0000","last_unstale":"2024-05-15T14:49:01.124836+0000","last_undegraded":"2024-05-15T14:49:01.124836+0000","last_fullsized":"2024-05-15T14:49:01.124836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:01.124687+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:01.124687+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.124687+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:37.809153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:43.046610+0000","last_change":"2024-05-15T14:49:43.046652+0000","last_active":"2024-05-15T14:49:43.046610+0000","last_peered":"2024-05-15T14:49:43.046610+0000","last_clean":"2024-05-15T14:49:43.046610+0000","last_became_active":"2024-05-15T14:31:16.593500+0000","last_became_peered":"2024-05-15T14:31:16.593500+0000","last_unstale":"2024-05-15T14:49:43.046610+0000","last_undegraded":"2024-05-15T14:49:43.046610+0000","last_fullsized":"2024-05-15T14:49:43.046610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:43.046488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:43.046488+0000","last_clean_scrub_stamp":"2024-05-15T14:49:43.046488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:01:05.830616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"39'14","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.041346+0000","last_change":"2024-05-15T14:49:13.041346+0000","last_active":"2024-05-15T14:49:13.041346+0000","last_peered":"2024-05-15T14:49:13.041346+0000","last_clean":"2024-05-15T14:49:13.041346+0000","last_became_active":"2024-05-15T14:27:52.844149+0000","last_became_peered":"2024-05-15T14:27:52.844149+0000","last_unstale":"2024-05-15T14:49:13.041346+0000","last_undegraded":"2024-05-15T14:49:13.041346+0000","last_fullsized":"2024-05-15T14:49:13.041346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:13.041221+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:13.041221+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.041221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:39.891498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.377083+0000","last_change":"2024-05-15T14:49:06.377115+0000","last_active":"2024-05-15T14:49:06.377083+0000","last_peered":"2024-05-15T14:49:06.377083+0000","last_clean":"2024-05-15T14:49:06.377083+0000","last_became_active":"2024-05-15T14:27:45.305280+0000","last_became_peered":"2024-05-15T14:27:45.305280+0000","last_unstale":"2024-05-15T14:49:06.377083+0000","last_undegraded":"2024-05-15T14:49:06.377083+0000","last_fullsized":"2024-05-15T14:49:06.377083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.376986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.376986+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.376986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:34:08.760321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"39'16","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.984137+0000","last_change":"2024-05-15T14:49:22.984137+0000","last_active":"2024-05-15T14:49:22.984137+0000","last_peered":"2024-05-15T14:49:22.984137+0000","last_clean":"2024-05-15T14:49:22.984137+0000","last_became_active":"2024-05-15T14:27:50.844771+0000","last_became_peered":"2024-05-15T14:27:50.844771+0000","last_unstale":"2024-05-15T14:49:22.984137+0000","last_undegraded":"2024-05-15T14:49:22.984137+0000","last_fullsized":"2024-05-15T14:49:22.984137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:22.984002+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:22.984002+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.984002+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:36.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"39'15","reported_seq":735,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.399123+0000","last_change":"2024-05-15T14:49:03.399123+0000","last_active":"2024-05-15T14:49:03.399123+0000","last_peered":"2024-05-15T14:49:03.399123+0000","last_clean":"2024-05-15T14:49:03.399123+0000","last_became_active":"2024-05-15T14:27:56.880109+0000","last_became_peered":"2024-05-15T14:27:56.880109+0000","last_unstale":"2024-05-15T14:49:03.399123+0000","last_undegraded":"2024-05-15T14:49:03.399123+0000","last_fullsized":"2024-05-15T14:49:03.399123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2024-05-15T14:49:03.399009+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2024-05-15T14:49:03.399009+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.399009+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:30:51.827026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":702,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"39'279","reported_seq":780,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.913793+0000","last_change":"2024-05-15T14:49:08.913863+0000","last_active":"2024-05-15T14:49:08.913793+0000","last_peered":"2024-05-15T14:49:08.913793+0000","last_clean":"2024-05-15T14:49:08.913793+0000","last_became_active":"2024-05-15T14:27:58.888477+0000","last_became_peered":"2024-05-15T14:27:58.888477+0000","last_unstale":"2024-05-15T14:49:08.913793+0000","last_undegraded":"2024-05-15T14:49:08.913793+0000","last_fullsized":"2024-05-15T14:49:08.913793+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'279","last_scrub_stamp":"2024-05-15T14:49:08.913654+0000","last_deep_scrub":"39'279","last_deep_scrub_stamp":"2024-05-15T14:49:08.913654+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.913654+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:35.763932+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":400,"num_read_kb":392,"num_write":265,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.161705+0000","last_change":"2024-05-15T14:49:11.161731+0000","last_active":"2024-05-15T14:49:11.161705+0000","last_peered":"2024-05-15T14:49:11.161705+0000","last_clean":"2024-05-15T14:49:11.161705+0000","last_became_active":"2024-05-15T14:28:00.880488+0000","last_became_peered":"2024-05-15T14:28:00.880488+0000","last_unstale":"2024-05-15T14:49:11.161705+0000","last_undegraded":"2024-05-15T14:49:11.161705+0000","last_fullsized":"2024-05-15T14:49:11.161705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:11.161591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:11.161591+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.161591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:31.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'21","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.651522+0000","last_change":"2024-05-15T14:49:12.651546+0000","last_active":"2024-05-15T14:49:12.651522+0000","last_peered":"2024-05-15T14:49:12.651522+0000","last_clean":"2024-05-15T14:49:12.651522+0000","last_became_active":"2024-05-15T14:28:02.893812+0000","last_became_peered":"2024-05-15T14:28:02.893812+0000","last_unstale":"2024-05-15T14:49:12.651522+0000","last_undegraded":"2024-05-15T14:49:12.651522+0000","last_fullsized":"2024-05-15T14:49:12.651522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'21","last_scrub_stamp":"2024-05-15T14:49:12.651430+0000","last_deep_scrub":"39'21","last_deep_scrub_stamp":"2024-05-15T14:49:12.651430+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.651430+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:16.036367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":112,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:41.428283+0000","last_change":"2024-05-15T14:49:41.428309+0000","last_active":"2024-05-15T14:49:41.428283+0000","last_peered":"2024-05-15T14:49:41.428283+0000","last_clean":"2024-05-15T14:49:41.428283+0000","last_became_active":"2024-05-15T14:31:16.589610+0000","last_became_peered":"2024-05-15T14:31:16.589610+0000","last_unstale":"2024-05-15T14:49:41.428283+0000","last_undegraded":"2024-05-15T14:49:41.428283+0000","last_fullsized":"2024-05-15T14:49:41.428283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:41.428185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:41.428185+0000","last_clean_scrub_stamp":"2024-05-15T14:49:41.428185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:24:46.801884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"39'4","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.055419+0000","last_change":"2024-05-15T14:49:17.055450+0000","last_active":"2024-05-15T14:49:17.055419+0000","last_peered":"2024-05-15T14:49:17.055419+0000","last_clean":"2024-05-15T14:49:17.055419+0000","last_became_active":"2024-05-15T14:27:52.839722+0000","last_became_peered":"2024-05-15T14:27:52.839722+0000","last_unstale":"2024-05-15T14:49:17.055419+0000","last_undegraded":"2024-05-15T14:49:17.055419+0000","last_fullsized":"2024-05-15T14:49:17.055419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:17.055311+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:17.055311+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.055311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:14.898841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.012122+0000","last_change":"2024-05-15T14:49:31.012146+0000","last_active":"2024-05-15T14:49:31.012122+0000","last_peered":"2024-05-15T14:49:31.012122+0000","last_clean":"2024-05-15T14:49:31.012122+0000","last_became_active":"2024-05-15T14:27:44.809777+0000","last_became_peered":"2024-05-15T14:27:44.809777+0000","last_unstale":"2024-05-15T14:49:31.012122+0000","last_undegraded":"2024-05-15T14:49:31.012122+0000","last_fullsized":"2024-05-15T14:49:31.012122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:31.012020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:31.012020+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.012020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:34.137354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'16","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.231777+0000","last_change":"2024-05-15T14:49:25.231800+0000","last_active":"2024-05-15T14:49:25.231777+0000","last_peered":"2024-05-15T14:49:25.231777+0000","last_clean":"2024-05-15T14:49:25.231777+0000","last_became_active":"2024-05-15T14:27:50.836731+0000","last_became_peered":"2024-05-15T14:27:50.836731+0000","last_unstale":"2024-05-15T14:49:25.231777+0000","last_undegraded":"2024-05-15T14:49:25.231777+0000","last_fullsized":"2024-05-15T14:49:25.231777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:25.231680+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:25.231680+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.231680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:01.652066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.169731+0000","last_change":"2024-05-15T14:49:21.169756+0000","last_active":"2024-05-15T14:49:21.169731+0000","last_peered":"2024-05-15T14:49:21.169731+0000","last_clean":"2024-05-15T14:49:21.169731+0000","last_became_active":"2024-05-15T14:27:56.880118+0000","last_became_peered":"2024-05-15T14:27:56.880118+0000","last_unstale":"2024-05-15T14:49:21.169731+0000","last_undegraded":"2024-05-15T14:49:21.169731+0000","last_fullsized":"2024-05-15T14:49:21.169731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.169636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.169636+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.169636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:24.554573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"39'336","reported_seq":83291,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.635265+0000","last_change":"2024-05-15T14:49:13.635265+0000","last_active":"2024-05-15T14:49:13.635265+0000","last_peered":"2024-05-15T14:49:13.635265+0000","last_clean":"2024-05-15T14:49:13.635265+0000","last_became_active":"2024-05-15T14:27:58.882039+0000","last_became_peered":"2024-05-15T14:27:58.882039+0000","last_unstale":"2024-05-15T14:49:13.635265+0000","last_undegraded":"2024-05-15T14:49:13.635265+0000","last_fullsized":"2024-05-15T14:49:13.635265+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'336","last_scrub_stamp":"2024-05-15T14:49:13.635123+0000","last_deep_scrub":"39'336","last_deep_scrub_stamp":"2024-05-15T14:49:13.635123+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.635123+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:46.736637+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207654,"num_read_kb":557003,"num_write":353,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.107779+0000","last_change":"2024-05-15T14:49:21.107779+0000","last_active":"2024-05-15T14:49:21.107779+0000","last_peered":"2024-05-15T14:49:21.107779+0000","last_clean":"2024-05-15T14:49:21.107779+0000","last_became_active":"2024-05-15T14:28:00.887095+0000","last_became_peered":"2024-05-15T14:28:00.887095+0000","last_unstale":"2024-05-15T14:49:21.107779+0000","last_undegraded":"2024-05-15T14:49:21.107779+0000","last_fullsized":"2024-05-15T14:49:21.107779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.107618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.107618+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.107618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:39.068756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"39'15","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.884290+0000","last_change":"2024-05-15T14:49:03.884290+0000","last_active":"2024-05-15T14:49:03.884290+0000","last_peered":"2024-05-15T14:49:03.884290+0000","last_clean":"2024-05-15T14:49:03.884290+0000","last_became_active":"2024-05-15T14:28:02.892255+0000","last_became_peered":"2024-05-15T14:28:02.892255+0000","last_unstale":"2024-05-15T14:49:03.884290+0000","last_undegraded":"2024-05-15T14:49:03.884290+0000","last_fullsized":"2024-05-15T14:49:03.884290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2024-05-15T14:49:03.884167+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2024-05-15T14:49:03.884167+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.884167+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:57:22.423172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:44.063681+0000","last_change":"2024-05-15T14:49:44.063704+0000","last_active":"2024-05-15T14:49:44.063681+0000","last_peered":"2024-05-15T14:49:44.063681+0000","last_clean":"2024-05-15T14:49:44.063681+0000","last_became_active":"2024-05-15T14:31:16.593582+0000","last_became_peered":"2024-05-15T14:31:16.593582+0000","last_unstale":"2024-05-15T14:49:44.063681+0000","last_undegraded":"2024-05-15T14:49:44.063681+0000","last_fullsized":"2024-05-15T14:49:44.063681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:44.063588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:44.063588+0000","last_clean_scrub_stamp":"2024-05-15T14:49:44.063588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:05.910659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'44","reported_seq":122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.067907+0000","last_change":"2024-05-15T14:49:07.067938+0000","last_active":"2024-05-15T14:49:07.067907+0000","last_peered":"2024-05-15T14:49:07.067907+0000","last_clean":"2024-05-15T14:49:07.067907+0000","last_became_active":"2024-05-15T14:27:52.851166+0000","last_became_peered":"2024-05-15T14:27:52.851166+0000","last_unstale":"2024-05-15T14:49:07.067907+0000","last_undegraded":"2024-05-15T14:49:07.067907+0000","last_fullsized":"2024-05-15T14:49:07.067907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'44","last_scrub_stamp":"2024-05-15T14:49:07.067797+0000","last_deep_scrub":"39'44","last_deep_scrub_stamp":"2024-05-15T14:49:07.067797+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.067797+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:04.265322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":125,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"39'8","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.432913+0000","last_change":"2024-05-15T14:49:18.432913+0000","last_active":"2024-05-15T14:49:18.432913+0000","last_peered":"2024-05-15T14:49:18.432913+0000","last_clean":"2024-05-15T14:49:18.432913+0000","last_became_active":"2024-05-15T14:28:37.941149+0000","last_became_peered":"2024-05-15T14:28:37.941149+0000","last_unstale":"2024-05-15T14:49:18.432913+0000","last_undegraded":"2024-05-15T14:49:18.432913+0000","last_fullsized":"2024-05-15T14:49:18.432913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:18.432781+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:18.432781+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.432781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:47:36.672014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11,"num_write":32,"num_write_kb":12919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.039657+0000","last_change":"2024-05-15T14:49:19.039683+0000","last_active":"2024-05-15T14:49:19.039657+0000","last_peered":"2024-05-15T14:49:19.039657+0000","last_clean":"2024-05-15T14:49:19.039657+0000","last_became_active":"2024-05-15T14:27:45.304891+0000","last_became_peered":"2024-05-15T14:27:45.304891+0000","last_unstale":"2024-05-15T14:49:19.039657+0000","last_undegraded":"2024-05-15T14:49:19.039657+0000","last_fullsized":"2024-05-15T14:49:19.039657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:19.039556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:19.039556+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.039556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:39.599575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.255292+0000","last_change":"2024-05-15T14:49:23.255319+0000","last_active":"2024-05-15T14:49:23.255292+0000","last_peered":"2024-05-15T14:49:23.255292+0000","last_clean":"2024-05-15T14:49:23.255292+0000","last_became_active":"2024-05-15T14:27:56.881083+0000","last_became_peered":"2024-05-15T14:27:56.881083+0000","last_unstale":"2024-05-15T14:49:23.255292+0000","last_undegraded":"2024-05-15T14:49:23.255292+0000","last_fullsized":"2024-05-15T14:49:23.255292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:23.255168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:23.255168+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.255168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:54:19.736551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"39'495","reported_seq":961,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.375580+0000","last_change":"2024-05-15T14:49:39.375634+0000","last_active":"2024-05-15T14:49:39.375580+0000","last_peered":"2024-05-15T14:49:39.375580+0000","last_clean":"2024-05-15T14:49:39.375580+0000","last_became_active":"2024-05-15T14:27:58.883886+0000","last_became_peered":"2024-05-15T14:27:58.883886+0000","last_unstale":"2024-05-15T14:49:39.375580+0000","last_undegraded":"2024-05-15T14:49:39.375580+0000","last_fullsized":"2024-05-15T14:49:39.375580+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'495","last_scrub_stamp":"2024-05-15T14:49:39.375484+0000","last_deep_scrub":"39'495","last_deep_scrub_stamp":"2024-05-15T14:49:39.375484+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.375484+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:01:02.159612+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1031,"num_read_kb":1287,"num_write":497,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1490,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.420978+0000","last_change":"2024-05-15T14:49:02.421002+0000","last_active":"2024-05-15T14:49:02.420978+0000","last_peered":"2024-05-15T14:49:02.420978+0000","last_clean":"2024-05-15T14:49:02.420978+0000","last_became_active":"2024-05-15T14:28:00.884315+0000","last_became_peered":"2024-05-15T14:28:00.884315+0000","last_unstale":"2024-05-15T14:49:02.420978+0000","last_undegraded":"2024-05-15T14:49:02.420978+0000","last_fullsized":"2024-05-15T14:49:02.420978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:02.420884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:02.420884+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.420884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:35:34.607185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"39'38","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.066817+0000","last_change":"2024-05-15T14:49:02.066854+0000","last_active":"2024-05-15T14:49:02.066817+0000","last_peered":"2024-05-15T14:49:02.066817+0000","last_clean":"2024-05-15T14:49:02.066817+0000","last_became_active":"2024-05-15T14:28:02.889093+0000","last_became_peered":"2024-05-15T14:28:02.889093+0000","last_unstale":"2024-05-15T14:49:02.066817+0000","last_undegraded":"2024-05-15T14:49:02.066817+0000","last_fullsized":"2024-05-15T14:49:02.066817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'38","last_scrub_stamp":"2024-05-15T14:49:02.066732+0000","last_deep_scrub":"39'38","last_deep_scrub_stamp":"2024-05-15T14:49:02.066732+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.066732+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:17:37.278158+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":151,"num_write":63,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.538178+0000","last_change":"2024-05-15T14:49:21.538178+0000","last_active":"2024-05-15T14:49:21.538178+0000","last_peered":"2024-05-15T14:49:21.538178+0000","last_clean":"2024-05-15T14:49:21.538178+0000","last_became_active":"2024-05-15T14:31:38.626777+0000","last_became_peered":"2024-05-15T14:31:38.626777+0000","last_unstale":"2024-05-15T14:49:21.538178+0000","last_undegraded":"2024-05-15T14:49:21.538178+0000","last_fullsized":"2024-05-15T14:49:21.538178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:21.538058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:21.538058+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.538058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:32:37.577496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'50","reported_seq":150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.304160+0000","last_change":"2024-05-15T14:49:24.304181+0000","last_active":"2024-05-15T14:49:24.304160+0000","last_peered":"2024-05-15T14:49:24.304160+0000","last_clean":"2024-05-15T14:49:24.304160+0000","last_became_active":"2024-05-15T14:27:52.846171+0000","last_became_peered":"2024-05-15T14:27:52.846171+0000","last_unstale":"2024-05-15T14:49:24.304160+0000","last_undegraded":"2024-05-15T14:49:24.304160+0000","last_fullsized":"2024-05-15T14:49:24.304160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'50","last_scrub_stamp":"2024-05-15T14:49:24.304084+0000","last_deep_scrub":"39'50","last_deep_scrub_stamp":"2024-05-15T14:49:24.304084+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.304084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:24.307977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":163,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.994668+0000","last_change":"2024-05-15T14:49:21.994695+0000","last_active":"2024-05-15T14:49:21.994668+0000","last_peered":"2024-05-15T14:49:21.994668+0000","last_clean":"2024-05-15T14:49:21.994668+0000","last_became_active":"2024-05-15T14:27:50.844741+0000","last_became_peered":"2024-05-15T14:27:50.844741+0000","last_unstale":"2024-05-15T14:49:21.994668+0000","last_undegraded":"2024-05-15T14:49:21.994668+0000","last_fullsized":"2024-05-15T14:49:21.994668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:21.994566+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:21.994566+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.994566+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:42.240091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":30,"num_write":80,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.590372+0000","last_change":"2024-05-15T14:49:30.590397+0000","last_active":"2024-05-15T14:49:30.590372+0000","last_peered":"2024-05-15T14:49:30.590372+0000","last_clean":"2024-05-15T14:49:30.590372+0000","last_became_active":"2024-05-15T14:27:45.305029+0000","last_became_peered":"2024-05-15T14:27:45.305029+0000","last_unstale":"2024-05-15T14:49:30.590372+0000","last_undegraded":"2024-05-15T14:49:30.590372+0000","last_fullsized":"2024-05-15T14:49:30.590372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:30.590286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:30.590286+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.590286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:10:10.662867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.142539+0000","last_change":"2024-05-15T14:49:05.142566+0000","last_active":"2024-05-15T14:49:05.142539+0000","last_peered":"2024-05-15T14:49:05.142539+0000","last_clean":"2024-05-15T14:49:05.142539+0000","last_became_active":"2024-05-15T14:27:56.880842+0000","last_became_peered":"2024-05-15T14:27:56.880842+0000","last_unstale":"2024-05-15T14:49:05.142539+0000","last_undegraded":"2024-05-15T14:49:05.142539+0000","last_fullsized":"2024-05-15T14:49:05.142539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:05.142451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:05.142451+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.142451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:12:52.024230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"39'499","reported_seq":504335,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.043159+0000","last_change":"2024-05-15T14:49:08.043210+0000","last_active":"2024-05-15T14:49:08.043159+0000","last_peered":"2024-05-15T14:49:08.043159+0000","last_clean":"2024-05-15T14:49:08.043159+0000","last_became_active":"2024-05-15T14:27:58.882284+0000","last_became_peered":"2024-05-15T14:27:58.882284+0000","last_unstale":"2024-05-15T14:49:08.043159+0000","last_undegraded":"2024-05-15T14:49:08.043159+0000","last_fullsized":"2024-05-15T14:49:08.043159+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'499","last_scrub_stamp":"2024-05-15T14:49:08.043071+0000","last_deep_scrub":"39'499","last_deep_scrub_stamp":"2024-05-15T14:49:08.043071+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.043071+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:35:40.229372+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1259744,"num_read_kb":3777635,"num_write":703,"num_write_kb":2009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"39'927","reported_seq":1381,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.919023+0000","last_change":"2024-05-15T14:49:06.919050+0000","last_active":"2024-05-15T14:49:06.919023+0000","last_peered":"2024-05-15T14:49:06.919023+0000","last_clean":"2024-05-15T14:49:06.919023+0000","last_became_active":"2024-05-15T14:28:00.891484+0000","last_became_peered":"2024-05-15T14:28:00.891484+0000","last_unstale":"2024-05-15T14:49:06.919023+0000","last_undegraded":"2024-05-15T14:49:06.919023+0000","last_fullsized":"2024-05-15T14:49:06.919023+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:06.918936+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:06.918936+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.918936+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:24.880073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"39'19","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.637621+0000","last_change":"2024-05-15T14:49:04.637650+0000","last_active":"2024-05-15T14:49:04.637621+0000","last_peered":"2024-05-15T14:49:04.637621+0000","last_clean":"2024-05-15T14:49:04.637621+0000","last_became_active":"2024-05-15T14:28:02.891380+0000","last_became_peered":"2024-05-15T14:28:02.891380+0000","last_unstale":"2024-05-15T14:49:04.637621+0000","last_undegraded":"2024-05-15T14:49:04.637621+0000","last_fullsized":"2024-05-15T14:49:04.637621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'19","last_scrub_stamp":"2024-05-15T14:49:04.637527+0000","last_deep_scrub":"39'19","last_deep_scrub_stamp":"2024-05-15T14:49:04.637527+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.637527+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:27.567433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":35,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:42.562311+0000","last_change":"2024-05-15T14:49:42.562333+0000","last_active":"2024-05-15T14:49:42.562311+0000","last_peered":"2024-05-15T14:49:42.562311+0000","last_clean":"2024-05-15T14:49:42.562311+0000","last_became_active":"2024-05-15T14:31:16.593811+0000","last_became_peered":"2024-05-15T14:31:16.593811+0000","last_unstale":"2024-05-15T14:49:42.562311+0000","last_undegraded":"2024-05-15T14:49:42.562311+0000","last_fullsized":"2024-05-15T14:49:42.562311+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:42.562185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:42.562185+0000","last_clean_scrub_stamp":"2024-05-15T14:49:42.562185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:02:31.218199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"39'18","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.480417+0000","last_change":"2024-05-15T14:49:19.480444+0000","last_active":"2024-05-15T14:49:19.480417+0000","last_peered":"2024-05-15T14:49:19.480417+0000","last_clean":"2024-05-15T14:49:19.480417+0000","last_became_active":"2024-05-15T14:28:37.942459+0000","last_became_peered":"2024-05-15T14:28:37.942459+0000","last_unstale":"2024-05-15T14:49:19.480417+0000","last_undegraded":"2024-05-15T14:49:19.480417+0000","last_fullsized":"2024-05-15T14:49:19.480417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:19.480325+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:19.480325+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.480325+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:55:42.780117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"39'10","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.604755+0000","last_change":"2024-05-15T14:49:31.604755+0000","last_active":"2024-05-15T14:49:31.604755+0000","last_peered":"2024-05-15T14:49:31.604755+0000","last_clean":"2024-05-15T14:49:31.604755+0000","last_became_active":"2024-05-15T14:27:50.854248+0000","last_became_peered":"2024-05-15T14:27:50.854248+0000","last_unstale":"2024-05-15T14:49:31.604755+0000","last_undegraded":"2024-05-15T14:49:31.604755+0000","last_fullsized":"2024-05-15T14:49:31.604755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:31.604587+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:31.604587+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.604587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:37:28.855030+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":50,"num_write_kb":8823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.070481+0000","last_change":"2024-05-15T14:49:18.070481+0000","last_active":"2024-05-15T14:49:18.070481+0000","last_peered":"2024-05-15T14:49:18.070481+0000","last_clean":"2024-05-15T14:49:18.070481+0000","last_became_active":"2024-05-15T14:27:44.808426+0000","last_became_peered":"2024-05-15T14:27:44.808426+0000","last_unstale":"2024-05-15T14:49:18.070481+0000","last_undegraded":"2024-05-15T14:49:18.070481+0000","last_fullsized":"2024-05-15T14:49:18.070481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:18.070336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:18.070336+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.070336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:11.212528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'2","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.264379+0000","last_change":"2024-05-15T14:49:16.264411+0000","last_active":"2024-05-15T14:49:16.264379+0000","last_peered":"2024-05-15T14:49:16.264379+0000","last_clean":"2024-05-15T14:49:16.264379+0000","last_became_active":"2024-05-15T14:27:56.875993+0000","last_became_peered":"2024-05-15T14:27:56.875993+0000","last_unstale":"2024-05-15T14:49:16.264379+0000","last_undegraded":"2024-05-15T14:49:16.264379+0000","last_fullsized":"2024-05-15T14:49:16.264379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:16.264296+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:16.264296+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.264296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:36.509821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"39'231","reported_seq":398,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.406389+0000","last_change":"2024-05-15T14:49:04.406424+0000","last_active":"2024-05-15T14:49:04.406389+0000","last_peered":"2024-05-15T14:49:04.406389+0000","last_clean":"2024-05-15T14:49:04.406389+0000","last_became_active":"2024-05-15T14:27:58.885090+0000","last_became_peered":"2024-05-15T14:27:58.885090+0000","last_unstale":"2024-05-15T14:49:04.406389+0000","last_undegraded":"2024-05-15T14:49:04.406389+0000","last_fullsized":"2024-05-15T14:49:04.406389+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'231","last_scrub_stamp":"2024-05-15T14:49:04.406300+0000","last_deep_scrub":"39'231","last_deep_scrub_stamp":"2024-05-15T14:49:04.406300+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.406300+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:24.352331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":336,"num_read_kb":330,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"39'927","reported_seq":1454,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.655551+0000","last_change":"2024-05-15T14:49:05.655578+0000","last_active":"2024-05-15T14:49:05.655551+0000","last_peered":"2024-05-15T14:49:05.655551+0000","last_clean":"2024-05-15T14:49:05.655551+0000","last_became_active":"2024-05-15T14:28:00.884286+0000","last_became_peered":"2024-05-15T14:28:00.884286+0000","last_unstale":"2024-05-15T14:49:05.655551+0000","last_undegraded":"2024-05-15T14:49:05.655551+0000","last_fullsized":"2024-05-15T14:49:05.655551+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:05.655463+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:05.655463+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.655463+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:39.495556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"39'25","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.065980+0000","last_change":"2024-05-15T14:49:05.066012+0000","last_active":"2024-05-15T14:49:05.065980+0000","last_peered":"2024-05-15T14:49:05.065980+0000","last_clean":"2024-05-15T14:49:05.065980+0000","last_became_active":"2024-05-15T14:28:02.891822+0000","last_became_peered":"2024-05-15T14:28:02.891822+0000","last_unstale":"2024-05-15T14:49:05.065980+0000","last_undegraded":"2024-05-15T14:49:05.065980+0000","last_fullsized":"2024-05-15T14:49:05.065980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:05.065867+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:05.065867+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.065867+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:26.544217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:49.438094+0000","last_change":"2024-05-15T14:49:49.438118+0000","last_active":"2024-05-15T14:49:49.438094+0000","last_peered":"2024-05-15T14:49:49.438094+0000","last_clean":"2024-05-15T14:49:49.438094+0000","last_became_active":"2024-05-15T14:31:16.595913+0000","last_became_peered":"2024-05-15T14:31:16.595913+0000","last_unstale":"2024-05-15T14:49:49.438094+0000","last_undegraded":"2024-05-15T14:49:49.438094+0000","last_fullsized":"2024-05-15T14:49:49.438094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:49.437990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:49.437990+0000","last_clean_scrub_stamp":"2024-05-15T14:49:49.437990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:11:37.535178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"39'16","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.233902+0000","last_change":"2024-05-15T14:49:21.233931+0000","last_active":"2024-05-15T14:49:21.233902+0000","last_peered":"2024-05-15T14:49:21.233902+0000","last_clean":"2024-05-15T14:49:21.233902+0000","last_became_active":"2024-05-15T14:27:52.848087+0000","last_became_peered":"2024-05-15T14:27:52.848087+0000","last_unstale":"2024-05-15T14:49:21.233902+0000","last_undegraded":"2024-05-15T14:49:21.233902+0000","last_fullsized":"2024-05-15T14:49:21.233902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:21.233814+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:21.233814+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.233814+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:14:29.301182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.296444+0000","last_change":"2024-05-15T14:49:34.296502+0000","last_active":"2024-05-15T14:49:34.296444+0000","last_peered":"2024-05-15T14:49:34.296444+0000","last_clean":"2024-05-15T14:49:34.296444+0000","last_became_active":"2024-05-15T14:27:50.840365+0000","last_became_peered":"2024-05-15T14:27:50.840365+0000","last_unstale":"2024-05-15T14:49:34.296444+0000","last_undegraded":"2024-05-15T14:49:34.296444+0000","last_fullsized":"2024-05-15T14:49:34.296444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:34.296338+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:34.296338+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.296338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:11:24.652627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.107230+0000","last_change":"2024-05-15T14:49:13.107230+0000","last_active":"2024-05-15T14:49:13.107230+0000","last_peered":"2024-05-15T14:49:13.107230+0000","last_clean":"2024-05-15T14:49:13.107230+0000","last_became_active":"2024-05-15T14:27:44.808305+0000","last_became_peered":"2024-05-15T14:27:44.808305+0000","last_unstale":"2024-05-15T14:49:13.107230+0000","last_undegraded":"2024-05-15T14:49:13.107230+0000","last_fullsized":"2024-05-15T14:49:13.107230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:13.107116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:13.107116+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.107116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:12:26.464097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"39'13","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.677454+0000","last_change":"2024-05-15T14:49:26.677454+0000","last_active":"2024-05-15T14:49:26.677454+0000","last_peered":"2024-05-15T14:49:26.677454+0000","last_clean":"2024-05-15T14:49:26.677454+0000","last_became_active":"2024-05-15T14:27:56.875166+0000","last_became_peered":"2024-05-15T14:27:56.875166+0000","last_unstale":"2024-05-15T14:49:26.677454+0000","last_undegraded":"2024-05-15T14:49:26.677454+0000","last_fullsized":"2024-05-15T14:49:26.677454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'13","last_scrub_stamp":"2024-05-15T14:49:26.677273+0000","last_deep_scrub":"39'13","last_deep_scrub_stamp":"2024-05-15T14:49:26.677273+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.677273+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:10:53.095293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'555","reported_seq":988,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.631535+0000","last_change":"2024-05-15T14:49:24.631581+0000","last_active":"2024-05-15T14:49:24.631535+0000","last_peered":"2024-05-15T14:49:24.631535+0000","last_clean":"2024-05-15T14:49:24.631535+0000","last_became_active":"2024-05-15T14:27:58.881529+0000","last_became_peered":"2024-05-15T14:27:58.881529+0000","last_unstale":"2024-05-15T14:49:24.631535+0000","last_undegraded":"2024-05-15T14:49:24.631535+0000","last_fullsized":"2024-05-15T14:49:24.631535+0000","mapping_epoch":26,"log_start":"39'500","ondisk_log_start":"39'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'555","last_scrub_stamp":"2024-05-15T14:49:24.631445+0000","last_deep_scrub":"39'555","last_deep_scrub_stamp":"2024-05-15T14:49:24.631445+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.631445+0000","objects_scrubbed":10,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:03.208301+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":967,"num_read_kb":997,"num_write":702,"num_write_kb":2669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1242,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.611305+0000","last_change":"2024-05-15T14:49:03.611323+0000","last_active":"2024-05-15T14:49:03.611305+0000","last_peered":"2024-05-15T14:49:03.611305+0000","last_clean":"2024-05-15T14:49:03.611305+0000","last_became_active":"2024-05-15T14:28:00.890685+0000","last_became_peered":"2024-05-15T14:28:00.890685+0000","last_unstale":"2024-05-15T14:49:03.611305+0000","last_undegraded":"2024-05-15T14:49:03.611305+0000","last_fullsized":"2024-05-15T14:49:03.611305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:03.611229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:03.611229+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.611229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:17.594221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"39'29","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.911194+0000","last_change":"2024-05-15T14:49:07.911254+0000","last_active":"2024-05-15T14:49:07.911194+0000","last_peered":"2024-05-15T14:49:07.911194+0000","last_clean":"2024-05-15T14:49:07.911194+0000","last_became_active":"2024-05-15T14:28:02.893174+0000","last_became_peered":"2024-05-15T14:28:02.893174+0000","last_unstale":"2024-05-15T14:49:07.911194+0000","last_undegraded":"2024-05-15T14:49:07.911194+0000","last_fullsized":"2024-05-15T14:49:07.911194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'29","last_scrub_stamp":"2024-05-15T14:49:07.911100+0000","last_deep_scrub":"39'29","last_deep_scrub_stamp":"2024-05-15T14:49:07.911100+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.911100+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:49.443849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:45.487929+0000","last_change":"2024-05-15T14:49:45.487952+0000","last_active":"2024-05-15T14:49:45.487929+0000","last_peered":"2024-05-15T14:49:45.487929+0000","last_clean":"2024-05-15T14:49:45.487929+0000","last_became_active":"2024-05-15T14:31:16.592898+0000","last_became_peered":"2024-05-15T14:31:16.592898+0000","last_unstale":"2024-05-15T14:49:45.487929+0000","last_undegraded":"2024-05-15T14:49:45.487929+0000","last_fullsized":"2024-05-15T14:49:45.487929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:45.487838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:45.487838+0000","last_clean_scrub_stamp":"2024-05-15T14:49:45.487838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:55:32.625325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'27","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.138164+0000","last_change":"2024-05-15T14:49:09.138193+0000","last_active":"2024-05-15T14:49:09.138164+0000","last_peered":"2024-05-15T14:49:09.138164+0000","last_clean":"2024-05-15T14:49:09.138164+0000","last_became_active":"2024-05-15T14:28:02.892547+0000","last_became_peered":"2024-05-15T14:28:02.892547+0000","last_unstale":"2024-05-15T14:49:09.138164+0000","last_undegraded":"2024-05-15T14:49:09.138164+0000","last_fullsized":"2024-05-15T14:49:09.138164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'27","last_scrub_stamp":"2024-05-15T14:49:09.138074+0000","last_deep_scrub":"39'27","last_deep_scrub_stamp":"2024-05-15T14:49:09.138074+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.138074+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:32.875517+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":37,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"39'44","reported_seq":138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.351111+0000","last_change":"2024-05-15T14:49:28.351135+0000","last_active":"2024-05-15T14:49:28.351111+0000","last_peered":"2024-05-15T14:49:28.351111+0000","last_clean":"2024-05-15T14:49:28.351111+0000","last_became_active":"2024-05-15T14:27:52.842733+0000","last_became_peered":"2024-05-15T14:27:52.842733+0000","last_unstale":"2024-05-15T14:49:28.351111+0000","last_undegraded":"2024-05-15T14:49:28.351111+0000","last_fullsized":"2024-05-15T14:49:28.351111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'44","last_scrub_stamp":"2024-05-15T14:49:28.351022+0000","last_deep_scrub":"39'44","last_deep_scrub_stamp":"2024-05-15T14:49:28.351022+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.351022+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:04:01.452536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":143,"num_write":62,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"39'22","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.383276+0000","last_change":"2024-05-15T14:49:17.383276+0000","last_active":"2024-05-15T14:49:17.383276+0000","last_peered":"2024-05-15T14:49:17.383276+0000","last_clean":"2024-05-15T14:49:17.383276+0000","last_became_active":"2024-05-15T14:28:37.940961+0000","last_became_peered":"2024-05-15T14:28:37.940961+0000","last_unstale":"2024-05-15T14:49:17.383276+0000","last_undegraded":"2024-05-15T14:49:17.383276+0000","last_fullsized":"2024-05-15T14:49:17.383276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:17.383122+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:17.383122+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.383122+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:45:50.056980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":40,"num_write":102,"num_write_kb":33493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"39'3","reported_seq":1018,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.065682+0000","last_change":"2024-05-15T14:49:03.065708+0000","last_active":"2024-05-15T14:49:03.065682+0000","last_peered":"2024-05-15T14:49:03.065682+0000","last_clean":"2024-05-15T14:49:03.065682+0000","last_became_active":"2024-05-15T14:27:56.879047+0000","last_became_peered":"2024-05-15T14:27:56.879047+0000","last_unstale":"2024-05-15T14:49:03.065682+0000","last_undegraded":"2024-05-15T14:49:03.065682+0000","last_fullsized":"2024-05-15T14:49:03.065682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-05-15T14:49:03.065616+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-05-15T14:49:03.065616+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.065616+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:21:36.534785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":959,"num_read_kb":959,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"39'708","reported_seq":1172,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.657931+0000","last_change":"2024-05-15T14:49:14.657970+0000","last_active":"2024-05-15T14:49:14.657931+0000","last_peered":"2024-05-15T14:49:14.657931+0000","last_clean":"2024-05-15T14:49:14.657931+0000","last_became_active":"2024-05-15T14:27:58.881703+0000","last_became_peered":"2024-05-15T14:27:58.881703+0000","last_unstale":"2024-05-15T14:49:14.657931+0000","last_undegraded":"2024-05-15T14:49:14.657931+0000","last_fullsized":"2024-05-15T14:49:14.657931+0000","mapping_epoch":26,"log_start":"39'600","ondisk_log_start":"39'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'708","last_scrub_stamp":"2024-05-15T14:49:14.657842+0000","last_deep_scrub":"39'708","last_deep_scrub_stamp":"2024-05-15T14:49:14.657842+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.657842+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:54:11.139225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1572,"num_read_kb":3606,"num_write":909,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.681406+0000","last_change":"2024-05-15T14:49:09.681429+0000","last_active":"2024-05-15T14:49:09.681406+0000","last_peered":"2024-05-15T14:49:09.681406+0000","last_clean":"2024-05-15T14:49:09.681406+0000","last_became_active":"2024-05-15T14:28:00.883811+0000","last_became_peered":"2024-05-15T14:28:00.883811+0000","last_unstale":"2024-05-15T14:49:09.681406+0000","last_undegraded":"2024-05-15T14:49:09.681406+0000","last_fullsized":"2024-05-15T14:49:09.681406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:09.681307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:09.681307+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.681307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:28:55.391390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.794813+0000","last_change":"2024-05-15T14:49:29.794813+0000","last_active":"2024-05-15T14:49:29.794813+0000","last_peered":"2024-05-15T14:49:29.794813+0000","last_clean":"2024-05-15T14:49:29.794813+0000","last_became_active":"2024-05-15T14:31:16.592053+0000","last_became_peered":"2024-05-15T14:31:16.592053+0000","last_unstale":"2024-05-15T14:49:29.794813+0000","last_undegraded":"2024-05-15T14:49:29.794813+0000","last_fullsized":"2024-05-15T14:49:29.794813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:29.794676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:29.794676+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.794676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:06.215062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"39'30","reported_seq":81,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.665420+0000","last_change":"2024-05-15T14:49:08.665420+0000","last_active":"2024-05-15T14:49:08.665420+0000","last_peered":"2024-05-15T14:49:08.665420+0000","last_clean":"2024-05-15T14:49:08.665420+0000","last_became_active":"2024-05-15T14:28:02.894053+0000","last_became_peered":"2024-05-15T14:28:02.894053+0000","last_unstale":"2024-05-15T14:49:08.665420+0000","last_undegraded":"2024-05-15T14:49:08.665420+0000","last_fullsized":"2024-05-15T14:49:08.665420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2024-05-15T14:49:08.665299+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2024-05-15T14:49:08.665299+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.665299+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:34:32.897052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":394,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"39'12","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.079792+0000","last_change":"2024-05-15T14:49:09.079860+0000","last_active":"2024-05-15T14:49:09.079792+0000","last_peered":"2024-05-15T14:49:09.079792+0000","last_clean":"2024-05-15T14:49:09.079792+0000","last_became_active":"2024-05-15T14:27:52.849013+0000","last_became_peered":"2024-05-15T14:27:52.849013+0000","last_unstale":"2024-05-15T14:49:09.079792+0000","last_undegraded":"2024-05-15T14:49:09.079792+0000","last_fullsized":"2024-05-15T14:49:09.079792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:09.079673+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:09.079673+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.079673+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:39.344389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"39'12","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:17.777868+0000","last_change":"2024-05-15T14:49:17.777868+0000","last_active":"2024-05-15T14:49:17.777868+0000","last_peered":"2024-05-15T14:49:17.777868+0000","last_clean":"2024-05-15T14:49:17.777868+0000","last_became_active":"2024-05-15T14:27:50.852755+0000","last_became_peered":"2024-05-15T14:27:50.852755+0000","last_unstale":"2024-05-15T14:49:17.777868+0000","last_undegraded":"2024-05-15T14:49:17.777868+0000","last_fullsized":"2024-05-15T14:49:17.777868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:17.777742+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:17.777742+0000","last_clean_scrub_stamp":"2024-05-15T14:49:17.777742+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:38.023267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.560193+0000","last_change":"2024-05-15T14:49:32.560261+0000","last_active":"2024-05-15T14:49:32.560193+0000","last_peered":"2024-05-15T14:49:32.560193+0000","last_clean":"2024-05-15T14:49:32.560193+0000","last_became_active":"2024-05-15T14:27:56.883312+0000","last_became_peered":"2024-05-15T14:27:56.883312+0000","last_unstale":"2024-05-15T14:49:32.560193+0000","last_undegraded":"2024-05-15T14:49:32.560193+0000","last_fullsized":"2024-05-15T14:49:32.560193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:32.560084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:32.560084+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.560084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:24:37.933782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'161","reported_seq":222595,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.128051+0000","last_change":"2024-05-15T14:49:12.128133+0000","last_active":"2024-05-15T14:49:12.128051+0000","last_peered":"2024-05-15T14:49:12.128051+0000","last_clean":"2024-05-15T14:49:12.128051+0000","last_became_active":"2024-05-15T14:27:58.884647+0000","last_became_peered":"2024-05-15T14:27:58.884647+0000","last_unstale":"2024-05-15T14:49:12.128051+0000","last_undegraded":"2024-05-15T14:49:12.128051+0000","last_fullsized":"2024-05-15T14:49:12.128051+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'161","last_scrub_stamp":"2024-05-15T14:49:12.127934+0000","last_deep_scrub":"39'161","last_deep_scrub_stamp":"2024-05-15T14:49:12.127934+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.127934+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:26.110927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555956,"num_read_kb":2334405,"num_write":176,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1536,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.933696+0000","last_change":"2024-05-15T14:49:05.933725+0000","last_active":"2024-05-15T14:49:05.933696+0000","last_peered":"2024-05-15T14:49:05.933696+0000","last_clean":"2024-05-15T14:49:05.933696+0000","last_became_active":"2024-05-15T14:28:00.888834+0000","last_became_peered":"2024-05-15T14:28:00.888834+0000","last_unstale":"2024-05-15T14:49:05.933696+0000","last_undegraded":"2024-05-15T14:49:05.933696+0000","last_fullsized":"2024-05-15T14:49:05.933696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:05.933598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:05.933598+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.933598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:25.879629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:46.458392+0000","last_change":"2024-05-15T14:49:46.458418+0000","last_active":"2024-05-15T14:49:46.458392+0000","last_peered":"2024-05-15T14:49:46.458392+0000","last_clean":"2024-05-15T14:49:46.458392+0000","last_became_active":"2024-05-15T14:31:16.594114+0000","last_became_peered":"2024-05-15T14:31:16.594114+0000","last_unstale":"2024-05-15T14:49:46.458392+0000","last_undegraded":"2024-05-15T14:49:46.458392+0000","last_fullsized":"2024-05-15T14:49:46.458392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:46.458297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:46.458297+0000","last_clean_scrub_stamp":"2024-05-15T14:49:46.458297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:13:54.389515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"39'28","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:01.039996+0000","last_change":"2024-05-15T14:49:01.040056+0000","last_active":"2024-05-15T14:49:01.039996+0000","last_peered":"2024-05-15T14:49:01.039996+0000","last_clean":"2024-05-15T14:49:01.039996+0000","last_became_active":"2024-05-15T14:28:02.890071+0000","last_became_peered":"2024-05-15T14:28:02.890071+0000","last_unstale":"2024-05-15T14:49:01.039996+0000","last_undegraded":"2024-05-15T14:49:01.039996+0000","last_fullsized":"2024-05-15T14:49:01.039996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'28","last_scrub_stamp":"2024-05-15T14:49:01.039894+0000","last_deep_scrub":"39'28","last_deep_scrub_stamp":"2024-05-15T14:49:01.039894+0000","last_clean_scrub_stamp":"2024-05-15T14:49:01.039894+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:14:43.778244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":114,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'10","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.642434+0000","last_change":"2024-05-15T14:49:27.642458+0000","last_active":"2024-05-15T14:49:27.642434+0000","last_peered":"2024-05-15T14:49:27.642434+0000","last_clean":"2024-05-15T14:49:27.642434+0000","last_became_active":"2024-05-15T14:27:52.851940+0000","last_became_peered":"2024-05-15T14:27:52.851940+0000","last_unstale":"2024-05-15T14:49:27.642434+0000","last_undegraded":"2024-05-15T14:49:27.642434+0000","last_fullsized":"2024-05-15T14:49:27.642434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-05-15T14:49:27.642334+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-05-15T14:49:27.642334+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.642334+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:02:16.298347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"39'4","reported_seq":77,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.000032+0000","last_change":"2024-05-15T14:49:36.000032+0000","last_active":"2024-05-15T14:49:36.000032+0000","last_peered":"2024-05-15T14:49:36.000032+0000","last_clean":"2024-05-15T14:49:36.000032+0000","last_became_active":"2024-05-15T14:27:50.846362+0000","last_became_peered":"2024-05-15T14:27:50.846362+0000","last_unstale":"2024-05-15T14:49:36.000032+0000","last_undegraded":"2024-05-15T14:49:36.000032+0000","last_fullsized":"2024-05-15T14:49:36.000032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:35.999912+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:35.999912+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.999912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:52:36.947140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":5880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"39'12","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.777551+0000","last_change":"2024-05-15T14:49:18.777587+0000","last_active":"2024-05-15T14:49:18.777551+0000","last_peered":"2024-05-15T14:49:18.777551+0000","last_clean":"2024-05-15T14:49:18.777551+0000","last_became_active":"2024-05-15T14:27:56.877413+0000","last_became_peered":"2024-05-15T14:27:56.877413+0000","last_unstale":"2024-05-15T14:49:18.777551+0000","last_undegraded":"2024-05-15T14:49:18.777551+0000","last_fullsized":"2024-05-15T14:49:18.777551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:18.777443+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:18.777443+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.777443+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:34:58.968978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"39'253","reported_seq":481,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.642376+0000","last_change":"2024-05-15T14:49:15.642416+0000","last_active":"2024-05-15T14:49:15.642376+0000","last_peered":"2024-05-15T14:49:15.642376+0000","last_clean":"2024-05-15T14:49:15.642376+0000","last_became_active":"2024-05-15T14:27:58.881581+0000","last_became_peered":"2024-05-15T14:27:58.881581+0000","last_unstale":"2024-05-15T14:49:15.642376+0000","last_undegraded":"2024-05-15T14:49:15.642376+0000","last_fullsized":"2024-05-15T14:49:15.642376+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'253","last_scrub_stamp":"2024-05-15T14:49:15.642282+0000","last_deep_scrub":"39'253","last_deep_scrub_stamp":"2024-05-15T14:49:15.642282+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.642282+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:49:15.646174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":399,"num_read_kb":391,"num_write":224,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.139014+0000","last_change":"2024-05-15T14:49:22.139037+0000","last_active":"2024-05-15T14:49:22.139014+0000","last_peered":"2024-05-15T14:49:22.139014+0000","last_clean":"2024-05-15T14:49:22.139014+0000","last_became_active":"2024-05-15T14:28:00.887738+0000","last_became_peered":"2024-05-15T14:28:00.887738+0000","last_unstale":"2024-05-15T14:49:22.139014+0000","last_undegraded":"2024-05-15T14:49:22.139014+0000","last_fullsized":"2024-05-15T14:49:22.139014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:22.138922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:22.138922+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.138922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:46.513303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:42.458381+0000","last_change":"2024-05-15T14:49:42.458411+0000","last_active":"2024-05-15T14:49:42.458381+0000","last_peered":"2024-05-15T14:49:42.458381+0000","last_clean":"2024-05-15T14:49:42.458381+0000","last_became_active":"2024-05-15T14:31:16.590502+0000","last_became_peered":"2024-05-15T14:31:16.590502+0000","last_unstale":"2024-05-15T14:49:42.458381+0000","last_undegraded":"2024-05-15T14:49:42.458381+0000","last_fullsized":"2024-05-15T14:49:42.458381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:42.458288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:42.458288+0000","last_clean_scrub_stamp":"2024-05-15T14:49:42.458288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:33.225976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'26","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.018451+0000","last_change":"2024-05-15T14:49:12.018496+0000","last_active":"2024-05-15T14:49:12.018451+0000","last_peered":"2024-05-15T14:49:12.018451+0000","last_clean":"2024-05-15T14:49:12.018451+0000","last_became_active":"2024-05-15T14:28:02.894280+0000","last_became_peered":"2024-05-15T14:28:02.894280+0000","last_unstale":"2024-05-15T14:49:12.018451+0000","last_undegraded":"2024-05-15T14:49:12.018451+0000","last_fullsized":"2024-05-15T14:49:12.018451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:12.018320+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:12.018320+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.018320+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:32.578339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"39'66","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:22.686963+0000","last_change":"2024-05-15T14:49:22.686990+0000","last_active":"2024-05-15T14:49:22.686963+0000","last_peered":"2024-05-15T14:49:22.686963+0000","last_clean":"2024-05-15T14:49:22.686963+0000","last_became_active":"2024-05-15T14:27:52.862259+0000","last_became_peered":"2024-05-15T14:27:52.862259+0000","last_unstale":"2024-05-15T14:49:22.686963+0000","last_undegraded":"2024-05-15T14:49:22.686963+0000","last_fullsized":"2024-05-15T14:49:22.686963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'66","last_scrub_stamp":"2024-05-15T14:49:22.686866+0000","last_deep_scrub":"39'66","last_deep_scrub_stamp":"2024-05-15T14:49:22.686866+0000","last_clean_scrub_stamp":"2024-05-15T14:49:22.686866+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:37:07.060211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":205,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"39'8","reported_seq":84,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:35.306500+0000","last_change":"2024-05-15T14:49:35.306500+0000","last_active":"2024-05-15T14:49:35.306500+0000","last_peered":"2024-05-15T14:49:35.306500+0000","last_clean":"2024-05-15T14:49:35.306500+0000","last_became_active":"2024-05-15T14:27:50.843223+0000","last_became_peered":"2024-05-15T14:27:50.843223+0000","last_unstale":"2024-05-15T14:49:35.306500+0000","last_undegraded":"2024-05-15T14:49:35.306500+0000","last_fullsized":"2024-05-15T14:49:35.306500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:35.306360+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:35.306360+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.306360+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:11:01.724379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16,"num_write":40,"num_write_kb":8825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"39'10","reported_seq":75,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.155423+0000","last_change":"2024-05-15T14:49:03.155458+0000","last_active":"2024-05-15T14:49:03.155423+0000","last_peered":"2024-05-15T14:49:03.155423+0000","last_clean":"2024-05-15T14:49:03.155423+0000","last_became_active":"2024-05-15T14:27:56.879589+0000","last_became_peered":"2024-05-15T14:27:56.879589+0000","last_unstale":"2024-05-15T14:49:03.155423+0000","last_undegraded":"2024-05-15T14:49:03.155423+0000","last_fullsized":"2024-05-15T14:49:03.155423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:03.155336+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:03.155336+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.155336+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:22:33.777606+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"39'205","reported_seq":411,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.563563+0000","last_change":"2024-05-15T14:49:26.563595+0000","last_active":"2024-05-15T14:49:26.563563+0000","last_peered":"2024-05-15T14:49:26.563563+0000","last_clean":"2024-05-15T14:49:26.563563+0000","last_became_active":"2024-05-15T14:27:58.884831+0000","last_became_peered":"2024-05-15T14:27:58.884831+0000","last_unstale":"2024-05-15T14:49:26.563563+0000","last_undegraded":"2024-05-15T14:49:26.563563+0000","last_fullsized":"2024-05-15T14:49:26.563563+0000","mapping_epoch":26,"log_start":"39'100","ondisk_log_start":"39'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'205","last_scrub_stamp":"2024-05-15T14:49:26.563476+0000","last_deep_scrub":"39'205","last_deep_scrub_stamp":"2024-05-15T14:49:26.563476+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.563476+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:09.388395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":326,"num_write":178,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.071622+0000","last_change":"2024-05-15T14:49:04.071645+0000","last_active":"2024-05-15T14:49:04.071622+0000","last_peered":"2024-05-15T14:49:04.071622+0000","last_clean":"2024-05-15T14:49:04.071622+0000","last_became_active":"2024-05-15T14:28:00.887513+0000","last_became_peered":"2024-05-15T14:28:00.887513+0000","last_unstale":"2024-05-15T14:49:04.071622+0000","last_undegraded":"2024-05-15T14:49:04.071622+0000","last_fullsized":"2024-05-15T14:49:04.071622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.071548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.071548+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.071548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:45.604297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:45.019794+0000","last_change":"2024-05-15T14:49:45.019794+0000","last_active":"2024-05-15T14:49:45.019794+0000","last_peered":"2024-05-15T14:49:45.019794+0000","last_clean":"2024-05-15T14:49:45.019794+0000","last_became_active":"2024-05-15T14:31:16.594193+0000","last_became_peered":"2024-05-15T14:31:16.594193+0000","last_unstale":"2024-05-15T14:49:45.019794+0000","last_undegraded":"2024-05-15T14:49:45.019794+0000","last_fullsized":"2024-05-15T14:49:45.019794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:45.019620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:45.019620+0000","last_clean_scrub_stamp":"2024-05-15T14:49:45.019620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:34.520662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"39'20","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.064388+0000","last_change":"2024-05-15T14:49:08.064433+0000","last_active":"2024-05-15T14:49:08.064388+0000","last_peered":"2024-05-15T14:49:08.064388+0000","last_clean":"2024-05-15T14:49:08.064388+0000","last_became_active":"2024-05-15T14:27:52.847609+0000","last_became_peered":"2024-05-15T14:27:52.847609+0000","last_unstale":"2024-05-15T14:49:08.064388+0000","last_undegraded":"2024-05-15T14:49:08.064388+0000","last_fullsized":"2024-05-15T14:49:08.064388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:08.064289+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:08.064289+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.064289+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:12:50.814001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":78,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"39'12","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.523168+0000","last_change":"2024-05-15T14:49:33.523168+0000","last_active":"2024-05-15T14:49:33.523168+0000","last_peered":"2024-05-15T14:49:33.523168+0000","last_clean":"2024-05-15T14:49:33.523168+0000","last_became_active":"2024-05-15T14:27:50.850524+0000","last_became_peered":"2024-05-15T14:27:50.850524+0000","last_unstale":"2024-05-15T14:49:33.523168+0000","last_undegraded":"2024-05-15T14:49:33.523168+0000","last_fullsized":"2024-05-15T14:49:33.523168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:33.523047+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:33.523047+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.523047+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:24.290735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":18802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"39'13","reported_seq":162,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.291460+0000","last_change":"2024-05-15T14:49:25.291460+0000","last_active":"2024-05-15T14:49:25.291460+0000","last_peered":"2024-05-15T14:49:25.291460+0000","last_clean":"2024-05-15T14:49:25.291460+0000","last_became_active":"2024-05-15T14:27:56.881789+0000","last_became_peered":"2024-05-15T14:27:56.881789+0000","last_unstale":"2024-05-15T14:49:25.291460+0000","last_undegraded":"2024-05-15T14:49:25.291460+0000","last_fullsized":"2024-05-15T14:49:25.291460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'13","last_scrub_stamp":"2024-05-15T14:49:25.291330+0000","last_deep_scrub":"39'13","last_deep_scrub_stamp":"2024-05-15T14:49:25.291330+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.291330+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:27:19.346883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":182,"num_write":22,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"39'280","reported_seq":577,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.045043+0000","last_change":"2024-05-15T14:49:12.045140+0000","last_active":"2024-05-15T14:49:12.045043+0000","last_peered":"2024-05-15T14:49:12.045043+0000","last_clean":"2024-05-15T14:49:12.045043+0000","last_became_active":"2024-05-15T14:27:58.887134+0000","last_became_peered":"2024-05-15T14:27:58.887134+0000","last_unstale":"2024-05-15T14:49:12.045043+0000","last_undegraded":"2024-05-15T14:49:12.045043+0000","last_fullsized":"2024-05-15T14:49:12.045043+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'280","last_scrub_stamp":"2024-05-15T14:49:12.044936+0000","last_deep_scrub":"39'280","last_deep_scrub_stamp":"2024-05-15T14:49:12.044936+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.044936+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:41.078456+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":462,"num_write":228,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.950191+0000","last_change":"2024-05-15T14:49:08.950216+0000","last_active":"2024-05-15T14:49:08.950191+0000","last_peered":"2024-05-15T14:49:08.950191+0000","last_clean":"2024-05-15T14:49:08.950191+0000","last_became_active":"2024-05-15T14:28:00.885174+0000","last_became_peered":"2024-05-15T14:28:00.885174+0000","last_unstale":"2024-05-15T14:49:08.950191+0000","last_undegraded":"2024-05-15T14:49:08.950191+0000","last_fullsized":"2024-05-15T14:49:08.950191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:08.950089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:08.950089+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.950089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:33.324469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"39'31","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.650844+0000","last_change":"2024-05-15T14:49:16.650875+0000","last_active":"2024-05-15T14:49:16.650844+0000","last_peered":"2024-05-15T14:49:16.650844+0000","last_clean":"2024-05-15T14:49:16.650844+0000","last_became_active":"2024-05-15T14:28:02.894515+0000","last_became_peered":"2024-05-15T14:28:02.894515+0000","last_unstale":"2024-05-15T14:49:16.650844+0000","last_undegraded":"2024-05-15T14:49:16.650844+0000","last_fullsized":"2024-05-15T14:49:16.650844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:16.650739+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:16.650739+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.650739+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:27:10.706293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":65,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.555640+0000","last_change":"2024-05-15T14:49:38.555640+0000","last_active":"2024-05-15T14:49:38.555640+0000","last_peered":"2024-05-15T14:49:38.555640+0000","last_clean":"2024-05-15T14:49:38.555640+0000","last_became_active":"2024-05-15T14:31:16.589442+0000","last_became_peered":"2024-05-15T14:31:16.589442+0000","last_unstale":"2024-05-15T14:49:38.555640+0000","last_undegraded":"2024-05-15T14:49:38.555640+0000","last_fullsized":"2024-05-15T14:49:38.555640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:38.555483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:38.555483+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.555483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:52:39.502711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"39'56","reported_seq":150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:26.280917+0000","last_change":"2024-05-15T14:49:26.280917+0000","last_active":"2024-05-15T14:49:26.280917+0000","last_peered":"2024-05-15T14:49:26.280917+0000","last_clean":"2024-05-15T14:49:26.280917+0000","last_became_active":"2024-05-15T14:27:52.845557+0000","last_became_peered":"2024-05-15T14:27:52.845557+0000","last_unstale":"2024-05-15T14:49:26.280917+0000","last_undegraded":"2024-05-15T14:49:26.280917+0000","last_fullsized":"2024-05-15T14:49:26.280917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'56","last_scrub_stamp":"2024-05-15T14:49:26.280780+0000","last_deep_scrub":"39'56","last_deep_scrub_stamp":"2024-05-15T14:49:26.280780+0000","last_clean_scrub_stamp":"2024-05-15T14:49:26.280780+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:28.590318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":171,"num_write":80,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"39'10","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.899755+0000","last_change":"2024-05-15T14:49:24.899755+0000","last_active":"2024-05-15T14:49:24.899755+0000","last_peered":"2024-05-15T14:49:24.899755+0000","last_clean":"2024-05-15T14:49:24.899755+0000","last_became_active":"2024-05-15T14:27:50.850175+0000","last_became_peered":"2024-05-15T14:27:50.850175+0000","last_unstale":"2024-05-15T14:49:24.899755+0000","last_undegraded":"2024-05-15T14:49:24.899755+0000","last_fullsized":"2024-05-15T14:49:24.899755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:24.899631+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:24.899631+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.899631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:58.739724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.146706+0000","last_change":"2024-05-15T14:49:04.146740+0000","last_active":"2024-05-15T14:49:04.146706+0000","last_peered":"2024-05-15T14:49:04.146706+0000","last_clean":"2024-05-15T14:49:04.146706+0000","last_became_active":"2024-05-15T14:27:56.879634+0000","last_became_peered":"2024-05-15T14:27:56.879634+0000","last_unstale":"2024-05-15T14:49:04.146706+0000","last_undegraded":"2024-05-15T14:49:04.146706+0000","last_fullsized":"2024-05-15T14:49:04.146706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:04.146612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:04.146612+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.146612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:07.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"39'510","reported_seq":1267,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.911817+0000","last_change":"2024-05-15T14:49:11.911862+0000","last_active":"2024-05-15T14:49:11.911817+0000","last_peered":"2024-05-15T14:49:11.911817+0000","last_clean":"2024-05-15T14:49:11.911817+0000","last_became_active":"2024-05-15T14:27:58.887144+0000","last_became_peered":"2024-05-15T14:27:58.887144+0000","last_unstale":"2024-05-15T14:49:11.911817+0000","last_undegraded":"2024-05-15T14:49:11.911817+0000","last_fullsized":"2024-05-15T14:49:11.911817+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'510","last_scrub_stamp":"2024-05-15T14:49:11.911710+0000","last_deep_scrub":"39'510","last_deep_scrub_stamp":"2024-05-15T14:49:11.911710+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.911710+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:26:29.857106+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1003,"num_read_kb":910,"num_write":675,"num_write_kb":1754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.013369+0000","last_change":"2024-05-15T14:49:16.013393+0000","last_active":"2024-05-15T14:49:16.013369+0000","last_peered":"2024-05-15T14:49:16.013369+0000","last_clean":"2024-05-15T14:49:16.013369+0000","last_became_active":"2024-05-15T14:28:00.891343+0000","last_became_peered":"2024-05-15T14:28:00.891343+0000","last_unstale":"2024-05-15T14:49:16.013369+0000","last_undegraded":"2024-05-15T14:49:16.013369+0000","last_fullsized":"2024-05-15T14:49:16.013369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:16.013268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:16.013268+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.013268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:19:40.387649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"39'31","reported_seq":124,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:25.109805+0000","last_change":"2024-05-15T14:49:25.109828+0000","last_active":"2024-05-15T14:49:25.109805+0000","last_peered":"2024-05-15T14:49:25.109805+0000","last_clean":"2024-05-15T14:49:25.109805+0000","last_became_active":"2024-05-15T14:28:02.889940+0000","last_became_peered":"2024-05-15T14:28:02.889940+0000","last_unstale":"2024-05-15T14:49:25.109805+0000","last_undegraded":"2024-05-15T14:49:25.109805+0000","last_fullsized":"2024-05-15T14:49:25.109805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:25.109684+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:25.109684+0000","last_clean_scrub_stamp":"2024-05-15T14:49:25.109684+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:45.669703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":111,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.263643+0000","last_change":"2024-05-15T14:49:38.263643+0000","last_active":"2024-05-15T14:49:38.263643+0000","last_peered":"2024-05-15T14:49:38.263643+0000","last_clean":"2024-05-15T14:49:38.263643+0000","last_became_active":"2024-05-15T14:31:16.590270+0000","last_became_peered":"2024-05-15T14:31:16.590270+0000","last_unstale":"2024-05-15T14:49:38.263643+0000","last_undegraded":"2024-05-15T14:49:38.263643+0000","last_fullsized":"2024-05-15T14:49:38.263643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:38.263509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:38.263509+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.263509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:35.074087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'14","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.643317+0000","last_change":"2024-05-15T14:49:18.643350+0000","last_active":"2024-05-15T14:49:18.643317+0000","last_peered":"2024-05-15T14:49:18.643317+0000","last_clean":"2024-05-15T14:49:18.643317+0000","last_became_active":"2024-05-15T14:27:52.861459+0000","last_became_peered":"2024-05-15T14:27:52.861459+0000","last_unstale":"2024-05-15T14:49:18.643317+0000","last_undegraded":"2024-05-15T14:49:18.643317+0000","last_fullsized":"2024-05-15T14:49:18.643317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:18.643228+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:18.643228+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.643228+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:46:21.768562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"39'12","reported_seq":92,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:24.265644+0000","last_change":"2024-05-15T14:49:24.265672+0000","last_active":"2024-05-15T14:49:24.265644+0000","last_peered":"2024-05-15T14:49:24.265644+0000","last_clean":"2024-05-15T14:49:24.265644+0000","last_became_active":"2024-05-15T14:27:50.836343+0000","last_became_peered":"2024-05-15T14:27:50.836343+0000","last_unstale":"2024-05-15T14:49:24.265644+0000","last_undegraded":"2024-05-15T14:49:24.265644+0000","last_fullsized":"2024-05-15T14:49:24.265644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:24.265555+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:24.265555+0000","last_clean_scrub_stamp":"2024-05-15T14:49:24.265555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:29:09.975638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":17641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.203034+0000","last_change":"2024-05-15T14:49:18.203061+0000","last_active":"2024-05-15T14:49:18.203034+0000","last_peered":"2024-05-15T14:49:18.203034+0000","last_clean":"2024-05-15T14:49:18.203034+0000","last_became_active":"2024-05-15T14:27:56.876994+0000","last_became_peered":"2024-05-15T14:27:56.876994+0000","last_unstale":"2024-05-15T14:49:18.203034+0000","last_undegraded":"2024-05-15T14:49:18.203034+0000","last_fullsized":"2024-05-15T14:49:18.203034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:18.202940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:18.202940+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.202940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:30.386529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"39'256","reported_seq":489,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:42.425963+0000","last_change":"2024-05-15T14:49:42.426000+0000","last_active":"2024-05-15T14:49:42.425963+0000","last_peered":"2024-05-15T14:49:42.425963+0000","last_clean":"2024-05-15T14:49:42.425963+0000","last_became_active":"2024-05-15T14:27:58.876807+0000","last_became_peered":"2024-05-15T14:27:58.876807+0000","last_unstale":"2024-05-15T14:49:42.425963+0000","last_undegraded":"2024-05-15T14:49:42.425963+0000","last_fullsized":"2024-05-15T14:49:42.425963+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'256","last_scrub_stamp":"2024-05-15T14:49:42.425862+0000","last_deep_scrub":"39'256","last_deep_scrub_stamp":"2024-05-15T14:49:42.425862+0000","last_clean_scrub_stamp":"2024-05-15T14:49:42.425862+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:30:55.530832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":396,"num_write":226,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:14.078333+0000","last_change":"2024-05-15T14:49:14.078360+0000","last_active":"2024-05-15T14:49:14.078333+0000","last_peered":"2024-05-15T14:49:14.078333+0000","last_clean":"2024-05-15T14:49:14.078333+0000","last_became_active":"2024-05-15T14:28:00.891181+0000","last_became_peered":"2024-05-15T14:28:00.891181+0000","last_unstale":"2024-05-15T14:49:14.078333+0000","last_undegraded":"2024-05-15T14:49:14.078333+0000","last_fullsized":"2024-05-15T14:49:14.078333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:14.078232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:14.078232+0000","last_clean_scrub_stamp":"2024-05-15T14:49:14.078232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:32.039369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"39'31","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:05.950712+0000","last_change":"2024-05-15T14:49:05.950748+0000","last_active":"2024-05-15T14:49:05.950712+0000","last_peered":"2024-05-15T14:49:05.950712+0000","last_clean":"2024-05-15T14:49:05.950712+0000","last_became_active":"2024-05-15T14:28:02.889976+0000","last_became_peered":"2024-05-15T14:28:02.889976+0000","last_unstale":"2024-05-15T14:49:05.950712+0000","last_undegraded":"2024-05-15T14:49:05.950712+0000","last_fullsized":"2024-05-15T14:49:05.950712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'31","last_scrub_stamp":"2024-05-15T14:49:05.950622+0000","last_deep_scrub":"39'31","last_deep_scrub_stamp":"2024-05-15T14:49:05.950622+0000","last_clean_scrub_stamp":"2024-05-15T14:49:05.950622+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:32.800900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:40.543421+0000","last_change":"2024-05-15T14:49:40.543421+0000","last_active":"2024-05-15T14:49:40.543421+0000","last_peered":"2024-05-15T14:49:40.543421+0000","last_clean":"2024-05-15T14:49:40.543421+0000","last_became_active":"2024-05-15T14:31:16.591739+0000","last_became_peered":"2024-05-15T14:31:16.591739+0000","last_unstale":"2024-05-15T14:49:40.543421+0000","last_undegraded":"2024-05-15T14:49:40.543421+0000","last_fullsized":"2024-05-15T14:49:40.543421+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:40.543304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:40.543304+0000","last_clean_scrub_stamp":"2024-05-15T14:49:40.543304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:11:30.899593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1c","version":"39'60","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.335021+0000","last_change":"2024-05-15T14:49:08.335055+0000","last_active":"2024-05-15T14:49:08.335021+0000","last_peered":"2024-05-15T14:49:08.335021+0000","last_clean":"2024-05-15T14:49:08.335021+0000","last_became_active":"2024-05-15T14:27:52.838558+0000","last_became_peered":"2024-05-15T14:27:52.838558+0000","last_unstale":"2024-05-15T14:49:08.335021+0000","last_undegraded":"2024-05-15T14:49:08.335021+0000","last_fullsized":"2024-05-15T14:49:08.335021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'60","last_scrub_stamp":"2024-05-15T14:49:08.334922+0000","last_deep_scrub":"39'60","last_deep_scrub_stamp":"2024-05-15T14:49:08.334922+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.334922+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:42:26.393241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":198,"num_write":84,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"39'14","reported_seq":91,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.276654+0000","last_change":"2024-05-15T14:49:32.276681+0000","last_active":"2024-05-15T14:49:32.276654+0000","last_peered":"2024-05-15T14:49:32.276654+0000","last_clean":"2024-05-15T14:49:32.276654+0000","last_became_active":"2024-05-15T14:27:50.833741+0000","last_became_peered":"2024-05-15T14:27:50.833741+0000","last_unstale":"2024-05-15T14:49:32.276654+0000","last_undegraded":"2024-05-15T14:49:32.276654+0000","last_fullsized":"2024-05-15T14:49:32.276654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:32.276549+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:32.276549+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.276549+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:29.087127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20,"num_write":62,"num_write_kb":15860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"39'4","reported_seq":287,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:04.052843+0000","last_change":"2024-05-15T14:49:04.052897+0000","last_active":"2024-05-15T14:49:04.052843+0000","last_peered":"2024-05-15T14:49:04.052843+0000","last_clean":"2024-05-15T14:49:04.052843+0000","last_became_active":"2024-05-15T14:27:56.883663+0000","last_became_peered":"2024-05-15T14:27:56.883663+0000","last_unstale":"2024-05-15T14:49:04.052843+0000","last_undegraded":"2024-05-15T14:49:04.052843+0000","last_fullsized":"2024-05-15T14:49:04.052843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:04.052742+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:04.052742+0000","last_clean_scrub_stamp":"2024-05-15T14:49:04.052742+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:00.238835+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2211,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":456,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"39'296","reported_seq":661,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.316930+0000","last_change":"2024-05-15T14:49:32.316972+0000","last_active":"2024-05-15T14:49:32.316930+0000","last_peered":"2024-05-15T14:49:32.316930+0000","last_clean":"2024-05-15T14:49:32.316930+0000","last_became_active":"2024-05-15T14:27:58.880510+0000","last_became_peered":"2024-05-15T14:27:58.880510+0000","last_unstale":"2024-05-15T14:49:32.316930+0000","last_undegraded":"2024-05-15T14:49:32.316930+0000","last_fullsized":"2024-05-15T14:49:32.316930+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'296","last_scrub_stamp":"2024-05-15T14:49:32.316840+0000","last_deep_scrub":"39'296","last_deep_scrub_stamp":"2024-05-15T14:49:32.316840+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.316840+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:08:34.626378+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":979,"num_read_kb":1295,"num_write":324,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2476,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'927","reported_seq":2566,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.113120+0000","last_change":"2024-05-15T14:49:07.113188+0000","last_active":"2024-05-15T14:49:07.113120+0000","last_peered":"2024-05-15T14:49:07.113120+0000","last_clean":"2024-05-15T14:49:07.113120+0000","last_became_active":"2024-05-15T14:28:00.885293+0000","last_became_peered":"2024-05-15T14:28:00.885293+0000","last_unstale":"2024-05-15T14:49:07.113120+0000","last_undegraded":"2024-05-15T14:49:07.113120+0000","last_fullsized":"2024-05-15T14:49:07.113120+0000","mapping_epoch":28,"log_start":"39'900","ondisk_log_start":"39'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'927","last_scrub_stamp":"2024-05-15T14:49:07.113019+0000","last_deep_scrub":"39'927","last_deep_scrub_stamp":"2024-05-15T14:49:07.113019+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.113019+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:38:04.929797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"39'25","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.887862+0000","last_change":"2024-05-15T14:49:06.887889+0000","last_active":"2024-05-15T14:49:06.887862+0000","last_peered":"2024-05-15T14:49:06.887862+0000","last_clean":"2024-05-15T14:49:06.887862+0000","last_became_active":"2024-05-15T14:28:02.892984+0000","last_became_peered":"2024-05-15T14:28:02.892984+0000","last_unstale":"2024-05-15T14:49:06.887862+0000","last_undegraded":"2024-05-15T14:49:06.887862+0000","last_fullsized":"2024-05-15T14:49:06.887862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'25","last_scrub_stamp":"2024-05-15T14:49:06.887772+0000","last_deep_scrub":"39'25","last_deep_scrub_stamp":"2024-05-15T14:49:06.887772+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.887772+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:33.315561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":37,"num_write":54,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.239115+0000","last_change":"2024-05-15T14:49:39.239143+0000","last_active":"2024-05-15T14:49:39.239115+0000","last_peered":"2024-05-15T14:49:39.239115+0000","last_clean":"2024-05-15T14:49:39.239115+0000","last_became_active":"2024-05-15T14:31:16.594019+0000","last_became_peered":"2024-05-15T14:31:16.594019+0000","last_unstale":"2024-05-15T14:49:39.239115+0000","last_undegraded":"2024-05-15T14:49:39.239115+0000","last_fullsized":"2024-05-15T14:49:39.239115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:39.238992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:39.238992+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.238992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:37:29.703568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"39'52","reported_seq":150,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:08.336418+0000","last_change":"2024-05-15T14:49:08.336446+0000","last_active":"2024-05-15T14:49:08.336418+0000","last_peered":"2024-05-15T14:49:08.336418+0000","last_clean":"2024-05-15T14:49:08.336418+0000","last_became_active":"2024-05-15T14:27:52.854479+0000","last_became_peered":"2024-05-15T14:27:52.854479+0000","last_unstale":"2024-05-15T14:49:08.336418+0000","last_undegraded":"2024-05-15T14:49:08.336418+0000","last_fullsized":"2024-05-15T14:49:08.336418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'52","last_scrub_stamp":"2024-05-15T14:49:08.336317+0000","last_deep_scrub":"39'52","last_deep_scrub_stamp":"2024-05-15T14:49:08.336317+0000","last_clean_scrub_stamp":"2024-05-15T14:49:08.336317+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:26.297455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":157,"num_write":72,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"39'14","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:33.024594+0000","last_change":"2024-05-15T14:49:33.024621+0000","last_active":"2024-05-15T14:49:33.024594+0000","last_peered":"2024-05-15T14:49:33.024594+0000","last_clean":"2024-05-15T14:49:33.024594+0000","last_became_active":"2024-05-15T14:27:50.840771+0000","last_became_peered":"2024-05-15T14:27:50.840771+0000","last_unstale":"2024-05-15T14:49:33.024594+0000","last_undegraded":"2024-05-15T14:49:33.024594+0000","last_fullsized":"2024-05-15T14:49:33.024594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:33.024498+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:33.024498+0000","last_clean_scrub_stamp":"2024-05-15T14:49:33.024498+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:12:24.618493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'26","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:16.797856+0000","last_change":"2024-05-15T14:49:16.797903+0000","last_active":"2024-05-15T14:49:16.797856+0000","last_peered":"2024-05-15T14:49:16.797856+0000","last_clean":"2024-05-15T14:49:16.797856+0000","last_became_active":"2024-05-15T14:27:56.877367+0000","last_became_peered":"2024-05-15T14:27:56.877367+0000","last_unstale":"2024-05-15T14:49:16.797856+0000","last_undegraded":"2024-05-15T14:49:16.797856+0000","last_fullsized":"2024-05-15T14:49:16.797856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:16.797749+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:16.797749+0000","last_clean_scrub_stamp":"2024-05-15T14:49:16.797749+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:40.177618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":101,"num_read_kb":87,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"39'422","reported_seq":23004,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.092567+0000","last_change":"2024-05-15T14:49:38.092567+0000","last_active":"2024-05-15T14:49:38.092567+0000","last_peered":"2024-05-15T14:49:38.092567+0000","last_clean":"2024-05-15T14:49:38.092567+0000","last_became_active":"2024-05-15T14:27:58.882139+0000","last_became_peered":"2024-05-15T14:27:58.882139+0000","last_unstale":"2024-05-15T14:49:38.092567+0000","last_undegraded":"2024-05-15T14:49:38.092567+0000","last_fullsized":"2024-05-15T14:49:38.092567+0000","mapping_epoch":26,"log_start":"39'400","ondisk_log_start":"39'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'422","last_scrub_stamp":"2024-05-15T14:49:38.092422+0000","last_deep_scrub":"39'422","last_deep_scrub_stamp":"2024-05-15T14:49:38.092422+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.092422+0000","objects_scrubbed":11,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:33:17.727919+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":56371,"num_read_kb":194199,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.130805+0000","last_change":"2024-05-15T14:49:07.130805+0000","last_active":"2024-05-15T14:49:07.130805+0000","last_peered":"2024-05-15T14:49:07.130805+0000","last_clean":"2024-05-15T14:49:07.130805+0000","last_became_active":"2024-05-15T14:28:00.885872+0000","last_became_peered":"2024-05-15T14:28:00.885872+0000","last_unstale":"2024-05-15T14:49:07.130805+0000","last_undegraded":"2024-05-15T14:49:07.130805+0000","last_fullsized":"2024-05-15T14:49:07.130805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:07.130678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:07.130678+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.130678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:00.272870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"39'21","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.516922+0000","last_change":"2024-05-15T14:49:37.516922+0000","last_active":"2024-05-15T14:49:37.516922+0000","last_peered":"2024-05-15T14:49:37.516922+0000","last_clean":"2024-05-15T14:49:37.516922+0000","last_became_active":"2024-05-15T14:28:02.896293+0000","last_became_peered":"2024-05-15T14:28:02.896293+0000","last_unstale":"2024-05-15T14:49:37.516922+0000","last_undegraded":"2024-05-15T14:49:37.516922+0000","last_fullsized":"2024-05-15T14:49:37.516922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'21","last_scrub_stamp":"2024-05-15T14:49:37.516796+0000","last_deep_scrub":"39'21","last_deep_scrub_stamp":"2024-05-15T14:49:37.516796+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.516796+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:52.753921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:43.562674+0000","last_change":"2024-05-15T14:49:43.562699+0000","last_active":"2024-05-15T14:49:43.562674+0000","last_peered":"2024-05-15T14:49:43.562674+0000","last_clean":"2024-05-15T14:49:43.562674+0000","last_became_active":"2024-05-15T14:31:16.594144+0000","last_became_peered":"2024-05-15T14:31:16.594144+0000","last_unstale":"2024-05-15T14:49:43.562674+0000","last_undegraded":"2024-05-15T14:49:43.562674+0000","last_fullsized":"2024-05-15T14:49:43.562674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:43.562583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:43.562583+0000","last_clean_scrub_stamp":"2024-05-15T14:49:43.562583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:12.974149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"39'56","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.317080+0000","last_change":"2024-05-15T14:49:10.317106+0000","last_active":"2024-05-15T14:49:10.317080+0000","last_peered":"2024-05-15T14:49:10.317080+0000","last_clean":"2024-05-15T14:49:10.317080+0000","last_became_active":"2024-05-15T14:27:52.854517+0000","last_became_peered":"2024-05-15T14:27:52.854517+0000","last_unstale":"2024-05-15T14:49:10.317080+0000","last_undegraded":"2024-05-15T14:49:10.317080+0000","last_fullsized":"2024-05-15T14:49:10.317080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'56","last_scrub_stamp":"2024-05-15T14:49:10.316960+0000","last_deep_scrub":"39'56","last_deep_scrub_stamp":"2024-05-15T14:49:10.316960+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.316960+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:31.795310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":183,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"39'16","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.034206+0000","last_change":"2024-05-15T14:49:32.034233+0000","last_active":"2024-05-15T14:49:32.034206+0000","last_peered":"2024-05-15T14:49:32.034206+0000","last_clean":"2024-05-15T14:49:32.034206+0000","last_became_active":"2024-05-15T14:27:50.839960+0000","last_became_peered":"2024-05-15T14:27:50.839960+0000","last_unstale":"2024-05-15T14:49:32.034206+0000","last_undegraded":"2024-05-15T14:49:32.034206+0000","last_fullsized":"2024-05-15T14:49:32.034206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:32.034114+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:32.034114+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.034114+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:10:40.340523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"39'2","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.048974+0000","last_change":"2024-05-15T14:49:28.049023+0000","last_active":"2024-05-15T14:49:28.048974+0000","last_peered":"2024-05-15T14:49:28.048974+0000","last_clean":"2024-05-15T14:49:28.048974+0000","last_became_active":"2024-05-15T14:27:56.883267+0000","last_became_peered":"2024-05-15T14:27:56.883267+0000","last_unstale":"2024-05-15T14:49:28.048974+0000","last_undegraded":"2024-05-15T14:49:28.048974+0000","last_fullsized":"2024-05-15T14:49:28.048974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-05-15T14:49:28.048878+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-05-15T14:49:28.048878+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.048878+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:10:08.121459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"39'224","reported_seq":435,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.331844+0000","last_change":"2024-05-15T14:49:29.331844+0000","last_active":"2024-05-15T14:49:29.331844+0000","last_peered":"2024-05-15T14:49:29.331844+0000","last_clean":"2024-05-15T14:49:29.331844+0000","last_became_active":"2024-05-15T14:27:58.882239+0000","last_became_peered":"2024-05-15T14:27:58.882239+0000","last_unstale":"2024-05-15T14:49:29.331844+0000","last_undegraded":"2024-05-15T14:49:29.331844+0000","last_fullsized":"2024-05-15T14:49:29.331844+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'224","last_scrub_stamp":"2024-05-15T14:49:29.331696+0000","last_deep_scrub":"39'224","last_deep_scrub_stamp":"2024-05-15T14:49:29.331696+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.331696+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:20.337088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":346,"num_read_kb":338,"num_write":194,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.140271+0000","last_change":"2024-05-15T14:49:11.140271+0000","last_active":"2024-05-15T14:49:11.140271+0000","last_peered":"2024-05-15T14:49:11.140271+0000","last_clean":"2024-05-15T14:49:11.140271+0000","last_became_active":"2024-05-15T14:28:00.886898+0000","last_became_peered":"2024-05-15T14:28:00.886898+0000","last_unstale":"2024-05-15T14:49:11.140271+0000","last_undegraded":"2024-05-15T14:49:11.140271+0000","last_fullsized":"2024-05-15T14:49:11.140271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:11.140161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:11.140161+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.140161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:21:44.609330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"39'13","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.596392+0000","last_change":"2024-05-15T14:49:02.596392+0000","last_active":"2024-05-15T14:49:02.596392+0000","last_peered":"2024-05-15T14:49:02.596392+0000","last_clean":"2024-05-15T14:49:02.596392+0000","last_became_active":"2024-05-15T14:28:02.890595+0000","last_became_peered":"2024-05-15T14:28:02.890595+0000","last_unstale":"2024-05-15T14:49:02.596392+0000","last_undegraded":"2024-05-15T14:49:02.596392+0000","last_fullsized":"2024-05-15T14:49:02.596392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'13","last_scrub_stamp":"2024-05-15T14:49:02.596237+0000","last_deep_scrub":"39'13","last_deep_scrub_stamp":"2024-05-15T14:49:02.596237+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.596237+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:22.841762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:32.789448+0000","last_change":"2024-05-15T14:49:32.789448+0000","last_active":"2024-05-15T14:49:32.789448+0000","last_peered":"2024-05-15T14:49:32.789448+0000","last_clean":"2024-05-15T14:49:32.789448+0000","last_became_active":"2024-05-15T14:31:16.597207+0000","last_became_peered":"2024-05-15T14:31:16.597207+0000","last_unstale":"2024-05-15T14:49:32.789448+0000","last_undegraded":"2024-05-15T14:49:32.789448+0000","last_fullsized":"2024-05-15T14:49:32.789448+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:32.789325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:32.789325+0000","last_clean_scrub_stamp":"2024-05-15T14:49:32.789325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:04:05.890839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"39'94","reported_seq":218,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.686057+0000","last_change":"2024-05-15T14:49:23.686057+0000","last_active":"2024-05-15T14:49:23.686057+0000","last_peered":"2024-05-15T14:49:23.686057+0000","last_clean":"2024-05-15T14:49:23.686057+0000","last_became_active":"2024-05-15T14:27:52.852536+0000","last_became_peered":"2024-05-15T14:27:52.852536+0000","last_unstale":"2024-05-15T14:49:23.686057+0000","last_undegraded":"2024-05-15T14:49:23.686057+0000","last_fullsized":"2024-05-15T14:49:23.686057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2024-05-15T14:49:23.685948+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2024-05-15T14:49:23.685948+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.685948+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:20.496527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":296,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"39'22","reported_seq":115,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:37.384430+0000","last_change":"2024-05-15T14:49:37.384430+0000","last_active":"2024-05-15T14:49:37.384430+0000","last_peered":"2024-05-15T14:49:37.384430+0000","last_clean":"2024-05-15T14:49:37.384430+0000","last_became_active":"2024-05-15T14:27:50.847850+0000","last_became_peered":"2024-05-15T14:27:50.847850+0000","last_unstale":"2024-05-15T14:49:37.384430+0000","last_undegraded":"2024-05-15T14:49:37.384430+0000","last_fullsized":"2024-05-15T14:49:37.384430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2024-05-15T14:49:37.384314+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2024-05-15T14:49:37.384314+0000","last_clean_scrub_stamp":"2024-05-15T14:49:37.384314+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:09:10.448785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":44,"num_write":110,"num_write_kb":26471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"39'4","reported_seq":1320,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.188745+0000","last_change":"2024-05-15T14:49:20.188745+0000","last_active":"2024-05-15T14:49:20.188745+0000","last_peered":"2024-05-15T14:49:20.188745+0000","last_clean":"2024-05-15T14:49:20.188745+0000","last_became_active":"2024-05-15T14:27:56.879092+0000","last_became_peered":"2024-05-15T14:27:56.879092+0000","last_unstale":"2024-05-15T14:49:20.188745+0000","last_undegraded":"2024-05-15T14:49:20.188745+0000","last_fullsized":"2024-05-15T14:49:20.188745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2024-05-15T14:49:20.188613+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2024-05-15T14:49:20.188613+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.188613+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:54.028706+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1596,"num_read_kb":1594,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'235","reported_seq":404,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.658410+0000","last_change":"2024-05-15T14:49:10.658453+0000","last_active":"2024-05-15T14:49:10.658410+0000","last_peered":"2024-05-15T14:49:10.658410+0000","last_clean":"2024-05-15T14:49:10.658410+0000","last_became_active":"2024-05-15T14:27:58.882703+0000","last_became_peered":"2024-05-15T14:27:58.882703+0000","last_unstale":"2024-05-15T14:49:10.658410+0000","last_undegraded":"2024-05-15T14:49:10.658410+0000","last_fullsized":"2024-05-15T14:49:10.658410+0000","mapping_epoch":26,"log_start":"39'200","ondisk_log_start":"39'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'235","last_scrub_stamp":"2024-05-15T14:49:10.658310+0000","last_deep_scrub":"39'235","last_deep_scrub_stamp":"2024-05-15T14:49:10.658310+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.658310+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:47.078696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":469,"num_write":437,"num_write_kb":1979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:06.387544+0000","last_change":"2024-05-15T14:49:06.387569+0000","last_active":"2024-05-15T14:49:06.387544+0000","last_peered":"2024-05-15T14:49:06.387544+0000","last_clean":"2024-05-15T14:49:06.387544+0000","last_became_active":"2024-05-15T14:28:00.884499+0000","last_became_peered":"2024-05-15T14:28:00.884499+0000","last_unstale":"2024-05-15T14:49:06.387544+0000","last_undegraded":"2024-05-15T14:49:06.387544+0000","last_fullsized":"2024-05-15T14:49:06.387544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:06.387416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:06.387416+0000","last_clean_scrub_stamp":"2024-05-15T14:49:06.387416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:35.420936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"39'19","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.861426+0000","last_change":"2024-05-15T14:49:10.861426+0000","last_active":"2024-05-15T14:49:10.861426+0000","last_peered":"2024-05-15T14:49:10.861426+0000","last_clean":"2024-05-15T14:49:10.861426+0000","last_became_active":"2024-05-15T14:28:02.895999+0000","last_became_peered":"2024-05-15T14:28:02.895999+0000","last_unstale":"2024-05-15T14:49:10.861426+0000","last_undegraded":"2024-05-15T14:49:10.861426+0000","last_fullsized":"2024-05-15T14:49:10.861426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'19","last_scrub_stamp":"2024-05-15T14:49:10.861308+0000","last_deep_scrub":"39'19","last_deep_scrub_stamp":"2024-05-15T14:49:10.861308+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.861308+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:20:05.506912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:41.575225+0000","last_change":"2024-05-15T14:49:41.575248+0000","last_active":"2024-05-15T14:49:41.575225+0000","last_peered":"2024-05-15T14:49:41.575225+0000","last_clean":"2024-05-15T14:49:41.575225+0000","last_became_active":"2024-05-15T14:31:16.593126+0000","last_became_peered":"2024-05-15T14:31:16.593126+0000","last_unstale":"2024-05-15T14:49:41.575225+0000","last_undegraded":"2024-05-15T14:49:41.575225+0000","last_fullsized":"2024-05-15T14:49:41.575225+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:41.575140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:41.575140+0000","last_clean_scrub_stamp":"2024-05-15T14:49:41.575140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:24.595555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":65,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.304348+0000","last_change":"2024-05-15T14:49:29.304348+0000","last_active":"2024-05-15T14:49:29.304348+0000","last_peered":"2024-05-15T14:49:29.304348+0000","last_clean":"2024-05-15T14:49:29.304348+0000","last_became_active":"2024-05-15T14:27:52.844112+0000","last_became_peered":"2024-05-15T14:27:52.844112+0000","last_unstale":"2024-05-15T14:49:29.304348+0000","last_undegraded":"2024-05-15T14:49:29.304348+0000","last_fullsized":"2024-05-15T14:49:29.304348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:29.304230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:29.304230+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.304230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:54:25.785614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"39'20","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:36.343644+0000","last_change":"2024-05-15T14:49:36.343669+0000","last_active":"2024-05-15T14:49:36.343644+0000","last_peered":"2024-05-15T14:49:36.343644+0000","last_clean":"2024-05-15T14:49:36.343644+0000","last_became_active":"2024-05-15T14:27:50.843701+0000","last_became_peered":"2024-05-15T14:27:50.843701+0000","last_unstale":"2024-05-15T14:49:36.343644+0000","last_undegraded":"2024-05-15T14:49:36.343644+0000","last_fullsized":"2024-05-15T14:49:36.343644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:36.343529+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:36.343529+0000","last_clean_scrub_stamp":"2024-05-15T14:49:36.343529+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:02:24.999543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":100,"num_write_kb":23517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:02.095906+0000","last_change":"2024-05-15T14:49:02.095906+0000","last_active":"2024-05-15T14:49:02.095906+0000","last_peered":"2024-05-15T14:49:02.095906+0000","last_clean":"2024-05-15T14:49:02.095906+0000","last_became_active":"2024-05-15T14:27:56.883534+0000","last_became_peered":"2024-05-15T14:27:56.883534+0000","last_unstale":"2024-05-15T14:49:02.095906+0000","last_undegraded":"2024-05-15T14:49:02.095906+0000","last_fullsized":"2024-05-15T14:49:02.095906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:02.095799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:02.095799+0000","last_clean_scrub_stamp":"2024-05-15T14:49:02.095799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:14:42.041400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"39'327","reported_seq":542,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:03.407498+0000","last_change":"2024-05-15T14:49:03.407537+0000","last_active":"2024-05-15T14:49:03.407498+0000","last_peered":"2024-05-15T14:49:03.407498+0000","last_clean":"2024-05-15T14:49:03.407498+0000","last_became_active":"2024-05-15T14:27:58.885479+0000","last_became_peered":"2024-05-15T14:27:58.885479+0000","last_unstale":"2024-05-15T14:49:03.407498+0000","last_undegraded":"2024-05-15T14:49:03.407498+0000","last_fullsized":"2024-05-15T14:49:03.407498+0000","mapping_epoch":26,"log_start":"39'300","ondisk_log_start":"39'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'327","last_scrub_stamp":"2024-05-15T14:49:03.407417+0000","last_deep_scrub":"39'327","last_deep_scrub_stamp":"2024-05-15T14:49:03.407417+0000","last_clean_scrub_stamp":"2024-05-15T14:49:03.407417+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:33.672132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":569,"num_read_kb":606,"num_write":518,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:10.127126+0000","last_change":"2024-05-15T14:49:10.127153+0000","last_active":"2024-05-15T14:49:10.127126+0000","last_peered":"2024-05-15T14:49:10.127126+0000","last_clean":"2024-05-15T14:49:10.127126+0000","last_became_active":"2024-05-15T14:28:00.885171+0000","last_became_peered":"2024-05-15T14:28:00.885171+0000","last_unstale":"2024-05-15T14:49:10.127126+0000","last_undegraded":"2024-05-15T14:49:10.127126+0000","last_fullsized":"2024-05-15T14:49:10.127126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T14:49:10.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T14:49:10.127026+0000","last_clean_scrub_stamp":"2024-05-15T14:49:10.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:33.506895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'29","reported_seq":83,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:35.312586+0000","last_change":"2024-05-15T14:49:35.312640+0000","last_active":"2024-05-15T14:49:35.312586+0000","last_peered":"2024-05-15T14:49:35.312586+0000","last_clean":"2024-05-15T14:49:35.312586+0000","last_became_active":"2024-05-15T14:28:02.888247+0000","last_became_peered":"2024-05-15T14:28:02.888247+0000","last_unstale":"2024-05-15T14:49:35.312586+0000","last_undegraded":"2024-05-15T14:49:35.312586+0000","last_fullsized":"2024-05-15T14:49:35.312586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'29","last_scrub_stamp":"2024-05-15T14:49:35.312474+0000","last_deep_scrub":"39'29","last_deep_scrub_stamp":"2024-05-15T14:49:35.312474+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.312474+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:26.317866+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":30,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"39'16","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:11.075052+0000","last_change":"2024-05-15T14:49:11.075052+0000","last_active":"2024-05-15T14:49:11.075052+0000","last_peered":"2024-05-15T14:49:11.075052+0000","last_clean":"2024-05-15T14:49:11.075052+0000","last_became_active":"2024-05-15T14:27:52.844292+0000","last_became_peered":"2024-05-15T14:27:52.844292+0000","last_unstale":"2024-05-15T14:49:11.075052+0000","last_undegraded":"2024-05-15T14:49:11.075052+0000","last_fullsized":"2024-05-15T14:49:11.075052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:11.074913+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:11.074913+0000","last_clean_scrub_stamp":"2024-05-15T14:49:11.074913+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:30:37.502702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"39'20","reported_seq":108,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.149154+0000","last_change":"2024-05-15T14:49:19.149192+0000","last_active":"2024-05-15T14:49:19.149154+0000","last_peered":"2024-05-15T14:49:19.149154+0000","last_clean":"2024-05-15T14:49:19.149154+0000","last_became_active":"2024-05-15T14:27:50.853042+0000","last_became_peered":"2024-05-15T14:27:50.853042+0000","last_unstale":"2024-05-15T14:49:19.149154+0000","last_undegraded":"2024-05-15T14:49:19.149154+0000","last_fullsized":"2024-05-15T14:49:19.149154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:19.149063+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:19.149063+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.149063+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:35:12.578395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":35,"num_write":92,"num_write_kb":30554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"39'20","reported_seq":122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.060054+0000","last_change":"2024-05-15T14:49:15.060054+0000","last_active":"2024-05-15T14:49:15.060054+0000","last_peered":"2024-05-15T14:49:15.060054+0000","last_clean":"2024-05-15T14:49:15.060054+0000","last_became_active":"2024-05-15T14:27:52.840716+0000","last_became_peered":"2024-05-15T14:27:52.840716+0000","last_unstale":"2024-05-15T14:49:15.060054+0000","last_undegraded":"2024-05-15T14:49:15.060054+0000","last_fullsized":"2024-05-15T14:49:15.060054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:15.059932+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:15.059932+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.059932+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:56.592681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":81,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"39'16","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.508457+0000","last_change":"2024-05-15T14:49:20.508498+0000","last_active":"2024-05-15T14:49:20.508457+0000","last_peered":"2024-05-15T14:49:20.508457+0000","last_clean":"2024-05-15T14:49:20.508457+0000","last_became_active":"2024-05-15T14:28:38.450578+0000","last_became_peered":"2024-05-15T14:28:38.450578+0000","last_unstale":"2024-05-15T14:49:20.508457+0000","last_undegraded":"2024-05-15T14:49:20.508457+0000","last_fullsized":"2024-05-15T14:49:20.508457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.508362+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.508362+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.508362+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:16.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"39'26","reported_seq":120,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.072811+0000","last_change":"2024-05-15T14:49:15.072811+0000","last_active":"2024-05-15T14:49:15.072811+0000","last_peered":"2024-05-15T14:49:15.072811+0000","last_clean":"2024-05-15T14:49:15.072811+0000","last_became_active":"2024-05-15T14:27:52.841192+0000","last_became_peered":"2024-05-15T14:27:52.841192+0000","last_unstale":"2024-05-15T14:49:15.072811+0000","last_undegraded":"2024-05-15T14:49:15.072811+0000","last_fullsized":"2024-05-15T14:49:15.072811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.072647+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.072647+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.072647+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:25:35.318172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":93,"num_write":35,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"39'18","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:40.039150+0000","last_change":"2024-05-15T14:49:40.039173+0000","last_active":"2024-05-15T14:49:40.039150+0000","last_peered":"2024-05-15T14:49:40.039150+0000","last_clean":"2024-05-15T14:49:40.039150+0000","last_became_active":"2024-05-15T14:28:38.450592+0000","last_became_peered":"2024-05-15T14:28:38.450592+0000","last_unstale":"2024-05-15T14:49:40.039150+0000","last_undegraded":"2024-05-15T14:49:40.039150+0000","last_fullsized":"2024-05-15T14:49:40.039150+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:40.039043+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:40.039043+0000","last_clean_scrub_stamp":"2024-05-15T14:49:40.039043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:25:12.969205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"39'72","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:39.078305+0000","last_change":"2024-05-15T14:49:39.078330+0000","last_active":"2024-05-15T14:49:39.078305+0000","last_peered":"2024-05-15T14:49:39.078305+0000","last_clean":"2024-05-15T14:49:39.078305+0000","last_became_active":"2024-05-15T14:28:37.941389+0000","last_became_peered":"2024-05-15T14:28:37.941389+0000","last_unstale":"2024-05-15T14:49:39.078305+0000","last_undegraded":"2024-05-15T14:49:39.078305+0000","last_fullsized":"2024-05-15T14:49:39.078305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'72","last_scrub_stamp":"2024-05-15T14:49:39.078206+0000","last_deep_scrub":"39'72","last_deep_scrub_stamp":"2024-05-15T14:49:39.078206+0000","last_clean_scrub_stamp":"2024-05-15T14:49:39.078206+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:22.098621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":292,"num_read_kb":236,"num_write":102,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"39'18","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:28.286967+0000","last_change":"2024-05-15T14:49:28.286997+0000","last_active":"2024-05-15T14:49:28.286967+0000","last_peered":"2024-05-15T14:49:28.286967+0000","last_clean":"2024-05-15T14:49:28.286967+0000","last_became_active":"2024-05-15T14:27:50.848763+0000","last_became_peered":"2024-05-15T14:27:50.848763+0000","last_unstale":"2024-05-15T14:49:28.286967+0000","last_undegraded":"2024-05-15T14:49:28.286967+0000","last_fullsized":"2024-05-15T14:49:28.286967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:28.286874+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:28.286874+0000","last_clean_scrub_stamp":"2024-05-15T14:49:28.286874+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:26:29.553520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":82,"num_write_kb":24675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"39'82","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:21.667759+0000","last_change":"2024-05-15T14:49:21.667789+0000","last_active":"2024-05-15T14:49:21.667759+0000","last_peered":"2024-05-15T14:49:21.667759+0000","last_clean":"2024-05-15T14:49:21.667759+0000","last_became_active":"2024-05-15T14:27:52.851068+0000","last_became_peered":"2024-05-15T14:27:52.851068+0000","last_unstale":"2024-05-15T14:49:21.667759+0000","last_undegraded":"2024-05-15T14:49:21.667759+0000","last_fullsized":"2024-05-15T14:49:21.667759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'82","last_scrub_stamp":"2024-05-15T14:49:21.667665+0000","last_deep_scrub":"39'82","last_deep_scrub_stamp":"2024-05-15T14:49:21.667665+0000","last_clean_scrub_stamp":"2024-05-15T14:49:21.667665+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:27.464154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":322,"num_read_kb":258,"num_write":116,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"39'10","reported_seq":90,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:35.433702+0000","last_change":"2024-05-15T14:49:35.433727+0000","last_active":"2024-05-15T14:49:35.433702+0000","last_peered":"2024-05-15T14:49:35.433702+0000","last_clean":"2024-05-15T14:49:35.433702+0000","last_became_active":"2024-05-15T14:27:50.847042+0000","last_became_peered":"2024-05-15T14:27:50.847042+0000","last_unstale":"2024-05-15T14:49:35.433702+0000","last_undegraded":"2024-05-15T14:49:35.433702+0000","last_fullsized":"2024-05-15T14:49:35.433702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-05-15T14:49:35.433607+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-05-15T14:49:35.433607+0000","last_clean_scrub_stamp":"2024-05-15T14:49:35.433607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:59:47.232976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20,"num_write":50,"num_write_kb":14704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'66","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:31.314486+0000","last_change":"2024-05-15T14:49:31.314535+0000","last_active":"2024-05-15T14:49:31.314486+0000","last_peered":"2024-05-15T14:49:31.314486+0000","last_clean":"2024-05-15T14:49:31.314486+0000","last_became_active":"2024-05-15T14:27:52.846918+0000","last_became_peered":"2024-05-15T14:27:52.846918+0000","last_unstale":"2024-05-15T14:49:31.314486+0000","last_undegraded":"2024-05-15T14:49:31.314486+0000","last_fullsized":"2024-05-15T14:49:31.314486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'66","last_scrub_stamp":"2024-05-15T14:49:31.314369+0000","last_deep_scrub":"39'66","last_deep_scrub_stamp":"2024-05-15T14:49:31.314369+0000","last_clean_scrub_stamp":"2024-05-15T14:49:31.314369+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:27:25.369922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":226,"num_write":90,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.942571+0000","last_change":"2024-05-15T14:49:23.942571+0000","last_active":"2024-05-15T14:49:23.942571+0000","last_peered":"2024-05-15T14:49:23.942571+0000","last_clean":"2024-05-15T14:49:23.942571+0000","last_became_active":"2024-05-15T14:27:50.849910+0000","last_became_peered":"2024-05-15T14:27:50.849910+0000","last_unstale":"2024-05-15T14:49:23.942571+0000","last_undegraded":"2024-05-15T14:49:23.942571+0000","last_fullsized":"2024-05-15T14:49:23.942571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:23.942463+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:23.942463+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.942463+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:46.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":80,"num_write_kb":20588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":89,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.650883+0000","last_change":"2024-05-15T14:49:20.650911+0000","last_active":"2024-05-15T14:49:20.650883+0000","last_peered":"2024-05-15T14:49:20.650883+0000","last_clean":"2024-05-15T14:49:20.650883+0000","last_became_active":"2024-05-15T14:27:52.862227+0000","last_became_peered":"2024-05-15T14:27:52.862227+0000","last_unstale":"2024-05-15T14:49:20.650883+0000","last_undegraded":"2024-05-15T14:49:20.650883+0000","last_fullsized":"2024-05-15T14:49:20.650883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-05-15T14:49:20.650774+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-05-15T14:49:20.650774+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.650774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:11.656167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"39'14","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:27.193934+0000","last_change":"2024-05-15T14:49:27.193934+0000","last_active":"2024-05-15T14:49:27.193934+0000","last_peered":"2024-05-15T14:49:27.193934+0000","last_clean":"2024-05-15T14:49:27.193934+0000","last_became_active":"2024-05-15T14:28:37.942198+0000","last_became_peered":"2024-05-15T14:28:37.942198+0000","last_unstale":"2024-05-15T14:49:27.193934+0000","last_undegraded":"2024-05-15T14:49:27.193934+0000","last_fullsized":"2024-05-15T14:49:27.193934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:27.193768+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:27.193768+0000","last_clean_scrub_stamp":"2024-05-15T14:49:27.193768+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:50.573637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28,"num_write":70,"num_write_kb":20581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"39'16","reported_seq":109,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.110507+0000","last_change":"2024-05-15T14:49:20.110542+0000","last_active":"2024-05-15T14:49:20.110507+0000","last_peered":"2024-05-15T14:49:20.110507+0000","last_clean":"2024-05-15T14:49:20.110507+0000","last_became_active":"2024-05-15T14:27:52.840941+0000","last_became_peered":"2024-05-15T14:27:52.840941+0000","last_unstale":"2024-05-15T14:49:20.110507+0000","last_undegraded":"2024-05-15T14:49:20.110507+0000","last_fullsized":"2024-05-15T14:49:20.110507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.110386+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.110386+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.110386+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:46.960664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"39'16","reported_seq":102,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:38.405845+0000","last_change":"2024-05-15T14:49:38.405874+0000","last_active":"2024-05-15T14:49:38.405845+0000","last_peered":"2024-05-15T14:49:38.405845+0000","last_clean":"2024-05-15T14:49:38.405845+0000","last_became_active":"2024-05-15T14:27:50.847998+0000","last_became_peered":"2024-05-15T14:27:50.847998+0000","last_unstale":"2024-05-15T14:49:38.405845+0000","last_undegraded":"2024-05-15T14:49:38.405845+0000","last_fullsized":"2024-05-15T14:49:38.405845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:38.405722+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:38.405722+0000","last_clean_scrub_stamp":"2024-05-15T14:49:38.405722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:52:51.105690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"39'8","reported_seq":99,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.150410+0000","last_change":"2024-05-15T14:49:20.150486+0000","last_active":"2024-05-15T14:49:20.150410+0000","last_peered":"2024-05-15T14:49:20.150410+0000","last_clean":"2024-05-15T14:49:20.150410+0000","last_became_active":"2024-05-15T14:27:52.852947+0000","last_became_peered":"2024-05-15T14:27:52.852947+0000","last_unstale":"2024-05-15T14:49:20.150410+0000","last_undegraded":"2024-05-15T14:49:20.150410+0000","last_fullsized":"2024-05-15T14:49:20.150410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2024-05-15T14:49:20.150300+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2024-05-15T14:49:20.150300+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.150300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:40:02.975219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"39'14","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.077621+0000","last_change":"2024-05-15T14:49:23.077621+0000","last_active":"2024-05-15T14:49:23.077621+0000","last_peered":"2024-05-15T14:49:23.077621+0000","last_clean":"2024-05-15T14:49:23.077621+0000","last_became_active":"2024-05-15T14:27:50.855927+0000","last_became_peered":"2024-05-15T14:27:50.855927+0000","last_unstale":"2024-05-15T14:49:23.077621+0000","last_undegraded":"2024-05-15T14:49:23.077621+0000","last_fullsized":"2024-05-15T14:49:23.077621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:23.077496+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:23.077496+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.077496+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:29:51.770946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24,"num_write":62,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"39'24","reported_seq":119,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.304690+0000","last_change":"2024-05-15T14:49:09.304727+0000","last_active":"2024-05-15T14:49:09.304690+0000","last_peered":"2024-05-15T14:49:09.304690+0000","last_clean":"2024-05-15T14:49:09.304690+0000","last_became_active":"2024-05-15T14:27:52.853857+0000","last_became_peered":"2024-05-15T14:27:52.853857+0000","last_unstale":"2024-05-15T14:49:09.304690+0000","last_undegraded":"2024-05-15T14:49:09.304690+0000","last_fullsized":"2024-05-15T14:49:09.304690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:09.304568+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:09.304568+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.304568+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:50.837317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":91,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"39'18","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.477199+0000","last_change":"2024-05-15T14:49:34.477253+0000","last_active":"2024-05-15T14:49:34.477199+0000","last_peered":"2024-05-15T14:49:34.477199+0000","last_clean":"2024-05-15T14:49:34.477199+0000","last_became_active":"2024-05-15T14:27:50.843874+0000","last_became_peered":"2024-05-15T14:27:50.843874+0000","last_unstale":"2024-05-15T14:49:34.477199+0000","last_undegraded":"2024-05-15T14:49:34.477199+0000","last_fullsized":"2024-05-15T14:49:34.477199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:34.477097+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:34.477097+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.477097+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:36:31.039320+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":20585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"39'58","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:09.314239+0000","last_change":"2024-05-15T14:49:09.314267+0000","last_active":"2024-05-15T14:49:09.314239+0000","last_peered":"2024-05-15T14:49:09.314239+0000","last_clean":"2024-05-15T14:49:09.314239+0000","last_became_active":"2024-05-15T14:27:52.847362+0000","last_became_peered":"2024-05-15T14:27:52.847362+0000","last_unstale":"2024-05-15T14:49:09.314239+0000","last_undegraded":"2024-05-15T14:49:09.314239+0000","last_fullsized":"2024-05-15T14:49:09.314239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'58","last_scrub_stamp":"2024-05-15T14:49:09.314142+0000","last_deep_scrub":"39'58","last_deep_scrub_stamp":"2024-05-15T14:49:09.314142+0000","last_clean_scrub_stamp":"2024-05-15T14:49:09.314142+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:37:44.576275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":172,"num_write":84,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"39'12","reported_seq":93,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.963884+0000","last_change":"2024-05-15T14:49:34.963913+0000","last_active":"2024-05-15T14:49:34.963884+0000","last_peered":"2024-05-15T14:49:34.963884+0000","last_clean":"2024-05-15T14:49:34.963884+0000","last_became_active":"2024-05-15T14:27:50.846291+0000","last_became_peered":"2024-05-15T14:27:50.846291+0000","last_unstale":"2024-05-15T14:49:34.963884+0000","last_undegraded":"2024-05-15T14:49:34.963884+0000","last_fullsized":"2024-05-15T14:49:34.963884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2024-05-15T14:49:34.963790+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2024-05-15T14:49:34.963790+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.963790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:02:03.080939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":60,"num_write_kb":14702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"39'74","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:23.277346+0000","last_change":"2024-05-15T14:49:23.277375+0000","last_active":"2024-05-15T14:49:23.277346+0000","last_peered":"2024-05-15T14:49:23.277346+0000","last_clean":"2024-05-15T14:49:23.277346+0000","last_became_active":"2024-05-15T14:27:52.848173+0000","last_became_peered":"2024-05-15T14:27:52.848173+0000","last_unstale":"2024-05-15T14:49:23.277346+0000","last_undegraded":"2024-05-15T14:49:23.277346+0000","last_fullsized":"2024-05-15T14:49:23.277346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2024-05-15T14:49:23.277252+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2024-05-15T14:49:23.277252+0000","last_clean_scrub_stamp":"2024-05-15T14:49:23.277252+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:34.025306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":248,"num_write":102,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:30.282473+0000","last_change":"2024-05-15T14:49:30.282500+0000","last_active":"2024-05-15T14:49:30.282473+0000","last_peered":"2024-05-15T14:49:30.282473+0000","last_clean":"2024-05-15T14:49:30.282473+0000","last_became_active":"2024-05-15T14:27:50.846782+0000","last_became_peered":"2024-05-15T14:27:50.846782+0000","last_unstale":"2024-05-15T14:49:30.282473+0000","last_undegraded":"2024-05-15T14:49:30.282473+0000","last_fullsized":"2024-05-15T14:49:30.282473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:30.282376+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:30.282376+0000","last_clean_scrub_stamp":"2024-05-15T14:49:30.282376+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:36.078865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":23519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"39'30","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:13.850454+0000","last_change":"2024-05-15T14:49:13.850479+0000","last_active":"2024-05-15T14:49:13.850454+0000","last_peered":"2024-05-15T14:49:13.850454+0000","last_clean":"2024-05-15T14:49:13.850454+0000","last_became_active":"2024-05-15T14:27:52.851642+0000","last_became_peered":"2024-05-15T14:27:52.851642+0000","last_unstale":"2024-05-15T14:49:13.850454+0000","last_undegraded":"2024-05-15T14:49:13.850454+0000","last_fullsized":"2024-05-15T14:49:13.850454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2024-05-15T14:49:13.850366+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2024-05-15T14:49:13.850366+0000","last_clean_scrub_stamp":"2024-05-15T14:49:13.850366+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:22:06.992558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":127,"num_write":38,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"39'26","reported_seq":120,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:15.078023+0000","last_change":"2024-05-15T14:49:15.078070+0000","last_active":"2024-05-15T14:49:15.078023+0000","last_peered":"2024-05-15T14:49:15.078023+0000","last_clean":"2024-05-15T14:49:15.078023+0000","last_became_active":"2024-05-15T14:27:50.840467+0000","last_became_peered":"2024-05-15T14:27:50.840467+0000","last_unstale":"2024-05-15T14:49:15.078023+0000","last_undegraded":"2024-05-15T14:49:15.078023+0000","last_fullsized":"2024-05-15T14:49:15.078023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'26","last_scrub_stamp":"2024-05-15T14:49:15.077923+0000","last_deep_scrub":"39'26","last_deep_scrub_stamp":"2024-05-15T14:49:15.077923+0000","last_clean_scrub_stamp":"2024-05-15T14:49:15.077923+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:14.720369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":130,"num_write_kb":35291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"39'92","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.171104+0000","last_change":"2024-05-15T14:49:19.171130+0000","last_active":"2024-05-15T14:49:19.171104+0000","last_peered":"2024-05-15T14:49:19.171104+0000","last_clean":"2024-05-15T14:49:19.171104+0000","last_became_active":"2024-05-15T14:27:52.859926+0000","last_became_peered":"2024-05-15T14:27:52.859926+0000","last_unstale":"2024-05-15T14:49:19.171104+0000","last_undegraded":"2024-05-15T14:49:19.171104+0000","last_fullsized":"2024-05-15T14:49:19.171104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2024-05-15T14:49:19.171010+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2024-05-15T14:49:19.171010+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.171010+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:55.591396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":270,"num_write":132,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"39'24","reported_seq":114,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.583649+0000","last_change":"2024-05-15T14:49:34.583673+0000","last_active":"2024-05-15T14:49:34.583649+0000","last_peered":"2024-05-15T14:49:34.583649+0000","last_clean":"2024-05-15T14:49:34.583649+0000","last_became_active":"2024-05-15T14:27:50.849936+0000","last_became_peered":"2024-05-15T14:27:50.849936+0000","last_unstale":"2024-05-15T14:49:34.583649+0000","last_undegraded":"2024-05-15T14:49:34.583649+0000","last_fullsized":"2024-05-15T14:49:34.583649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'24","last_scrub_stamp":"2024-05-15T14:49:34.583559+0000","last_deep_scrub":"39'24","last_deep_scrub_stamp":"2024-05-15T14:49:34.583559+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.583559+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:10:42.889967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":112,"num_write_kb":36442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"39'62","reported_seq":171,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:19.630250+0000","last_change":"2024-05-15T14:49:19.630277+0000","last_active":"2024-05-15T14:49:19.630250+0000","last_peered":"2024-05-15T14:49:19.630250+0000","last_clean":"2024-05-15T14:49:19.630250+0000","last_became_active":"2024-05-15T14:27:52.856767+0000","last_became_peered":"2024-05-15T14:27:52.856767+0000","last_unstale":"2024-05-15T14:49:19.630250+0000","last_undegraded":"2024-05-15T14:49:19.630250+0000","last_fullsized":"2024-05-15T14:49:19.630250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'62","last_scrub_stamp":"2024-05-15T14:49:19.630152+0000","last_deep_scrub":"39'62","last_deep_scrub_stamp":"2024-05-15T14:49:19.630152+0000","last_clean_scrub_stamp":"2024-05-15T14:49:19.630152+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:26:20.896798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":205,"num_write":87,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"39'18","reported_seq":105,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:07.338853+0000","last_change":"2024-05-15T14:49:07.338895+0000","last_active":"2024-05-15T14:49:07.338853+0000","last_peered":"2024-05-15T14:49:07.338853+0000","last_clean":"2024-05-15T14:49:07.338853+0000","last_became_active":"2024-05-15T14:27:50.842512+0000","last_became_peered":"2024-05-15T14:27:50.842512+0000","last_unstale":"2024-05-15T14:49:07.338853+0000","last_undegraded":"2024-05-15T14:49:07.338853+0000","last_fullsized":"2024-05-15T14:49:07.338853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:07.338747+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:07.338747+0000","last_clean_scrub_stamp":"2024-05-15T14:49:07.338747+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:46:29.168239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":36,"num_write":90,"num_write_kb":26460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"39'56","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:12.881484+0000","last_change":"2024-05-15T14:49:12.881484+0000","last_active":"2024-05-15T14:49:12.881484+0000","last_peered":"2024-05-15T14:49:12.881484+0000","last_clean":"2024-05-15T14:49:12.881484+0000","last_became_active":"2024-05-15T14:27:52.854841+0000","last_became_peered":"2024-05-15T14:27:52.854841+0000","last_unstale":"2024-05-15T14:49:12.881484+0000","last_undegraded":"2024-05-15T14:49:12.881484+0000","last_fullsized":"2024-05-15T14:49:12.881484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'56","last_scrub_stamp":"2024-05-15T14:49:12.881296+0000","last_deep_scrub":"39'56","last_deep_scrub_stamp":"2024-05-15T14:49:12.881296+0000","last_clean_scrub_stamp":"2024-05-15T14:49:12.881296+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:54:16.688582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":78,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"39'20","reported_seq":109,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:29.025657+0000","last_change":"2024-05-15T14:49:29.025682+0000","last_active":"2024-05-15T14:49:29.025657+0000","last_peered":"2024-05-15T14:49:29.025657+0000","last_clean":"2024-05-15T14:49:29.025657+0000","last_became_active":"2024-05-15T14:27:50.848291+0000","last_became_peered":"2024-05-15T14:27:50.848291+0000","last_unstale":"2024-05-15T14:49:29.025657+0000","last_undegraded":"2024-05-15T14:49:29.025657+0000","last_fullsized":"2024-05-15T14:49:29.025657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'20","last_scrub_stamp":"2024-05-15T14:49:29.025562+0000","last_deep_scrub":"39'20","last_deep_scrub_stamp":"2024-05-15T14:49:29.025562+0000","last_clean_scrub_stamp":"2024-05-15T14:49:29.025562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:19.151530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":40,"num_write":100,"num_write_kb":23521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"39'18","reported_seq":103,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:34.007543+0000","last_change":"2024-05-15T14:49:34.007605+0000","last_active":"2024-05-15T14:49:34.007543+0000","last_peered":"2024-05-15T14:49:34.007543+0000","last_clean":"2024-05-15T14:49:34.007543+0000","last_became_active":"2024-05-15T14:27:50.842420+0000","last_became_peered":"2024-05-15T14:27:50.842420+0000","last_unstale":"2024-05-15T14:49:34.007543+0000","last_undegraded":"2024-05-15T14:49:34.007543+0000","last_fullsized":"2024-05-15T14:49:34.007543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'18","last_scrub_stamp":"2024-05-15T14:49:34.007442+0000","last_deep_scrub":"39'18","last_deep_scrub_stamp":"2024-05-15T14:49:34.007442+0000","last_clean_scrub_stamp":"2024-05-15T14:49:34.007442+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:58:51.376517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":90,"num_write_kb":20587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'14","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.204045+0000","last_change":"2024-05-15T14:49:18.204045+0000","last_active":"2024-05-15T14:49:18.204045+0000","last_peered":"2024-05-15T14:49:18.204045+0000","last_clean":"2024-05-15T14:49:18.204045+0000","last_became_active":"2024-05-15T14:27:52.853329+0000","last_became_peered":"2024-05-15T14:27:52.853329+0000","last_unstale":"2024-05-15T14:49:18.204045+0000","last_undegraded":"2024-05-15T14:49:18.204045+0000","last_fullsized":"2024-05-15T14:49:18.204045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'14","last_scrub_stamp":"2024-05-15T14:49:18.203851+0000","last_deep_scrub":"39'14","last_deep_scrub_stamp":"2024-05-15T14:49:18.203851+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.203851+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:29:03.913933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"39'16","reported_seq":100,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:20.971863+0000","last_change":"2024-05-15T14:49:20.971893+0000","last_active":"2024-05-15T14:49:20.971863+0000","last_peered":"2024-05-15T14:49:20.971863+0000","last_clean":"2024-05-15T14:49:20.971863+0000","last_became_active":"2024-05-15T14:27:50.839496+0000","last_became_peered":"2024-05-15T14:27:50.839496+0000","last_unstale":"2024-05-15T14:49:20.971863+0000","last_undegraded":"2024-05-15T14:49:20.971863+0000","last_fullsized":"2024-05-15T14:49:20.971863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'16","last_scrub_stamp":"2024-05-15T14:49:20.971755+0000","last_deep_scrub":"39'16","last_deep_scrub_stamp":"2024-05-15T14:49:20.971755+0000","last_clean_scrub_stamp":"2024-05-15T14:49:20.971755+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:39:44.351624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":80,"num_write_kb":17647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"39'70","reported_seq":195,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-15T14:49:18.109324+0000","last_change":"2024-05-15T14:49:18.109324+0000","last_active":"2024-05-15T14:49:18.109324+0000","last_peered":"2024-05-15T14:49:18.109324+0000","last_clean":"2024-05-15T14:49:18.109324+0000","last_became_active":"2024-05-15T14:27:52.851973+0000","last_became_peered":"2024-05-15T14:27:52.851973+0000","last_unstale":"2024-05-15T14:49:18.109324+0000","last_undegraded":"2024-05-15T14:49:18.109324+0000","last_fullsized":"2024-05-15T14:49:18.109324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'70","last_scrub_stamp":"2024-05-15T14:49:18.109179+0000","last_deep_scrub":"39'70","last_deep_scrub_stamp":"2024-05-15T14:49:18.109179+0000","last_clean_scrub_stamp":"2024-05-15T14:49:18.109179+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:27:59.326269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":234,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3423,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1381,"num_read_kb":1449,"num_write":1045,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":6846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11724,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":2162820,"num_read_kb":7062227,"num_write":12291,"num_write_kb":15784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30692,"num_omap_keys":82,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1949,"ondisk_log_size":1949,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":14929,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5671,"num_read_kb":6915,"num_write":192,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":29858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9598,"num_read_kb":7988,"num_write":3212,"num_write_kb":1308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2246,"ondisk_log_size":2246,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2611,"num_read_kb":1724,"num_write":4445,"num_write_kb":1235021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":913,"ondisk_log_size":913,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575118,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40588,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331252,"statfs":{"total":96636764160,"available":96595202048,"internally_reserved":0,"allocated":1118208,"data_stored":815108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575119,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35812,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":487424,"data_stored":221551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575118,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":536576,"data_stored":225223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575119,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":227462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575119,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45584,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326256,"statfs":{"total":96636764160,"available":96590086144,"internally_reserved":0,"allocated":532480,"data_stored":222205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575119,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":491520,"data_stored":224011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575119,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":516096,"data_stored":222247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575120,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1118208,"data_stored":816897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":68,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T14:50:04.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-15T14:50:05.283 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-15T14:50:05.284 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-15T14:50:05.284 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-15T14:50:05.284 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.322 INFO:tasks.ceph.osd.0:Stopped 2024-05-15T14:50:05.322 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-15T14:50:05.322 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.399 INFO:tasks.ceph.osd.1:Stopped 2024-05-15T14:50:05.400 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-15T14:50:05.400 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.466 INFO:tasks.ceph.osd.2:Stopped 2024-05-15T14:50:05.467 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-15T14:50:05.467 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.542 INFO:tasks.ceph.osd.3:Stopped 2024-05-15T14:50:05.543 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-15T14:50:05.543 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.589 INFO:tasks.ceph.osd.4:Stopped 2024-05-15T14:50:05.589 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-15T14:50:05.589 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.626 INFO:tasks.ceph.osd.5:Stopped 2024-05-15T14:50:05.627 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-15T14:50:05.627 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.702 INFO:tasks.ceph.osd.6:Stopped 2024-05-15T14:50:05.703 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-15T14:50:05.703 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.779 INFO:tasks.ceph.osd.7:Stopped 2024-05-15T14:50:05.780 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-15T14:50:05.780 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-15T14:50:05.780 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.806 INFO:tasks.ceph.mgr.y:Stopped 2024-05-15T14:50:05.806 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-15T14:50:05.806 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.852 INFO:tasks.ceph.mgr.x:Stopped 2024-05-15T14:50:05.852 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-15T14:50:05.852 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-15T14:50:05.852 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.865 INFO:tasks.ceph.mon.a:Stopped 2024-05-15T14:50:05.865 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-15T14:50:05.865 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.917 INFO:tasks.ceph.mon.c:Stopped 2024-05-15T14:50:05.917 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-15T14:50:05.917 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T14:50:05.930 INFO:tasks.ceph.mon.b:Stopped 2024-05-15T14:50:05.930 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-15T14:50:05.931 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-05-15T14:50:05.987 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:50:05.987 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-15T14:50:06.365 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:50:06.365 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-15T14:50:06.447 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:50:06.447 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-15T14:50:06.496 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:50:06.497 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-15T14:50:06.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:50:06.556 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-15T14:50:06.674 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:50:06.675 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-15T14:50:06.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:50:06.771 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-15T14:50:06.819 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:50:06.819 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-15T14:50:06.861 INFO:tasks.ceph:Archiving mon data... 2024-05-15T14:50:06.862 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/data/mon.a.tgz 2024-05-15T14:50:06.862 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-05-15T14:50:06.879 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.8lG0fDmUHg 2024-05-15T14:50:06.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8lG0fDmUHg 2024-05-15T14:50:07.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.8lG0fDmUHg 2024-05-15T14:50:07.126 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.8lG0fDmUHg is 351KB 2024-05-15T14:50:07.224 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.8lG0fDmUHg 2024-05-15T14:50:07.239 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/data/mon.c.tgz 2024-05-15T14:50:07.239 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-05-15T14:50:07.295 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.nR0oCkE6um 2024-05-15T14:50:07.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.nR0oCkE6um 2024-05-15T14:50:07.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.nR0oCkE6um 2024-05-15T14:50:07.538 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.nR0oCkE6um is 387KB 2024-05-15T14:50:07.635 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.nR0oCkE6um 2024-05-15T14:50:07.651 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/data/mon.b.tgz 2024-05-15T14:50:07.651 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-05-15T14:50:07.670 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.Pv5aVoIIhL 2024-05-15T14:50:07.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Pv5aVoIIhL 2024-05-15T14:50:07.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.Pv5aVoIIhL 2024-05-15T14:50:07.931 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.Pv5aVoIIhL is 387KB 2024-05-15T14:50:08.031 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.Pv5aVoIIhL 2024-05-15T14:50:08.047 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-15T14:50:08.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T14:50:08.050 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T14:50:08.133 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T14:50:08.165 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T14:50:08.165 INFO:tasks.ceph:Archiving crash dumps... 2024-05-15T14:50:08.167 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/remote/smithi018/crash 2024-05-15T14:50:08.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T14:50:08.202 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/remote/smithi070/crash 2024-05-15T14:50:08.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T14:50:08.229 INFO:tasks.ceph:Compressing logs... 2024-05-15T14:50:08.230 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T14:50:08.246 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T14:50:08.325 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34069.log 2024-05-15T14:50:08.326 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40372.log 2024-05-15T14:50:08.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39773.log 2024-05-15T14:50:08.326 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34069.log.gz 2024-05-15T14:50:08.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.1.40372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33949.log 2024-05-15T14:50:08.326 INFO:teuthology.orchestra.run.smithi070.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.1.40372.log.gz 2024-05-15T14:50:08.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.1.39773.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-15T14:50:08.326 INFO:teuthology.orchestra.run.smithi070.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.1.39773.log.gz 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39071.log 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33949.log.gz 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39031.log 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39071.log.gz 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33904.log 2024-05-15T14:50:08.327 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39031.log.gz 2024-05-15T14:50:08.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-15T14:50:08.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33904.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-15T14:50:08.328 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33904.log.gz 2024-05-15T14:50:08.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.7.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-15T14:50:08.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-15T14:50:08.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40971.log 2024-05-15T14:50:08.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.4.log: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-15T14:50:08.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43132.log 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39111.log 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.1.40971.log: 43.9% -- replaced with /var/log/ceph/ceph-client.1.40971.log.gz 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.1.43132.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.1.log 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr: 92.9%/var/log/ceph/ceph-client.admin.39111.log: -- replaced with /var/log/ceph/ceph-client.1.43132.log.gz 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39111.log.gz 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33778.log 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ops-log-ceph-client.1.log: 34.9% -- replaced with /var/log/ceph/ops-log-ceph-client.1.log.gz 2024-05-15T14:50:08.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33818.log 2024-05-15T14:50:08.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39174.log 2024-05-15T14:50:08.330 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33778.log.gz 2024-05-15T14:50:08.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33818.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-15T14:50:08.330 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33818.log.gz 2024-05-15T14:50:08.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.1.39174.log: gzip -5 --verbose -- 43.5% -- replaced with /var/log/ceph/ceph-client.1.39174.log.gz 2024-05-15T14:50:08.330 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/rgw.ceph.client.1.log 2024-05-15T14:50:08.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34029.log 2024-05-15T14:50:08.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/rgw.ceph.client.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39151.log 2024-05-15T14:50:08.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34029.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33858.log 2024-05-15T14:50:08.331 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34029.log.gz 2024-05-15T14:50:08.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39151.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-15T14:50:08.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39151.log.gz 2024-05-15T14:50:08.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33858.log.gz 2024-05-15T14:50:08.352 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40127.log 2024-05-15T14:50:08.352 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141017.log 2024-05-15T14:50:08.352 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59608.log 2024-05-15T14:50:08.352 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40127.log.gz 2024-05-15T14:50:08.352 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.141017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33794.log 2024-05-15T14:50:08.352 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.141017.log.gz 2024-05-15T14:50:08.352 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131290.log 2024-05-15T14:50:08.353 INFO:teuthology.orchestra.run.smithi018.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.59608.log.gz 2024-05-15T14:50:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199762.log 2024-05-15T14:50:08.353 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33794.log.gz 2024-05-15T14:50:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.131290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197354.log 2024-05-15T14:50:08.353 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.131290.log.gz 2024-05-15T14:50:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.199762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226379.log 2024-05-15T14:50:08.353 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.199762.log.gz 2024-05-15T14:50:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.197354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217951.log 2024-05-15T14:50:08.354 INFO:teuthology.orchestra.run.smithi018.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.197354.log.gz 2024-05-15T14:50:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156168.log 2024-05-15T14:50:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.226379.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.226379.log.gz 2024-05-15T14:50:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.217951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109549.log 2024-05-15T14:50:08.354 INFO:teuthology.orchestra.run.smithi018.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.217951.log.gz 2024-05-15T14:50:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.156168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96303.log 2024-05-15T14:50:08.354 INFO:teuthology.orchestra.run.smithi018.stderr: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.156168.log.gz 2024-05-15T14:50:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.109549.log: /var/log/ceph/ceph-client.admin.39077.log 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109549.log.gz 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.96303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233856.log 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.96303.log.gz 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150048.log 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39077.log.gz 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.233856.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.233856.log.gz -5 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51853.log 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.150048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118648.log 2024-05-15T14:50:08.355 INFO:teuthology.orchestra.run.smithi018.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.150048.log.gz 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182823.log 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.51853.log.gz 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.118648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227666.log 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.118648.log.gz 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.182823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39936.log 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.182823.log.gz 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233940.log 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.227666.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.227666.log.gz 2024-05-15T14:50:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167600.log 2024-05-15T14:50:08.357 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39936.log.gz 2024-05-15T14:50:08.357 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.233940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142221.log 2024-05-15T14:50:08.357 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233940.log.gz 2024-05-15T14:50:08.357 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.167600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144629.log 2024-05-15T14:50:08.357 INFO:teuthology.orchestra.run.smithi018.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.167600.log.gz 2024-05-15T14:50:08.357 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.142221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102324.log 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.142221.log.gz 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228268.log 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.144629.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.144629.log.gz 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.102324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39338.log 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.102324.log.gz 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79423.log 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.228268.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.228268.log.gz 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210125.log 2024-05-15T14:50:08.358 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39338.log.gz 2024-05-15T14:50:08.359 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.79423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39678.log 2024-05-15T14:50:08.359 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.79423.log.gz 2024-05-15T14:50:08.359 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.210125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196067.log 2024-05-15T14:50:08.359 INFO:teuthology.orchestra.run.smithi018.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.210125.log.gz 2024-05-15T14:50:08.359 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86991.log 2024-05-15T14:50:08.359 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39678.log.gz 2024-05-15T14:50:08.359 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.196067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183425.log 2024-05-15T14:50:08.359 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.196067.log.gz 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.86991.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39559.log 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.86991.log.gz 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.183425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132494.log 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.183425.log.gz 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161580.log 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39559.log.gz 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90271.log 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.132494.log: /var/log/ceph/ceph-client.admin.161580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194863.log 2024-05-15T14:50:08.360 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.132494.log.gz 2024-05-15T14:50:08.361 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.161580.log.gz 2024-05-15T14:50:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.90271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158570.log 2024-05-15T14:50:08.361 INFO:teuthology.orchestra.run.smithi018.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.90271.log.gz 2024-05-15T14:50:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.194863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213737.log 2024-05-15T14:50:08.361 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.194863.log.gz 2024-05-15T14:50:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.158570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38945.log 2024-05-15T14:50:08.361 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.158570.log.gz 2024-05-15T14:50:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.213737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65107.log 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.213737.log.gz 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44522.log 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38945.log.gz 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.65107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39343.log 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.65107.log.gz 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.44522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184027.log 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44522.log.gz 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50047.log 2024-05-15T14:50:08.362 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39343.log.gz 2024-05-15T14:50:08.363 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.184027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207653.log 2024-05-15T14:50:08.363 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.184027.log.gz 2024-05-15T14:50:08.363 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187037.log 2024-05-15T14:50:08.363 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50047.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.50047.log.gz 2024-05-15T14:50:08.363 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.207653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199160.log 2024-05-15T14:50:08.363 INFO:teuthology.orchestra.run.smithi018.stderr: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.207653.log.gz 2024-05-15T14:50:08.364 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.187037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39937.log 2024-05-15T14:50:08.364 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.187037.log.gz 2024-05-15T14:50:08.364 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-15T14:50:08.364 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.199160.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.199160.log.gz 2024-05-15T14:50:08.364 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209529.log 2024-05-15T14:50:08.364 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39937.log.gz 2024-05-15T14:50:08.364 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216145.log 2024-05-15T14:50:08.365 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170008.log 2024-05-15T14:50:08.365 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.209529.log: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.209529.log.gz 2024-05-15T14:50:08.365 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.216145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234444.log 2024-05-15T14:50:08.365 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.216145.log.gz 2024-05-15T14:50:08.365 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.170008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207057.log 2024-05-15T14:50:08.365 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.170008.log.gz 2024-05-15T14:50:08.365 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138007.log 2024-05-15T14:50:08.365 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234444.log.gz 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.207057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222767.log 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.admin.207057.log.gz 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.138007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208933.log 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.138007.log.gz 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.222767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67589.log 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.222767.log.gz 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.208933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133781.log 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.admin.208933.log.gz 2024-05-15T14:50:08.366 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.67589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211931.log 2024-05-15T14:50:08.367 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.67589.log.gz 2024-05-15T14:50:08.367 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.133781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225175.log 2024-05-15T14:50:08.367 INFO:teuthology.orchestra.run.smithi018.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133781.log.gz 2024-05-15T14:50:08.367 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.211931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39333.log 2024-05-15T14:50:08.367 INFO:teuthology.orchestra.run.smithi018.stderr: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-15T14:50:08.367 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.211931.log.gz 2024-05-15T14:50:08.367 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.225175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234782.log 2024-05-15T14:50:08.367 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.225175.log.gz 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.39333.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39671.log 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39333.log.gz 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234782.log.gz 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52455.log 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39671.log.gz 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69417.log 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112559.log 2024-05-15T14:50:08.368 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.52455.log.gz 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118046.log 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.69417.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.69417.log.gz 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.112559.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.156764.log 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.admin.112559.log.gz 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.118046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34096.log 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.118046.log.gz 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.156764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68805.log 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.156764.log.gz 2024-05-15T14:50:08.369 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90873.log 2024-05-15T14:50:08.370 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34096.log.gz 2024-05-15T14:50:08.370 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.68805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189445.log 2024-05-15T14:50:08.370 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.68805.log.gz 2024-05-15T14:50:08.370 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.90873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162182.log 2024-05-15T14:50:08.370 INFO:teuthology.orchestra.run.smithi018.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.90873.log.gz 2024-05-15T14:50:08.370 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.189445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82191.log 2024-05-15T14:50:08.370 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.189445.log.gz 2024-05-15T14:50:08.370 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.162182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187639.log 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.162182.log.gz 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.82191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101120.log 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.82191.log.gz 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.187639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97507.log 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.187639.log.gz 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.101120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178539.log 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101120.log.gz 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.97507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223971.log 2024-05-15T14:50:08.371 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97507.log.gz 2024-05-15T14:50:08.372 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.178539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166396.log 2024-05-15T14:50:08.372 INFO:teuthology.orchestra.run.smithi018.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.178539.log.gz 2024-05-15T14:50:08.372 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.223971.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-15T14:50:08.372 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.223971.log.gz 2024-05-15T14:50:08.372 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.166396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211329.log 2024-05-15T14:50:08.372 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.166396.log.gz 2024-05-15T14:50:08.372 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39676.log 2024-05-15T14:50:08.372 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.211329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212533.log 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.211329.log.gz 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39676.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.111957.log -- replaced with /var/log/ceph/ceph-client.admin.39676.log.gz 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.212533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73074.log 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.212533.log.gz 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.111957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114436.log 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.111957.log.gz 2024-05-15T14:50:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.73074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117444.log 2024-05-15T14:50:08.374 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.73074.log.gz 2024-05-15T14:50:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.114436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229472.log 2024-05-15T14:50:08.374 INFO:teuthology.orchestra.run.smithi018.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.114436.log.gz 2024-05-15T14:50:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.117444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131892.log 2024-05-15T14:50:08.374 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.117444.log.gz 2024-05-15T14:50:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.229472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107743.log 2024-05-15T14:50:08.374 INFO:teuthology.orchestra.run.smithi018.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.229472.log.gz 2024-05-15T14:50:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.131892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176745.log 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.131892.log.gz 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.107743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92679.log 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.107743.log.gz 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.176745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143425.log 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.176745.log.gz 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.92679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115650.log 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.92679.log.gz 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.143425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223369.log 2024-05-15T14:50:08.375 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.143425.log.gz 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.115650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191853.log 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.admin.115650.log.gz 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.223369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201568.log 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.223369.log.gz 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.191853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168804.log 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.191853.log.gz 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.201568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53659.log 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.201568.log.gz 2024-05-15T14:50:08.376 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.168804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145834.log 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.168804.log.gz 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234150.log 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.53659.log.gz 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.145834.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.145834.log.gz 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152458.log 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234150.log.gz 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168202.log 2024-05-15T14:50:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.152458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133179.log 2024-05-15T14:50:08.378 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.152458.log.gz 2024-05-15T14:50:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.168202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157366.log 2024-05-15T14:50:08.378 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.168202.log.gz 2024-05-15T14:50:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146436.log 2024-05-15T14:50:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.133179.log: /var/log/ceph/ceph-client.admin.157366.log: gzip 81.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.133179.log.gz --verbose 2024-05-15T14:50:08.378 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.39677.log 2024-05-15T14:50:08.378 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.157366.log.gz 2024-05-15T14:50:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.146436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210727.log 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.146436.log.gz 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39677.log.gz 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153060.log 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120454.log 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.210727.log: /var/log/ceph/ceph-client.admin.153060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102926.log 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.210727.log.gz 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.153060.log.gz 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.120454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197956.log 2024-05-15T14:50:08.379 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.120454.log.gz 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39675.log/var/log/ceph/ceph-client.admin.102926.log: 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102926.log.gz 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.197956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104130.log 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.197956.log.gz 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39675.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39675.log.gz -5 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.115048.log 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.104130.log: gzip -5 --verbose 81.9% -- -- replaced with /var/log/ceph/ceph-client.admin.104130.log.gz 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.234234.log 2024-05-15T14:50:08.380 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134393.log 2024-05-15T14:50:08.381 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.115048.log: /var/log/ceph/ceph-client.admin.234234.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.115048.log.gz 2024-05-15T14:50:08.381 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234234.log.gz 2024-05-15T14:50:08.381 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85558.log 2024-05-15T14:50:08.381 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.134393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65709.log 2024-05-15T14:50:08.381 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.134393.log.gz 2024-05-15T14:50:08.381 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.85558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106539.log 2024-05-15T14:50:08.382 INFO:teuthology.orchestra.run.smithi018.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.85558.log.gz 2024-05-15T14:50:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129484.log 2024-05-15T14:50:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.65709.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.65709.log.gz 2024-05-15T14:50:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.106539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34199.log 2024-05-15T14:50:08.382 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106539.log.gz 2024-05-15T14:50:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179223.log 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.129484.log: /var/log/ceph/ceph-client.admin.34199.log: gzip 80.2% -- replaced with /var/log/ceph/ceph-client.admin.129484.log.gz -5 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34199.log.gz 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.179223.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.217349.log 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.admin.179223.log.gz 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.232485.log 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.217349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84207.log 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.217349.log.gz 2024-05-15T14:50:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234192.log 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.232485.log: /var/log/ceph/ceph-client.admin.84207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200966.log 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.84207.log.gz 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.0.232485.log.gz 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64505.log 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234192.log.gz 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215543.log 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.200966.log: /var/log/ceph/ceph-client.admin.64505.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.200966.log.gz 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234108.log 2024-05-15T14:50:08.384 INFO:teuthology.orchestra.run.smithi018.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.64505.log.gz 2024-05-15T14:50:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.215543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234528.log 2024-05-15T14:50:08.385 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.215543.log.gz 2024-05-15T14:50:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147038.log 2024-05-15T14:50:08.385 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234108.log.gz 2024-05-15T14:50:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.234528.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.125872.log 2024-05-15T14:50:08.385 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234528.log.gz 2024-05-15T14:50:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.147038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193659.log 2024-05-15T14:50:08.385 INFO:teuthology.orchestra.run.smithi018.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147038.log.gz 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.125872.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.125872.log.gz 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.193659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39556.log 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.193659.log.gz 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154271.log 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.39556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159774.log 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39556.log.gz 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.154271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170610.log 2024-05-15T14:50:08.386 INFO:teuthology.orchestra.run.smithi018.stderr: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.154271.log.gz 2024-05-15T14:50:08.387 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.159774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234360.log 2024-05-15T14:50:08.387 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.159774.log.gz 2024-05-15T14:50:08.387 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.170610.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-15T14:50:08.387 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.170610.log.gz 2024-05-15T14:50:08.387 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234360.log.gz 2024-05-15T14:50:08.387 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121056.log 2024-05-15T14:50:08.387 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100518.log 2024-05-15T14:50:08.387 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.121056.log: gzip -5 93.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.121056.log.gz 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.100518.log: gzip 81.8% -- replaced with /var/log/ceph/ceph-client.admin.100518.log.gz -5 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40043.log 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126474.log 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40043.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40043.log.gz 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.139813.log 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.126474.log: gzip -5 --verbose 80.2% -- replaced with /var/log/ceph/ceph-client.admin.126474.log.gz 2024-05-15T14:50:08.388 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.219757.log 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.139813.log: gzip -5 82.0% -- replaced with /var/log/ceph/ceph-client.admin.139813.log.gz 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.0.42113.log 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.219757.log: gzip -5 --verbose -- 80.2% -- replaced with /var/log/ceph/ceph-client.admin.219757.log.gz 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-osd.0.log 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.42113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39341.log 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137405.log 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.42113.log.gz 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39341.log.gz 2024-05-15T14:50:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136803.log 2024-05-15T14:50:08.390 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.137405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116246.log 2024-05-15T14:50:08.390 INFO:teuthology.orchestra.run.smithi018.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.137405.log.gz 2024-05-15T14:50:08.390 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.136803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231278.log 2024-05-15T14:50:08.390 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.116246.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136803.log.gz 2024-05-15T14:50:08.390 INFO:teuthology.orchestra.run.smithi018.stderr: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.116246.log.gz 2024-05-15T14:50:08.390 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99916.log 2024-05-15T14:50:08.390 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.231278.log: gzip -5 --verbose 81.8% -- replaced with /var/log/ceph/ceph-client.admin.231278.log.gz 2024-05-15T14:50:08.390 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.40249.log 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40249.log: /var/log/ceph/ceph-client.admin.99916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40249.log.gz 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.99916.log.gz 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224573.log 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163988.log 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.224573.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27975.log 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.224573.log.gz 2024-05-15T14:50:08.391 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.163988.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.163988.log.gz 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166998.log 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.tmp-client.admin.27975.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27975.log.gz 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.166998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107141.log 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.166998.log.gz 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47639.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40915.log 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98109.log 2024-05-15T14:50:08.392 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.107141.log: /var/log/ceph/ceph-client.0.40915.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.107141.log.gz 2024-05-15T14:50:08.393 INFO:teuthology.orchestra.run.smithi018.stderr: 42.8% -- replaced with /var/log/ceph/ceph-client.0.40915.log.gz 2024-05-15T14:50:08.393 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134997.log 2024-05-15T14:50:08.393 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193057.log 2024-05-15T14:50:08.393 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.98109.log: /var/log/ceph/ceph-client.admin.134997.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98109.log.gz 2024-05-15T14:50:08.393 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.134997.log.gz 2024-05-15T14:50:08.393 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202772.log 2024-05-15T14:50:08.393 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.193057.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.193057.log.gz 2024-05-15T14:50:08.393 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83604.log 2024-05-15T14:50:08.394 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-15T14:50:08.394 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.202772.log: 43.9% -- replaced with /var/log/ceph/ceph-client.admin.202772.log.gz 2024-05-15T14:50:08.394 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.83604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173133.log 2024-05-15T14:50:08.394 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.83604.log.gz 2024-05-15T14:50:08.394 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.c.log: 94.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-15T14:50:08.394 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234402.log 2024-05-15T14:50:08.394 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.173133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39342.log 2024-05-15T14:50:08.394 INFO:teuthology.orchestra.run.smithi018.stderr: 82.4%/var/log/ceph/ceph-client.admin.234402.log: -- replaced with /var/log/ceph/ceph-client.admin.173133.log.gz 2024-05-15T14:50:08.395 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234402.log.gz 2024-05-15T14:50:08.429 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38887.log 2024-05-15T14:50:08.429 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39342.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184629.log 2024-05-15T14:50:08.429 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39342.log.gz 2024-05-15T14:50:08.429 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62677.log 2024-05-15T14:50:08.429 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38887.log: /var/log/ceph/ceph-client.admin.184629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38887.log.gz 2024-05-15T14:50:08.430 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.184629.log.gz 2024-05-15T14:50:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127678.log 2024-05-15T14:50:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163386.log 2024-05-15T14:50:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.127678.log: /var/log/ceph/ceph-client.admin.62677.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.62677.log.gz 2024-05-15T14:50:08.430 INFO:teuthology.orchestra.run.smithi018.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.127678.log.gz 2024-05-15T14:50:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39161.log 2024-05-15T14:50:08.430 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.163386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130688.log 2024-05-15T14:50:08.430 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.163386.log.gz 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39161.log.gz 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164590.log 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70643.log 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.130688.log: /var/log/ceph/ceph-client.admin.164590.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.130688.log.gz 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.164590.log.gz 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54261.log 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.70643.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.70643.log.gz 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111355.log 2024-05-15T14:50:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198558.log 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54261.log: /var/log/ceph/ceph-client.admin.111355.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.54261.log.gz 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.111355.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75497.log 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.198558.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.198558.log.gz 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41514.log 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116842.log 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.75497.log: /var/log/ceph/ceph-client.0.41514.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75497.log.gz 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41514.log.gz 2024-05-15T14:50:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172464.log 2024-05-15T14:50:08.433 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108345.log 2024-05-15T14:50:08.433 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.116842.log: /var/log/ceph/ceph-client.admin.172464.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.116842.log.gz 2024-05-15T14:50:08.433 INFO:teuthology.orchestra.run.smithi018.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.172464.log.gz 2024-05-15T14:50:08.433 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149446.log 2024-05-15T14:50:08.433 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.108345.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.108345.log.gz 2024-05-15T14:50:08.433 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95099.log 2024-05-15T14:50:08.433 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121658.log 2024-05-15T14:50:08.433 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.149446.log: /var/log/ceph/ceph-client.admin.95099.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.149446.log.gz 2024-05-15T14:50:08.434 INFO:teuthology.orchestra.run.smithi018.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95099.log.gz 2024-05-15T14:50:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-15T14:50:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.121658.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.121658.log.gz 2024-05-15T14:50:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203368.log 2024-05-15T14:50:08.434 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231880.log 2024-05-15T14:50:08.435 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.203368.log: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.203368.log.gz 2024-05-15T14:50:08.435 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72462.log 2024-05-15T14:50:08.435 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.231880.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.231880.log.gz 2024-05-15T14:50:08.435 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225777.log 2024-05-15T14:50:08.435 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.72462.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.72462.log.gz 2024-05-15T14:50:08.435 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130086.log 2024-05-15T14:50:08.435 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.225777.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.225777.log.gz 2024-05-15T14:50:08.435 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203964.log 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.130086.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.130086.log.gz 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78219.log 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.203964.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.203964.log.gz 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93283.log 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.78219.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.78219.log.gz 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165192.log 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.93283.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93283.log.gz 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208249.log 2024-05-15T14:50:08.436 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.165192.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.165192.log.gz 2024-05-15T14:50:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148242.log 2024-05-15T14:50:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.208249.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.208249.log.gz 2024-05-15T14:50:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144027.log 2024-05-15T14:50:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.148242.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.148242.log.gz 2024-05-15T14:50:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234823.log 2024-05-15T14:50:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.144027.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.144027.log.gz 2024-05-15T14:50:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48241.log 2024-05-15T14:50:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234823.log.gz 2024-05-15T14:50:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.233190.log 2024-05-15T14:50:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48241.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.48241.log.gz 2024-05-15T14:50:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53057.log 2024-05-15T14:50:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.233190.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.233190.log.gz 2024-05-15T14:50:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234486.log 2024-05-15T14:50:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53057.log: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.53057.log.gz 2024-05-15T14:50:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73677.log 2024-05-15T14:50:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234486.log.gz 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181619.log 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.73677.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.73677.log.gz 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177347.log 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.181619.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.181619.log.gz 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171212.log 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.177347.log: 43.9% -- replaced with /var/log/ceph/ceph-client.admin.177347.log.gz 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205770.log 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.171212.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.171212.log.gz 2024-05-15T14:50:08.439 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57271.log 2024-05-15T14:50:08.440 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.205770.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.205770.log.gz 2024-05-15T14:50:08.440 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155572.log 2024-05-15T14:50:08.440 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57271.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.57271.log.gz 2024-05-15T14:50:08.440 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88464.log 2024-05-15T14:50:08.440 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.155572.log: 44.2% -- replaced with /var/log/ceph/ceph-client.admin.155572.log.gz 2024-05-15T14:50:08.440 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185833.log 2024-05-15T14:50:08.440 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.88464.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88464.log.gz 2024-05-15T14:50:08.440 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173735.log 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.185833.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.185833.log.gz 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76099.log 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.173735.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.173735.log.gz 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159172.log 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.76099.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.76099.log.gz 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176143.log 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.159172.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.159172.log.gz 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204566.log 2024-05-15T14:50:08.441 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.176143.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.176143.log.gz 2024-05-15T14:50:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93895.log 2024-05-15T14:50:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.204566.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.204566.log.gz 2024-05-15T14:50:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63299.log 2024-05-15T14:50:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.93895.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93895.log.gz 2024-05-15T14:50:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221563.log 2024-05-15T14:50:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63299.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.63299.log.gz 2024-05-15T14:50:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192455.log 2024-05-15T14:50:08.442 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.221563.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.221563.log.gz 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181017.log 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.192455.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.192455.log.gz 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179819.log 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.181017.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.181017.log.gz 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39335.log 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.179819.log: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.179819.log.gz 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76732.log 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39335.log.gz 2024-05-15T14:50:08.443 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162784.log 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.76732.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.76732.log.gz 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91475.log 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.162784.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.162784.log.gz 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150650.log 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.91475.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.91475.log.gz 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214339.log 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.150650.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.150650.log.gz 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59003.log 2024-05-15T14:50:08.444 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.214339.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.214339.log.gz 2024-05-15T14:50:08.445 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142823.log 2024-05-15T14:50:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59003.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.59003.log.gz 2024-05-15T14:50:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68202.log 2024-05-15T14:50:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.142823.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.142823.log.gz 2024-05-15T14:50:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39895.log 2024-05-15T14:50:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.68202.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.68202.log.gz 2024-05-15T14:50:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39340.log 2024-05-15T14:50:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39895.log.gz 2024-05-15T14:50:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151252.log 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39340.log.gz 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82929.log 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.151252.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.151252.log.gz 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220359.log 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.82929.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.82929.log.gz 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60232.log 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.220359.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.220359.log.gz 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39875.log 2024-05-15T14:50:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60232.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.60232.log.gz 2024-05-15T14:50:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222165.log 2024-05-15T14:50:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39875.log.gz 2024-05-15T14:50:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220961.log 2024-05-15T14:50:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.222165.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.222165.log.gz 2024-05-15T14:50:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125270.log 2024-05-15T14:50:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.220961.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.220961.log.gz 2024-05-15T14:50:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205168.log 2024-05-15T14:50:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.125270.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.125270.log.gz 2024-05-15T14:50:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153675.log 2024-05-15T14:50:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.205168.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.205168.log.gz 2024-05-15T14:50:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190649.log 2024-05-15T14:50:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.153675.log: 43.5% -- replaced with /var/log/ceph/ceph-client.admin.153675.log.gz 2024-05-15T14:50:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40209.log 2024-05-15T14:50:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.190649.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.190649.log.gz 2024-05-15T14:50:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136201.log 2024-05-15T14:50:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40209.log.gz 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92077.log 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.136201.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.136201.log.gz 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145232.log 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.92077.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.92077.log.gz 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234612.log 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.145232.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145232.log.gz 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40085.log 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234612.log.gz 2024-05-15T14:50:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138609.log 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40085.log.gz 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78821.log 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.138609.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.138609.log.gz 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105335.log 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.78821.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.78821.log.gz 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39119.log 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.105335.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.105335.log.gz 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110151.log 2024-05-15T14:50:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39119.log.gz 2024-05-15T14:50:08.462 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140415.log 2024-05-15T14:50:08.462 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.110151.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.110151.log.gz 2024-05-15T14:50:08.462 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174337.log 2024-05-15T14:50:08.462 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.140415.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.140415.log.gz 2024-05-15T14:50:08.462 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171814.log 2024-05-15T14:50:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.174337.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.174337.log.gz 2024-05-15T14:50:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42725.log 2024-05-15T14:50:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.171814.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.171814.log.gz 2024-05-15T14:50:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101722.log 2024-05-15T14:50:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.42725.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42725.log.gz 2024-05-15T14:50:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228870.log 2024-05-15T14:50:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.101722.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101722.log.gz 2024-05-15T14:50:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182221.log 2024-05-15T14:50:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.228870.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.228870.log.gz 2024-05-15T14:50:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234276.log 2024-05-15T14:50:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.182221.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.182221.log.gz 2024-05-15T14:50:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214941.log 2024-05-15T14:50:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234276.log.gz 2024-05-15T14:50:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61445.log 2024-05-15T14:50:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.214941.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.214941.log.gz 2024-05-15T14:50:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194261.log 2024-05-15T14:50:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61445.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.61445.log.gz 2024-05-15T14:50:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141619.log 2024-05-15T14:50:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.194261.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.194261.log.gz 2024-05-15T14:50:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39339.log 2024-05-15T14:50:08.470 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.141619.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.141619.log.gz 2024-05-15T14:50:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40314.log 2024-05-15T14:50:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39339.log.gz 2024-05-15T14:50:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113751.log 2024-05-15T14:50:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.40314.log: 45.4% -- replaced with /var/log/ceph/ceph-client.0.40314.log.gz 2024-05-15T14:50:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122862.log 2024-05-15T14:50:08.473 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.113751.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.113751.log.gz 2024-05-15T14:50:08.474 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233982.log 2024-05-15T14:50:08.474 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.122862.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.122862.log.gz 2024-05-15T14:50:08.474 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151854.log 2024-05-15T14:50:08.474 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.233982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233982.log.gz 2024-05-15T14:50:08.474 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177943.log 2024-05-15T14:50:08.474 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.151854.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.151854.log.gz 2024-05-15T14:50:08.475 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80814.log 2024-05-15T14:50:08.475 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.177943.log: 51.1% -- replaced with /var/log/ceph/ceph-client.admin.177943.log.gz 2024-05-15T14:50:08.475 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71245.log 2024-05-15T14:50:08.475 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.80814.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.80814.log.gz 2024-05-15T14:50:08.475 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74293.log 2024-05-15T14:50:08.476 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.71245.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.71245.log.gz 2024-05-15T14:50:08.477 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128280.log 2024-05-15T14:50:08.477 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.74293.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.74293.log.gz 2024-05-15T14:50:08.477 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147640.log 2024-05-15T14:50:08.477 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.128280.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.128280.log.gz 2024-05-15T14:50:08.477 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77404.log 2024-05-15T14:50:08.478 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.147640.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147640.log.gz 2024-05-15T14:50:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186435.log 2024-05-15T14:50:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.77404.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.77404.log.gz 2024-05-15T14:50:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195465.log 2024-05-15T14:50:08.480 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.186435.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.186435.log.gz 2024-05-15T14:50:08.480 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86276.log 2024-05-15T14:50:08.480 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.195465.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.195465.log.gz 2024-05-15T14:50:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191251.log 2024-05-15T14:50:08.481 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.86276.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.86276.log.gz 2024-05-15T14:50:08.482 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188843.log 2024-05-15T14:50:08.482 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.191251.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.191251.log.gz 2024-05-15T14:50:08.483 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39679.log 2024-05-15T14:50:08.483 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.188843.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.188843.log.gz 2024-05-15T14:50:08.484 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216747.log 2024-05-15T14:50:08.484 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39679.log.gz 2024-05-15T14:50:08.484 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154867.log 2024-05-15T14:50:08.485 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.216747.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.216747.log.gz 2024-05-15T14:50:08.486 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188241.log 2024-05-15T14:50:08.486 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.154867.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.154867.log.gz 2024-05-15T14:50:08.486 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160376.log 2024-05-15T14:50:08.487 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.188241.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.188241.log.gz 2024-05-15T14:50:08.488 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213135.log 2024-05-15T14:50:08.488 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.160376.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.160376.log.gz 2024-05-15T14:50:08.488 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56067.log 2024-05-15T14:50:08.489 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.213135.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.213135.log.gz 2024-05-15T14:50:08.490 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160978.log 2024-05-15T14:50:08.490 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56067.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.56067.log.gz 2024-05-15T14:50:08.490 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87826.log 2024-05-15T14:50:08.491 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.160978.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.160978.log.gz 2024-05-15T14:50:08.491 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230676.log 2024-05-15T14:50:08.492 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.87826.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.87826.log.gz 2024-05-15T14:50:08.492 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227064.log 2024-05-15T14:50:08.493 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.230676.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.230676.log.gz 2024-05-15T14:50:08.493 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185231.log 2024-05-15T14:50:08.494 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.227064.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.227064.log.gz 2024-05-15T14:50:08.495 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80025.log 2024-05-15T14:50:08.495 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.185231.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.185231.log.gz 2024-05-15T14:50:08.495 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196752.log 2024-05-15T14:50:08.496 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.80025.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.80025.log.gz 2024-05-15T14:50:08.496 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89669.log 2024-05-15T14:50:08.497 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.196752.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.196752.log.gz 2024-05-15T14:50:08.497 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51251.log 2024-05-15T14:50:08.498 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.89669.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.89669.log.gz 2024-05-15T14:50:08.498 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43324.log 2024-05-15T14:50:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51251.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.51251.log.gz 2024-05-15T14:50:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103528.log 2024-05-15T14:50:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.43324.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.43324.log.gz 2024-05-15T14:50:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174939.log 2024-05-15T14:50:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.103528.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103528.log.gz 2024-05-15T14:50:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55465.log 2024-05-15T14:50:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.174939.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.174939.log.gz 2024-05-15T14:50:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66381.log 2024-05-15T14:50:08.505 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55465.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.55465.log.gz 2024-05-15T14:50:08.505 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234739.log 2024-05-15T14:50:08.505 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.66381.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.66381.log.gz 2024-05-15T14:50:08.505 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70022.log 2024-05-15T14:50:08.505 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234739.log.gz 2024-05-15T14:50:08.506 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71858.log 2024-05-15T14:50:08.506 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.70022.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.70022.log.gz 2024-05-15T14:50:08.506 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219155.log 2024-05-15T14:50:08.507 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.71858.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.71858.log.gz 2024-05-15T14:50:08.507 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234697.log 2024-05-15T14:50:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.219155.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.219155.log.gz 2024-05-15T14:50:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54863.log 2024-05-15T14:50:08.509 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234697.log.gz 2024-05-15T14:50:08.509 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56669.log 2024-05-15T14:50:08.510 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54863.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.54863.log.gz 2024-05-15T14:50:08.510 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190047.log 2024-05-15T14:50:08.511 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56669.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.56669.log.gz 2024-05-15T14:50:08.511 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119852.log 2024-05-15T14:50:08.511 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.190047.log: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.190047.log.gz 2024-05-15T14:50:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206372.log 2024-05-15T14:50:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.119852.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.119852.log.gz 2024-05-15T14:50:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48843.log 2024-05-15T14:50:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.206372.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.206372.log.gz 2024-05-15T14:50:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89067.log 2024-05-15T14:50:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48843.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.48843.log.gz 2024-05-15T14:50:08.515 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234654.log 2024-05-15T14:50:08.515 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.89067.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.89067.log.gz 2024-05-15T14:50:08.516 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234024.log 2024-05-15T14:50:08.516 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234654.log.gz 2024-05-15T14:50:08.517 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98711.log 2024-05-15T14:50:08.517 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234024.log.gz 2024-05-15T14:50:08.518 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233814.log 2024-05-15T14:50:08.519 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.98711.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.98711.log.gz 2024-05-15T14:50:08.519 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110753.log 2024-05-15T14:50:08.519 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.233814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233814.log.gz 2024-05-15T14:50:08.520 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165794.log 2024-05-15T14:50:08.520 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.110753.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.110753.log.gz 2024-05-15T14:50:08.521 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180415.log 2024-05-15T14:50:08.521 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.165794.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.165794.log.gz 2024-05-15T14:50:08.521 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148844.log 2024-05-15T14:50:08.522 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.180415.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.180415.log.gz 2024-05-15T14:50:08.523 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63903.log 2024-05-15T14:50:08.523 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.148844.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.148844.log.gz 2024-05-15T14:50:08.523 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127076.log 2024-05-15T14:50:08.524 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63903.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.63903.log.gz 2024-05-15T14:50:08.525 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94497.log 2024-05-15T14:50:08.525 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.127076.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.127076.log.gz 2024-05-15T14:50:08.525 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139211.log 2024-05-15T14:50:08.526 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.94497.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.94497.log.gz 2024-05-15T14:50:08.527 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62055.log 2024-05-15T14:50:08.527 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.139211.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.139211.log.gz 2024-05-15T14:50:08.527 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104733.log 2024-05-15T14:50:08.528 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62055.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.62055.log.gz 2024-05-15T14:50:08.528 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60840.log 2024-05-15T14:50:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.104733.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104733.log.gz 2024-05-15T14:50:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74895.log 2024-05-15T14:50:08.530 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60840.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60840.log.gz 2024-05-15T14:50:08.531 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200364.log 2024-05-15T14:50:08.531 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.74895.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.74895.log.gz 2024-05-15T14:50:08.532 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66987.log 2024-05-15T14:50:08.532 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.200364.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.200364.log.gz 2024-05-15T14:50:08.533 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233898.log 2024-05-15T14:50:08.533 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.66987.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.66987.log.gz 2024-05-15T14:50:08.534 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202170.log 2024-05-15T14:50:08.534 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.233898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233898.log.gz 2024-05-15T14:50:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96905.log 2024-05-15T14:50:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.202170.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.202170.log.gz 2024-05-15T14:50:08.536 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124066.log 2024-05-15T14:50:08.536 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.96905.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96905.log.gz 2024-05-15T14:50:08.536 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81475.log 2024-05-15T14:50:08.537 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.124066.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.124066.log.gz 2024-05-15T14:50:08.537 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157968.log 2024-05-15T14:50:08.538 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.81475.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.81475.log.gz 2024-05-15T14:50:08.538 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57873.log 2024-05-15T14:50:08.539 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.157968.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.157968.log.gz 2024-05-15T14:50:08.539 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169406.log 2024-05-15T14:50:08.540 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57873.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.57873.log.gz 2024-05-15T14:50:08.540 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124668.log 2024-05-15T14:50:08.541 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.169406.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.169406.log.gz 2024-05-15T14:50:08.541 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84809.log 2024-05-15T14:50:08.542 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.124668.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.124668.log.gz 2024-05-15T14:50:08.543 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99314.log 2024-05-15T14:50:08.543 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.84809.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.84809.log.gz 2024-05-15T14:50:08.543 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105937.log 2024-05-15T14:50:08.544 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.99314.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.99314.log.gz 2024-05-15T14:50:08.544 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49445.log 2024-05-15T14:50:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.105937.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.105937.log.gz 2024-05-15T14:50:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218553.log 2024-05-15T14:50:08.546 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49445.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.49445.log.gz 2024-05-15T14:50:08.546 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234570.log 2024-05-15T14:50:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.218553.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.218553.log.gz 2024-05-15T14:50:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123464.log 2024-05-15T14:50:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234570.log.gz 2024-05-15T14:50:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119250.log 2024-05-15T14:50:08.549 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.123464.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.123464.log.gz 2024-05-15T14:50:08.549 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108947.log 2024-05-15T14:50:08.550 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.119250.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.119250.log.gz 2024-05-15T14:50:08.550 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234318.log 2024-05-15T14:50:08.551 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.108947.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.108947.log.gz 2024-05-15T14:50:08.551 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230074.log 2024-05-15T14:50:08.552 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234318.log.gz 2024-05-15T14:50:08.552 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128882.log 2024-05-15T14:50:08.553 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.230074.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.230074.log.gz 2024-05-15T14:50:08.553 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45915.log 2024-05-15T14:50:08.554 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.128882.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.128882.log.gz 2024-05-15T14:50:08.554 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.b.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-15T14:50:08.555 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40167.log 2024-05-15T14:50:08.555 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.45915.log: 83.4% -- replaced with /var/log/ceph/ceph-client.0.45915.log.gz 2024-05-15T14:50:08.555 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113155.log 2024-05-15T14:50:08.556 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40167.log.gz 2024-05-15T14:50:08.556 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50649.log 2024-05-15T14:50:08.557 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.113155.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.113155.log.gz 2024-05-15T14:50:08.557 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95701.log 2024-05-15T14:50:08.557 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50649.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.50649.log.gz 2024-05-15T14:50:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234066.log 2024-05-15T14:50:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.95701.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95701.log.gz 2024-05-15T14:50:08.559 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175541.log 2024-05-15T14:50:08.559 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.234066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234066.log.gz 2024-05-15T14:50:08.560 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122260.log 2024-05-15T14:50:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.175541.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.175541.log.gz 2024-05-15T14:50:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43923.log 2024-05-15T14:50:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.122260.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.122260.log.gz 2024-05-15T14:50:08.562 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135599.log 2024-05-15T14:50:08.562 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.43923.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.43923.log.gz 2024-05-15T14:50:08.563 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38987.log 2024-05-15T14:50:08.563 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.135599.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.135599.log.gz 2024-05-15T14:50:08.564 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38987.log.gz 2024-05-15T14:50:08.813 INFO:teuthology.orchestra.run.smithi018.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-15T14:50:08.895 INFO:teuthology.orchestra.run.smithi070.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-15T14:50:09.539 INFO:teuthology.orchestra.run.smithi018.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-15T14:50:10.071 INFO:teuthology.orchestra.run.smithi070.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-15T14:50:10.685 INFO:teuthology.orchestra.run.smithi018.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-15T14:50:10.712 INFO:teuthology.orchestra.run.smithi070.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-15T14:50:10.865 INFO:teuthology.orchestra.run.smithi018.stderr: 97.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-15T14:50:12.280 INFO:teuthology.orchestra.run.smithi070.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-15T14:50:12.596 INFO:teuthology.orchestra.run.smithi070.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-15T14:50:15.750 INFO:teuthology.orchestra.run.smithi070.stderr: 97.5% -- replaced with /var/log/ceph/rgw.ceph.client.1.log.gz 2024-05-15T14:50:15.752 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-05-15T14:50:15.752 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m7.463s 2024-05-15T14:50:15.752 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m19.947s 2024-05-15T14:50:15.752 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.789s 2024-05-15T14:50:17.945 INFO:teuthology.orchestra.run.smithi018.stderr: 96.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-15T14:50:29.180 INFO:teuthology.orchestra.run.smithi018.stderr: 97.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-15T14:50:51.435 INFO:teuthology.orchestra.run.smithi018.stderr: 97.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-15T14:50:51.437 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-05-15T14:50:51.437 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m43.176s 2024-05-15T14:50:51.437 INFO:teuthology.orchestra.run.smithi018.stderr:user 1m17.439s 2024-05-15T14:50:51.437 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m3.017s 2024-05-15T14:50:51.438 INFO:tasks.ceph:Archiving logs... 2024-05-15T14:50:51.438 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/remote/smithi018/log 2024-05-15T14:50:51.439 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T14:50:58.640 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/remote/smithi070/log 2024-05-15T14:50:58.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T14:51:00.927 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-15T14:51:00.937 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-15T14:51:00.937 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T14:51:00.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T14:51:01.030 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-15T14:51:01.040 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-15T14:51:01.040 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T14:51:01.043 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T14:51:01.058 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-05-15T14:51:01.060 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-05-15T14:51:01.064 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T14:51:01.064 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-05-15T14:51:01.064 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +494us[ +524us] +/- 47ms 2024-05-15T14:51:01.064 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -922us[ -893us] +/- 52ms 2024-05-15T14:51:01.064 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +643us[ +643us] +/- 90ms 2024-05-15T14:51:01.064 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:51:01.065 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T14:51:01.065 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-05-15T14:51:01.065 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 +496us[ +517us] +/- 47ms 2024-05-15T14:51:01.066 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -934us[ -913us] +/- 52ms 2024-05-15T14:51:01.066 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +656us[ +676us] +/- 90ms 2024-05-15T14:51:01.066 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T14:51:01.066 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-15T14:51:01.075 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-15T14:51:01.076 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-15T14:51:01.085 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T14:51:01.175 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T14:51:01.241 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T14:51:01.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:51:01.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T14:51:01.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:51:01.303 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-15T14:51:01.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-15T14:51:01.322 INFO:teuthology.task.internal:Duration was 1854.004072 seconds 2024-05-15T14:51:01.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-15T14:51:01.331 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-15T14:51:01.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T14:51:01.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T14:51:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T14:51:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T14:51:01.737 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-15T14:51:01.738 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-05-15T14:51:01.738 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T14:51:01.802 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-05-15T14:51:01.802 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T14:51:01.835 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-15T14:51:01.835 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T14:51:01.844 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T14:51:01.902 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-15T14:51:01.903 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T14:51:01.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T14:51:02.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-15T14:51:02.052 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-15T14:51:02.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T14:51:02.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T14:51:02.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-15T14:51:02.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T14:51:02.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T14:51:02.143 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-05-15T14:51:02.167 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-05-15T14:51:02.192 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T14:51:02.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:51:02.209 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T14:51:02.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T14:51:02.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-15T14:51:02.257 INFO:teuthology.task.internal:Transferring archived files... 2024-05-15T14:51:02.258 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/remote/smithi018 2024-05-15T14:51:02.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T14:51:02.293 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131/remote/smithi070 2024-05-15T14:51:02.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T14:51:02.325 INFO:teuthology.task.internal:Removing archive directory... 2024-05-15T14:51:02.326 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T14:51:02.329 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T14:51:02.375 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-15T14:51:02.387 INFO:teuthology.task.internal:Not uploading archives. 2024-05-15T14:51:02.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-15T14:51:02.396 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-15T14:51:02.396 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T14:51:02.399 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T14:51:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 15 14:51 /home/ubuntu/cephtest 2024-05-15T14:51:02.430 INFO:teuthology.orchestra.run.smithi070.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 15 14:51 /home/ubuntu/cephtest 2024-05-15T14:51:02.431 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-15T14:51:02.441 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-15T14:51:02.464 INFO:teuthology.nuke:Checking targets against current locks 2024-05-15T14:51:02.489 DEBUG:teuthology.nuke:shortname: smithi018 2024-05-15T14:51:02.489 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T14:51:02.514 DEBUG:teuthology.nuke:shortname: smithi070 2024-05-15T14:51:02.514 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T14:51:02.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 14:11:36.897022', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIGOiAIRywfNHhWu0feBiCiJEU5I0oNDSPwZrcxt0GCoF9sa5bTlzG/6k1J/bg/hpQ3oKsM7gIQcq25EBhpzxk='} 2024-05-15T14:51:02.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-15_14:09:14-rgw-wip-cbodley-testing-distro-default-smithi/7707131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 14:11:36.898826', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOK62w/SYOggCcBf7HbhO/NdjNBJKXIwv9zvxVfBaFvjYxJZ5I6pD8oBMjxGTnJpeZUfg85b/RCzg3ws4lUg4zU='} 2024-05-15T14:51:02.571 INFO:teuthology.orchestra.console.smithi018:Power off 2024-05-15T14:51:02.571 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-15T14:51:02.596 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2024-05-15T14:51:02.597 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T14:51:02.612 INFO:teuthology.orchestra.console.smithi070:Power off 2024-05-15T14:51:02.612 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-15T14:51:02.622 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-05-15T14:51:02.635 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-05-15T14:51:02.635 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T14:51:02.659 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-05-15T14:51:06.623 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T14:51:06.660 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T14:51:06.733 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-05-15T14:51:06.769 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-05-15T14:51:10.736 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T14:51:10.770 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T14:51:10.849 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-05-15T14:51:10.881 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-05-15T14:51:10.950 INFO:teuthology.orchestra.console.smithi018:Power off completed 2024-05-15T14:51:10.982 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-05-15T14:51:11.088 INFO:teuthology.run:Summary data: description: rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/others/{0-install supported-distros/{centos_latest} test_others}} duration: 1854.004072189331 failure_reason: 'Command failed (bucket notification tests against different endpoints) on smithi018 with status 1: "BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a ''!kafka_test,!amqp_test,!amqp_ssl_test,!kafka_security_test,!modification_required,!manual_test''"' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e5faa567103245e4b07a2ab9a5a525ae status: fail success: false 2024-05-15T14:51:11.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-15T14:51:11.174 INFO:teuthology.run:FAIL